Valeriano Piñeiro-Naval e-mail(Login required)

Main Article Content

Authors

Valeriano Piñeiro-Naval e-mail(Login required)

Abstract

1713

Based on a conceptual review of the content analysis research method, this article identifies meta-research studies that confirm the relevance of this technique in the atomised field of communication sciences. In light of the empirical evidence, this study is based on an analysis of 262 papers that use this tool and were published in major Spanish-language journals between 2013 and 2017. At instrumental level, bibliometric exploration is combined with content analysis itself, considering 18 categories, such as authorship, funding, sampling method and reporting of intercoder reliability. The results indicate that there is a steady annual growth in the number of papers produced by researchers affiliated to Spanish universities. These papers have more than two authors on average and often lack additional financial resources. As for the implementation of the content analysis method, it is generally applied to non-probabilistic samples and does not involve any intercoder reliability assessment and reporting. A series of recommendations are offered for researchers in Spain and in Latin America to meet international standards.

Keywords

Content analysis, research methods, meta-research, journals, communication, spain, Latin America

References

Bardin, L. (1986). Análisis de contenido. Madrid: Akal.

Berelson, B. (1952). Content analysis in communication research. Glencoe: Free Press.

Berger, A. A. (2016). Media and communication research methods. An introduction to qualitative and quantitative approaches (4th Ed.). Thousand Oaks, CA: Sage.

Bermejo-Berros, J. (2014). Evolución de los paradigmas, metodologías y campos de la comunicación en Revista Latina de Comunicación Social durante la década 2004-2013. Revista Latina de Comunicación Social, 69, 330-353. https://www.doi.org/10.4185/RLCS-2014-1014

Borah, P. (2017). Emerging communication technology research: Theoretical and methodological variables in the last 16 years and future directions. New Media & Society, 19(4), 616-636. https://www.doi.org/10.1177/1461444815621512

Bos, W. & Tarnai, C. (1999). Content analysis in empirical social research. International Journal of Educational Research, 31(8), 659-671. https://www.doi.org/10.1016/S0883-0355(99)00032-4

Boumans, J. W. & Trilling, D. (2016). Taking stock of the toolkit: An overview of relevant automated content analysis approaches and techniques for digital journalism scholars. Digital Journalism, 4(1), 8-23. https://www.doi.org/10.1080/21670811.2015.1096598

Bryant, J. & Miron, D. (2004). Theory and research in mass communication. Journal of Communication, 54(4), 662-704. https://www.doi.org/10.1111/j.1460-2466.2004.tb02650.x

Caffarel-Serra, C. (2018). La metainvestigación en comunicación, una necesidad y una oportunidad. adComunica, 15, 293-295. https://www.doi.org/10.6035/2174-0992.2018.15.16

Caffarel-Serra, C., Ortega-Mohedano, F. & Gaitán-Moya, J. A. (2017). Investigación en Comunicación en la universidad española en el periodo 2007-2014. El Profesional de la Información, 26(2), 218-227. https://www.doi.org/10.3145/epi.2017.mar.08

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd Ed.). Hillsdale, NJ: Lawrence Earlbaum.

Deacon, D., Pickering, M., Golding, P. & Murdock, G. (1999). Researching communications. A practical guide to methods in media and cultural analysis. London: Arnold Publishers.

Denzin, N. K. (2012). Triangulation 2.0. Journal of Mixed Methods Research, 6(2), 80-88. https://www.doi.org/10.1177/1558689812437186

Denzin, N. K. (2015). Triangulation. In G. Ritzer (Ed.), The Blackwell Encyclopedia of Sociology (pp. 1-6). NJ: Wiley & Sons. https://www.doi.org/10.1002/9781405165518.wbeost050.pub2

Downe‐Wamboldt, B. (1992). Content analysis: Method, applications, and issues. Health Care for Women International, 13(3), 313-321. https://www.doi.org/10.1080/07399339209516006

Escribà, E. & Cortiñas, S. (2013). La internacionalización y las coautorías en las principales revistas científicas de Comunicación en España. Comunicar, 21(41), 35-44. https://www.doi.org/10.3916/C41-2013-03.

Espín, J. V. (2009). El análisis de contenido: una técnica para explorar y sistematizar información. Revista de Educación, 4, 95-105.

Fernández-Quijada, D. & Masip, P. (2013). Tres décadas de investigación española en comunicación: hacia la mayoría de edad. Comunicar, 21(41), 15-24. https://www.doi.org/10.3916/C41-2013-01

Goyanes, M., Rodríguez-Gómez, E. F. & Rosique-Cedillo, G. (2018). Investigación en comunicación en revistas científicas en España (2005-2015): de disquisiciones teóricas a investigación basada en evidencias. El Profesional de la Información, 27(6), 1281-1291. https://www.doi.org/10.3145/epi.2018.nov.11

Johnson, B. T., Scott-Sheldon, L. A. J., Snyder, L. B., Noar, S. M. & Huedo-Medina, T. B. (2008). Contemporary approaches to meta-analysis in communication research. In A. F. Hayes, M. D. Slater & L. B. Snyder (Eds.), The SAGE Sourcebook of Advanced Data Analysis Methods for Communication Research (pp. 311-347). Thousand Oaks, CA: Sage.

Hayes, A. F. & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77-89. https://www.doi.org/10.1080/19312450709336664

Henry, G. T. (1990). Practical sampling. Newbury Park, CA: Sage. https://www.doi.org/10.4135/9781412985451

Holsti, O. R. (1968). Content Analysis. In G. Lindzey & E. Aronson (Eds.), The Handbook of Social Psychology (pp. 596-692). Oxford: Addison-Wesley.

Igartua, J. J. (2006). Métodos cuantitativos de investigación en comunicación. Barcelona: Bosch.

Ioannidis, J. P. A. (2018). Meta-research: Why research on research matters. PLOS Biology, 16(3), e2005468. https://www.doi.org/10.1371/journal.pbio.2005468

Kim, Y., Kim, B., Kim, Y. & Wang, Y. (2017). Mobile communication research in communication journals from 1999 to 2014. New Media & Society, 19(10), 1668-1691. https://www.doi.org/10.1177/1461444817718162

Krippendorff, K. (1990). Metodología de análisis de contenido. Teoría y práctica. Barcelona: Paidós Comunicación.

Krippendorff, K. (2004). Reliability in content analysis. Some common misconceptions and recommendations. Human Communication Research, 30(3), 411-433. https://www.doi.org/10.1111/j.1468-2958.2004.tb00738.x

Krippendorff, K. (2011). Agreement and information in the reliability of coding. Communication Methods and Measures, 5(2), 93-112. https://www.doi.org/10.1080/19312458.2011.568376

Krippendorff, K. (2013). Commentary: A Dissenting View on So-Called Paradoxes of Reliability Coefficients. Annals of the International Communication Association, 36(1), 481-499. https://www.doi.org/10.1080/23808985.2013.11679143

Krippendorff, K. (2017). Reliability. In J. Matthes, C. S. Davis & R. F. Potter (Eds.), The International Encyclopaedia of Communication Research Methods (pp. 1-28). NJ: Wiley & Sons. https://www.doi.org/10.1002/9781118901731.iecrm0210

Lacy, S., Watson, B. R., Riffe, D. & Lovejoy, J. (2015). Issues and best practices in content analysis. Journalism & Mass Communication Quarterly, 92(4), 791-811. https://www.doi.org/10.1177/1077699015607338

Lombard, M., Snyder-Duch, J. & Campanella, C. (2002). Content analysis in mass communication. Assessment and reporting of intercoder reliability. Human Communication Research, 28(4), 587-604. https://www.doi.org/10.1111/j.1468-2958.2002.tb00826.x

Lovejoy, J., Watson, B. R., Lacy, S. & Riffe, D. (2016). Three decades of reliability in communication content analyses: Reporting of reliability statistics and coefficient levels in three top journals. Journalism & Mass Communication Quarterly, 93(4), 1135-1159. https://www.doi.org/10.1177/1077699016644558

Lozano, J. C. (1994). Hacia la reconsideración del análisis de contenido en la investigación de los mensajes comunicacionales. In C. Cervantes & E. Sánchez (Eds.), Investigar la comunicación: propuestas iberoamericanas (pp. 135-157). México: Universidad de Guadalajara, CEIC, ALAIC.

Martín-López, E. (1963). El análisis de contenido. Revista de estudios políticos, 132, 45-64.

Martínez-Nicolás, M., Saperas, E. & Carrasco-Campos, Á. (2019). La investigación sobre comunicación en España en los últimos 25 años (1990-2014). Objetos de estudio y métodos aplicados en los trabajos publicados en revistas españolas especializadas. Empiria. Revista de metodología de ciencias sociales, 42, 37-69. https://www.doi.org/10.5944/empiria.42.2019.23250

Naccarato, J. L. & Neuendorf, K. A. (1998). Content Analysis as a Predictive Methodology: Recall, Readership, and Evaluations of Business-to-Business Print Advertising. Journal of Advertising Research, 38, 19-29.

Neuendorf, K. A. (2009). Reliability for content analysis. In A. B. Jordan, D. Kunkel, J. Manganello & M. Fishbein (Eds.), Media messages and public health: A decisions approach to content analysis (pp. 67-87). New York: Routledge.

Neuendorf, K. A. (2017). The content analysis guidebook (2nd Ed.). Thousand Oaks, CA: Sage.

Piñeiro-Naval, V., Igartua, J. J., Marañón-Lazcano, F. J. & Sánchez-Nuevo, L. A. (2018). El análisis de contenido y su aplicación a entornos web: un caso empírico. In C. Caffarel, J. A. Gaitán, C. Lozano & J. L. Piñuel (Eds.), Tendencias metodológicas en la investigación académica sobre Comunicación (pp. 253-272). Salamanca: Comunicación Social.

Piñeiro-Naval, V. & Mangana, R. (2018). Teoría del encuadre: Panorámica conceptual y estado del arte en el contexto hispano. Estudios sobre el Mensaje Periodístico, 24(2), 1541-1557. https://www.doi.org/10.5209/ESMP.62233

Piñeiro-Naval, V. & Mangana, R. (2019). La presencia del framing en los artículos publicados en revistas hispanoamericanas de comunicación indexadas en Scopus. Palabra Clave, 22(1), e2216. https://www.doi.org/10.5294/pacla.2019.22.1.6

Piñeiro-Naval, V. & Morais, R. (2019). Study of the academic production on communication in Spain and Latin America. Comunicar, 27(61), 108-117. https://www.doi.org/10.3916/C61-2019-10

Piñuel, J. L. (2002). Epistemología, metodología y técnicas del análisis de contenido. Estudios de Sociolingüística, 3(1), 1-42.

Riffe, D. & Freitag, A. (1997). A content analysis of content analyses: Twenty-five years of Journalism Quarterly. Journalism & Mass Communication Quarterly, 74(3), 515-524. https://www.doi.org/10.1177/107769909707400306

Riffe, D., Lacy, S. & Fico, F. (2014). Analyzing Media Messages. Using Quantitative Content Analysis in Research (3rd Ed.). New York: Routledge.

Rodríguez-Gómez, E. F., Goyanes, M. & Rosique-Cedillo, G. (2018). Communication Research in Spain: Labor Temporality, Intensive Production and Competitiveness. Communication & Society, 31(4), 229-242. https://www.doi.org/10.15581/003.31.4.229-242

Saperas, E. & Carrasco-Campos, Á. (2015). The operationalization of the concept of “framing” in the “Journal of Communication” (2009-2013): objects of study, research techniques and theoretical construction. Communication & Society, 28(4), 49-66. https://www.doi.org/10.15581/003.28.4.sp.49-66

Saperas, E. & Carrasco-Campos, Á. (2018). Journalism research: a dominant field of communication research in Spain. A meta-research on Spanish peer-reviewed journals (2000-2014). Estudos em Comunicação, 26(1), 281-300. https://www.doi.org/10.20287/ec.n26.v1.a16

Saperas, E. & Carrasco-Campos, Á. (2019). ¿Cómo investigamos la comunicación? La meta-investigación como método para el estudio de las prácticas de investigación en los artículos publicados en revistas científicas. In F. Sierra Caballero & J. Alberich Pascual (Eds.), Epistemología de la comunicación y cultura digital: retos emergentes (pp. 217-230). Granada: Universidad de Granada.

Trilling, D. & Jonkman, J. G. (2018). Scaling up content analysis. Communication Methods and Measures, 12(2-3), 158-174. https://www.doi.org/10.1080/19312458.2018.1447655

Vicente-Mariño, M. & López-Rabadán, P. (2009). Resultados actuales de la investigación sobre framing: sólido avance internacional y arranque de la especialidad en España. Zer. Revista de Estudios de Comunicación, 14(26), 13-34.

Walter, N., Cody, M. J. & Ball-Rokeach, S. J. (2018). The Ebb and Flow of Communication Research: Seven Decades of Publication Trends and Research Priorities. Journal of Communication, 68(2), 424-440. https://www.doi.org/10.1093/joc/jqx015

White, M. D. & Marsh, E. E. (2006). Content analysis: a flexible methodology. Library Trends, 55(1), 22-45.

Wimmer, R. D. & Dominick, J. R. (2011). Mass Media Research: An Introduction (9th Ed.). Boston: Wadsworth.

Zamith, R. & Lewis, S. C. (2015). Content analysis and the algorithmic coder: What computational social science means for traditional modes of media analysis. The ANNALS of the American Academy of Political and Social Science, 659(1), 307-318. https://www.doi.org/10.1177/0002716215570576

Zhao, X., Liu, J. S. & Deng, K. (2013). Assumptions behind Intercoder Reliability Indices. Annals of the International Communication Association, 36(1), 419-480. https://www.doi.org/10.1080/23808985.2013.11679142

Metrics





Search GoogleScholar


Details

Article Details

Section
Articles