A fact-checking tool based on Artificial Intelligence to fight disinformation on Telegram

Abstract
This article develops an automatic detection model based on natural learning by designing a useful tool for disinformation monitoring in Telegram that avoids the algorithmic bias of artificial intelligence. It is of relevance the monitoring of online platforms and messaging applications such as WhatsApp and Telegram because they have become tools for circumventing traditional verification controls, and, therefore, for conveying disinformation content. The goal of this work is to contribute with early warning mechanisms that allow early combatting of disinformation (prebunking), especially in media ecosystems prone to the dissemination of false content such as pre-election periods, wars or energy crises. The methodology used applies a systematic and structured approach that allows the design and development of the tool, as well as its subsequent evaluation and optimisation. The main result is the creation of an Artificial Intelligence model capable of detecting disinformation in Telegram, and which also allows the integration of these solutions in the information verification workflow through a friendly and easy-to-use interface, thus contributing to the field of fact-checking. The findings reveal lines of future research, including the adaptation of the tool for other platforms and the integration of new features.
References
Aguado-Guadalupe, G. & Bernaola-Serrano, I. (2020). Verificación en la infodemia de la Covid-19. El caso Newtral. Revista Latina De Comunicación Social, 78, 289-308. https://doi.org/10.4185/RLCS-2020-1478
Almansa-Martínez, A., Fernández-Torres, M. J., & Rodríguez-Fernández, L. (2022). Desinformación en España un año después de la COVID-19. Análisis de las verificaciones de Newtral y Maldita. Revista Latina De Comunicación Social, 80, 183-200. https://doi.org/10.4185/RLCS-2022-1538
Athira, A. B., Kumar, S. M., & Chacko, A. M. (2023). A systematic survey on explainable AI applied to fake news detection. Engineering Applications of Artificial Intelligence, 122, 106087. https://doi.org/10.1016/j.engappai.2023.106087
Baumgartner, J., Zannettou, S., Squire, M., & Blackburn, J. (2020). The Pushshift Telegram Dataset (arXiv:2001.08438). arXiv. https://doi.org/10.48550/arXiv.2001.08438
Bennett, W. L. & Livingston, S. (2018). The disinformation order: Disruptive communication and the decline of democratic institutions. European Journal of Communication, 33(2), 122-139. https://doi.org/10.1177/0267323118760317
Borges do Nascimento, I. J., Pizarro, A. B., Almeida, J. M., Azzopardi-Muscat, N., Gonçalves, M. A., Björklund, M., & Novillo-Ortiz, D. (2022). Infodemics and health misinformation: A systematic review of reviews. Bulletin of the World Health Organization, 100(9), 544-561. https://doi.org/10.2471/BLT.21.287654
Botha, J. G. & Pieterse, H. (2020). Fake news and deepfakes: A dangerous threat for 21st century information security. In B. K. Payne & H. Wu (Eds.), Proceedings of the 15th International Conference on Cyber Warfare and Security, Norfolk, Virginia, 12-13 March 2020 (pp. 57-66). Retrieved from http://hdl.handle.net/10204/11946
Bovet, A. & Grindrod, P. (2022). Organization and evolution of the UK far-right network on Telegram. Applied Network Science, 7(1). https://doi.org/10.1007/s41109-022-00513-8
Cartwright, B., Weir, G., Frank, R., & Padda, K. (2019). Deploying Artificial Intelligence to Combat Disinformation Warfare Identifying and Interdicting Disinformation Attacks Against Cloud-based Social Media Platforms. International Journal on Advances in Security, 12(3 & 4), 203-222. Retrieved from https://www.iariajournals.org/security/tocv12n34.html
Cartwright, B., Frank, R., Weir, G., & Padda, K. (2022). Detecting and responding to hostile disinformation activities on social media using machine learning and deep neural networks. Neural Computing and Applications, 34(18), 15141-15163. https://doi.org/10.1007/s00521-022-07296-0
Cazzamatta, R., & Santos, A. (2023). Checking verifications during the 2022 Brazilian run-off election: How fact-checking organizations exposed falsehoods and contributed to the accuracy of the public debate. Journalism, 14648849231196080. https://doi.org/10.1177/14648849231196080
European Commission (2022). 2022 strengthened Code of Practice on disinformation. Shaping Europe’s Digital Future. Retrieved from https://digital-strategy.ec.europa.eu/en/library/2022-strengthened-code-practice-disinformation
Demartini, G., Mizzaro, S., & Spina, D. (2020). Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities. IEEE Data Engineering Bulletin, 43(3), 65-74. Retrieved from http://sites.computer.org/debull/A20sept/p65.pdf
García Vivero, G. & López, X. (2021). La verificación de datos en Europa. Análisis de 5 iniciativas europeas: Maldita.es, Newtral, Pagella Politica, Les Décodeurs y BBC Reality Check. AdComunica, 235-264. https://doi.org/10.6035/2174-0992.2021.21.12
Gupta, A., Kumar, N., Prabhat, P., Gupta, R., Tanwar, S., Sharma, G., Bokoro, P. N., & Sharma, R. (2022). Combating Fake News: Stakeholder Interventions and Potential Solutions. IEEE Access, 10, 78268-78289. https://doi.org/10.1109/ACCESS.2022.3193670
Gursky, J., Riedl, M. J., Joseff, K., & Woolley, S. (2022). Chat Apps and Cascade Logic: A Multi-Platform Perspective on India, Mexico, and the United States. Social Media + Society, 8(2), 205630512210947. https://doi.org/10.1177/20563051221094773
Jiang, T., Li, J. P., Haq, A. U., Saboor, A., & Ali, A. (2021). A Novel Stacking Approach for Accurate Detection of Fake News. IEEE Access, 9, 22626-22639. https://doi.org/10.1109/ACCESS.2021.3056079
Kertysova, K. (2018). Artificial Intelligence and Disinformation: How AI changes the way disinformation is produced, disseminated, and can be countered. Security and Human Rights, 29, 55-81. https://doi.org/10.1163/18750230-02901005
Lyons, B., Mérola, V., Reifler, J., & Stoeckel, F. (2020). How Politics Shape Views Toward Fact-Checking: Evidence from Six European Countries. The International Journal of Press/Politics, 25(3), 469-492. https://doi.org/10.1177/1940161220921732
Maldita (2024, September 30). Los riesgos sin mitigar de los canales públicos de Telegram y pasos a seguir. Retrieved from https://maldita.es/nosotros/20240930/telegram-canales-riesgos-documento-politicas/
Manfredi Sánchez, J. L. & Ufarte Ruiz, M. J. (2020). Inteligencia artificial y periodismo - Artificial Intelligence and Journalism: una herramienta contra la desinformación. Revista CIDOB d’Afers Internacionals, 124, 49-72. Retrieved from https://www.jstor.org/stable/26975708
Muhammed T. S. & Mathew, S. (2022). The disaster of misinformation: A review of research in social media. International Journal of Data Science and Analytics, 13(4), 271-285. https://doi.org/10.1007/s41060-022-00311-6
Newman, N. (2024, June 17). Resumen y principales conclusiones del Informe de noticias digitales de 2024. Reuters Institute. Retrieved from https://reutersinstitute.politics.ox.ac.uk/digital-news-report/2024/dnr-executive-summary
Pérez-Curiel, C. & Rivas-de Roca, R. (2022). Realities and Challenges of a Democracy in Crisis. Impact of Disinformation and Populism on the Media System. In Á. Rocha, D. Barredo, P. C. López-López & I. Puentes-Rivera (Eds.), Communication and Smart Technologies. ICOMTA 2021. Smart Innovation, Systems and Technologies, 259. Singapore: Springer. https://doi.org/10.1007/978-981-16-5792-4_10
Piattini Velthuis, M. G., García Rubio, F. O., García-Rodríguez de Guzmán, I., & Pino, F. (2019). Calidad de Sistemas de Información (5th Ed.). Ra-Ma.
Porlezza, C. (2023). Promoting responsible AI: A European perspective on the governance of Artificial Intelligence in Media and Journalism. Communications, 48(3), 370-394 . https://doi.org/10.1515/commun-2022-0091
Pozo-Montes, Y. & León-Manovel, M. (2020). Plataformas fact-checking: las fakes news desmenti¬das por Newtral en la crisis del coronavirus en España. Revista Española De Comunicación En Salud, 103-116. https://doi.org/10.20318/recs.2020.5446
Reporteros Sin Fronteras. (2023, May 3). Clasificación Mundial de la Libertad de Prensa de Reporteros Sin Fronteras (RSF). Retrieved from https://www.rsf-es.org/clasificacion-2023-analisis-general-los-peligros-de-la-industria-del-engano/
Romero Vicente, A. (2023). Disinformation landscape in Spain. EU DisinfoLab. Retrieved from https://www.disinfo.eu/wp-content/uploads/2023/03/20230224_SP_DisinfoFS.pdf
Salaverría, R., Bachmann, I., & Magallón Rosa, R. (2024). Desinformación y confianza en los medios: propuestas de actuación. Index.Comunicación, 14(2), 13-32. https://doi.org/10.62008/ixc/14/02Yconfi
Salaverría, R. & Cardoso, G. (2023). Future of disinformation studies: Emerging research fields. Profesional De La información, 32(5). https://doi.org/10.3145/epi.2023.sep.25
Salaverría, R., Buslón, N., López-Pan, F., León, B., López-Goñi, I., & Erviti, M.-C. (2020). Desinformación en tiempos de pandemia: tipología de los bulos sobre la Covid-19. Profesional De La información, 29(3). https://doi.org/10.3145/epi.2020.may.15
Santini, R., Salles, D., & Barros, C. E. (2022). We love to hate George Soros: A cross-platform analysis of the Globalism conspiracy theory campaign in Brazil. Convergence: The International Journal of Research into New Media Technologies, 28(4), 983-1006. https://doi.org/10.1177/13548565221085833
Santini, R., Tucci, G., Salles, D., & de Almeida, A. R. D. (2021). Do You Believe in Fake After All? In Guillermo López-García, Dolors Palau-Sampio, Bella Palomo, Eva Campos-Domínguez & Pere Masip (Eds.), Politics of Disinformation: The Influence of Fake News on the Public Sphere (pp. 49-66). Wiley-Blackwell. https://doi.org/10.1002/9781119743347.ch4
Santos, F. C. C. (2023). Artificial Intelligence in Automated Detection of Disinformation: A Thematic Analysis. Journalism and Media, 4(2). https://doi.org/10.3390/journalmedia4020043
Schulze, H., Hohner, J., Greipl, S., Girgnhuber, M., Desta, I., & Rieger, D. (2022). Far-right conspiracy groups on fringe platforms: A longitudinal analysis of radicalization dynamics on Telegram. Convergence: The International Journal of Research into New Media Technologies, 28(4), 1103-1126. https://doi.org/10.1177/13548565221104977
Sosa, J., & Sharoff, S. (2022). Multimodal Pipeline for Collection of Misinformation Data from Telegram (arXiv:2204.12690). arXiv. http://arxiv.org/abs/2204.12690
Stencel, M., Ryan, E., & Luthor, J. (2023, June 21). Misinformation spreads, but fact-checking has leveled off. Duke Reporters’ Lab. Retrieved from https://www.poynter.org/fact-checking/2023/duke-reporters-lab-fact-checking-census-2023/
Tandoc, E. C., Lim, Z. W., & Ling, R. (2018). Defining “Fake News”: A typology of scholarly definitions. Digital Journalism, 6(2), 137-153. https://doi.org/10.1080/21670811.2017.1360143
Tsfati, Y. (2003). Media skepticism and climate of opinion perception. International Journal of Public Opinion Research, 15, 65-82. https://doi.org/10.1093/ijpor/15.1.65
Tsfati, Y. & Peri, Y. (2006). Mainstream Media Skepticism and Exposure to Sectorial and Extranational News Media: The Case of Israel. Mass Communication and Society, 9(2), 165-187. https://doi.org/10.1207/s15327825mcs0902_3
Ufarte-Ruiz, M.-J., Peralta-García, L., & Murcia-Verdú, F.-J. (2018). Fact checking: un nuevo desafío del periodismo. Profesional De La información, 27(4), 733-741. https://doi.org/10.3145/epi.2018.jul.02
Ufarte-Ruiz, M. J., Anzera, G., & Murcia-Verdú, F. J. (2020). Plataformas independientes de fact-checking en España e Italia. Características, organización y método. Revista Mediterránea de Comunicación, 11(2), 23-39. https://www.doi.org/10.14198/MEDCOM2020.11.2.3
Directive (EU) 2018/1808 of the European Parliament and of the Council of 14 November 2018 amending Directive 2010/13/EU on the coordination of certain provisions laid down by law, regulation or administrative action in Member States concerning the provision of audiovisual media services (Audiovisual Media Services Directive) in view of changing market realities. Official Journal of the European Union, L303, 28 November 2018, pp. 69-92. Retrieved from https://www.boe.es/doue/2018/303/L00069-00092.pdf
Vázquez-Herrero, J., Negreira-Rey, M. C., & López-García, X. (2023). Misinformation on Trial: Media Coverage of a Murder, Public Conversation and Fact-Checking. Journalism Practice, 17(10), 2218-2240. https://doi.org/10.1080/17512786.2022.2164328
Wardle, C. & Derakhshan, H. (2017). Information Disorder: Toward an interdisciplinary framework for research and policy making. Council of Europe. Retrieved from https://rm.coe.int/information-disorder-toward-an-interdisciplinary-framework-for-researc/168076277c
Zimmermann, F. & Kohring, M. (2020). Mistrust, Disinforming News, and Vote Choice: A Panel Survey on the Origins and Consequences of Believing Disinformation in the 2017 German Parliamentary Election. Political Communication, 37(2), 215-237. https://doi.org/10.1080/10584609.2019.1686095
Section
RIGHTS TRANSFER
By submitting the article for evaluation and subsequent publication in Communicaton & Society, the AUTHOR grants exclusive economic and/or exploitation rights: reproduction, distribution, public communication, transformation/translation/creation of derivative works, and commercialisation to the University of Navarra through its Publications Service, for the maximum legal period in force -the author's lifetime and seventy years after his or her death or declaration of death-, in any country, and in any of the current and future publishing modalities, both in print and electronic versions.
In the event that the article is not accepted for publication, this transfer of rights lapses with the communication of the refusal to the AUTHOR.
The AUTHOR affirms that the article is unpublished, that it has not been sent simultaneously to another publication medium and that the rights have not been transferred exclusively previously. He is responsible to the University of Navarra through its Publications Service for the authorship and originality of his work, as well as for all pecuniary charges that may arise for the University of Navarra through its Publications Service, in favor of third parties due to actions, claims or conflicts arising from the breach of obligations by the AUTHOR.