Social Science Research Council Research AMP Just Tech
Citation

Generative Artificial Intelligence and Disinformation

Author:
Krack, Noémie; Dutkiewicz, Lidia; De Meyere, Jean
Year:
2025

The impact of Generative Artificial Intelligence (Gen AI) on the information ecosystem has garnered significant attention, especially since 2024 was a crit-ical year for elections worldwide. This chapter investigates the relationship between Gen AI and the creation, dissemination, and amplification of disin-formation. It aims to debunk myths about Gen AI, and to clarify its capabilities and limitations. As a technology based on mathematical and statistical theories, Gen AI does not understand the content it produces. While it does not disinform itself, it can be misused for disinformation purposes. The chapter explores the disinformation considerations associated with the different stages of Gen AI: the input phase, the prompt stage, the output and use stage. It includes recent examples of disinformation involving text, images, video, and audio generated by AI. The debated risks of Gen AI for disinformation are addressed, noting that while Gen AI may not drastically alter the disinformation landscape, human actors remain the primary drivers. How-ever, extensive research is needed to assess its full impact. The chapter also examines how recent European Union (EU) regulatory and policy instruments cover Gen AI. Preliminary analysis focuses on the AI Act, the Digital Services Act (DSA), the Gender-Based Violence Directive, the European Media Freedom Act, Guidelines on the mitigation of systemic risks for electoral processes, and the Strengthened Code of Practice on Disinformation.