Social Science Research Council Research AMP Just Tech
Citation

How Spammers and Scammers Leverage AI-Generated Images on Facebook for Audience Growth

Author:
DiResta, Renee; Goldstein, Josh A.
Year:
2024

Much of the research and discourse on risks from artificial intelligence (AI) image generators, such as DALL-E and Midjourney, has centered around whether they could be used to inject false information into political discourse. We show that spammers and scammers – seemingly motivated by profit or clout, not ideology – are already using AI-generated images to gain significant traction on Facebook. At times, the Facebook Feed is recommending unlabeled AI-generated images to users who neither follow the Pages posting the images nor realize that the images are AI-generated, highlighting the need for improved transparency and provenance standards as AI models proliferate.