New research by Flinder’s University has found that Generative AI failed the publishing test. Generative AI is prized for its capacity to create text, images, and video. The study was used to test how false information about health and medical issues may be created and spread.
In the study, researchers attempted to create disinformation about vaping and vaccines using Generative AI tools for text, image and video creation.
In just over an hour, they produced over 100 misleading blogs, 20 deceptive images, and a convincing deep-fake video purporting health disinformation. Alarmingly this video could be adapted into over 40 languages, amplifying its potential harm.
Bradley Menz, first author, registered pharmacist and Flinders University researcher says he has serious concerns about the findings, drawing upon prior examples of disinformation pandemics that have led to fear, confusion and harm.
“The implications of our findings are clear: society currently stands at the cusp of an AI revolution, yet in its implementation governments must enforce regulations to minimise the risk of malicious use of these tools to mislead the community,” says Mr Menz.
“Our study demonstrates how easy it is to use currently accessible AI tools to generate large volumes of coercive and targeted misleading content on critical health topics, complete with hundreds of fabricated clinician and patient testimonials and fake, yet convincing, attention-grabbing titles
“We propose that key pillars of pharmacovigilance – including transparency, surveillance and regulation – serve as valuable examples for managing these risks and safeguarding public health amidst the rapidly advancing AI technologies,” he says.
The investigations, beyond illustrating concerning scenarios, underscore an urgent need for robust AI vigilance. It also highlights important roles healthcare professionals can play in proactively minimising and monitoring risks related to misleading health information generated by artificial intelligence.
The research investigated OpenAI’s GPT Playground for its capacity to facilitate the generation of large volumes of health-related disinformation.
Within OpenAI’s GPT Playground the researchers generated 102 distinct blog articles, containing more than 17,000 words of disinformation related to vaccines and vaping, in just 65 minutes. Further, within 5 minutes, using AI avatar technology and natural language processing the team generated a concerning deepfake video featuring a health professional promoting disinformation about vaccines. The video could easily be manipulated into over 40 different languages.
Dr Ashley Hopkins from the College of Medicine and Public Health and senior author says that there is a clear need for AI developers to collaborate with healthcare professionals to ensure that AI vigilance structures focus on public safety and well-being.
“We have proven that when the guardrails of AI tools are insufficient, the ability to rapidly generate diverse and large amounts of convincing disinformation is profound. Now there is an urgent need for transparent processes to monitor, report, and patch issues in AI tools,” says Dr Hopkins.
