Companies and Regulators Scramble to Counter the Threat of AI Deception

AI deception is increasingly worrisome to regulators and businesses, but new tools and strategies can counter this threat and safeguard the public from fraud.

AI deception is increasingly worrisome to regulators and businesses, but new tools and strategies can counter this threat and safeguard the public from fraud.

How do we decide whether a human, artificial intelligence (AI) or a combination of the two created a piece of text? Some studies find that more than half of individuals cannot accurately identify content made by AI chatbots such as ChatGPT.#1: How Al-generated content detection ranked in educational challenges in a survey among educators in 2023, versus #10 in 2022

The implication for regulators, businesses and the public at large is that many are susceptible to AI manipulation without realizing it. This can have troubling and profound consequences for society, as AI content can potentially influence large swaths of the population based on false premises.

The “Generative AI Tracker®” examines the challenge of detecting AI-generated content and distinguishing it from human-created material. This edition explores new AI tools and strategies organizations are developing and deploying to counter the threat of AI-generated fraud and the measures government regulators are proposing to safeguard the public.

Generative AI Tools Are Promising but Not Foolproof

3%: ChatGPT’s accuracy in June 2023 in identifying prime numbers compared to the 98% success rate it achieved doing the same task in March, in what experts call “drift”As generative AI grows, countermeasures being developed to detect artificially generated content are close behind. Companies such as Originality.ai, Turnitin and Copyleaks are designing tools that discern between unique content and content compiled from online material. These tools are promising but not infallible, as their accuracy can be challenging to measure and varies widely.

To learn more, visit the Tracker’s Companies of Note section.

Academia, News and Publishers: Early Adopters of AI Content Detection

Just as financial organizations prioritize fraud detection, industries and institutions that depend on authentic, trustworthy content to preserve their integrity seek technologies that can correctly and comprehensively identify AI-generated content. These sectors include academia, publishers and research and news organizations.

To learn more, visit the Tracker’s Innovation and Use Cases section.

Tackling AI With AI May Not Be Ideal. Not Yet, at Least

74%: Proportion of Al-produced text that OpenAl's classifier tool missed detectingAs generative AI grows by leaps and bounds, countermeasures to keep tabs on artificially generated content are emerging. Interestingly, those content scouts are AI tools themselves. The challenge for companies developing these solutions is not just that their tools are new, unproven and offer mixed success, but also that these tools’ capabilities will be increasingly stretched as AI-generated content grows and becomes more humanlike.

To learn more, visit the Tracker’s Issues and Challenges section.

About the Tracker

The “Generative AI Tracker®,” a collaboration with AI-ID, examines the challenge of detecting AI-generated content and distinguishing it from human-created material.