SyncAI.news, a Varaisys broadcasting
AI Has Endless Answers But A Shrinking Supply Of Human Truth
GD

Gary Drenik, Contributor

· 1 min read

World NewsForbes: Innovation

AI Has Endless Answers But A Shrinking Supply Of Human Truth

Progress in the AI realm has historically focused on measuring chip efficiency and monitoring parameters; however, as the internet that trained today’s models has become full of text written by those same models, a new constraint is becoming increasingly visible: the supply of original, verifiable human data.

SEO firm Graphite, for instance, recently went through over fifty thousand English-language articles from Common Crawl and found that roughly half of them were AI-generated. That’s not all; that trend (of AI content flooding the interweb) has been prevalent since the beginning of last year and shows no signs of slowing down any time soon.

On the subject, Trevor Koverko, co-founder of Sapien, a platform that pays people to label and verify AI training data, believes that as the internet continues to saturate with AI-generated data, “a fresh observation from a real person becomes more valuable,” adding:

“Models can generate endless plausible answers. They still need evidence of what actually happened, what worked and where they got it wrong.”

When Models Learn From Themselves

The risk of leaning on machine-made data is well documented, and in a joint research paper published by Oxford and Cambridge, it was made clear that the indiscriminate use of model-generated content in training is causing “irreversible defects in resultant models.”

Not only that, but the team also concluded that data from genuine human interactions is becoming increasingly rare and valuable, especially with the prevalence of LLM-generated content continuing to seep into what gets crawled from the web.

Koverko is wary of diagnosing collapse in a commercial model from the outside, but the symptoms, in his view, are familiar, i.e., polished, repetitive answers that miss unusual cases. Synthetic data works where answers can be checked against code, math, or a simulator, and far less well where they depend on judgment.

Original source

This story was published by Forbes: Innovation and written by Gary Drenik, Contributor. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on forbes.com

Similar News