
CC
Claudiu Creanga, Liviu Dinu
· 1 min read
ResearcharXiv cs.CL
Ontological Instability and Statistical Amplification: The Paradox of "Humanizing" LLM-Generated Text
arXiv:2610.03110v1 Announce Type: new
Abstract: Supervised AI-text detectors report high benchmark accuracy, but it is not clear what their decisions are based on. We analyze a RoBERTa-based detector under semantic, structural, and tokenizer-level perturbations, using the M4 dataset (N = 10,000) and controlled generations (N = 300). When Mistral-7B-Instruct was asked to make machine text sound more human, Verb Diversity rose from 0.77 to 0.92 and the outputs became easier to detect. Detection scores appear to track statistical complexity, which also leads to a 76.3% false-positive rate on formal human writing. As a control, we evaluate event-based Latent Space detection. Paraphrasing changed 87% of its event sequences (Jaccard = 0.067), and homoglyphs altered 70% of the extracted verbs even though extraction still ran (Jaccard = 0.30). Its best domain AUC was 0.577. RoBERTa's robustness seems specific to the features it uses, and structural abstraction did not make detection more robust.
Original source
This story was published by arXiv cs.CL and written by Claudiu Creanga, Liviu Dinu. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


