
MD
Matthieu Dubois, Pablo Piantanida, Fran\c{c}ois Yvon
· 1 min read
ResearcharXiv cs.CL
How Much Were You Told? Measuring External Information in Peer Reviews
arXiv:2609.28041v1 Announce Type: new
Abstract: Conference policies distinguish using Large Language Models (LLMs) to polish one's own review from delegating the critique, but current Artificial Text Detection (ATD) methods largely measure surface form rather than the origin of its content. We instead measure the external information carried by a review: information not explained by the reviewed paper and a generic reviewing instruction. We propose Self-Conditioning, an unsupervised information-theoretic estimator that compares the likelihood of a review under its production context with its likelihood when that context is augmented with hints extracted from the review itself. On the IntelLabs peer-review benchmark, Self-Conditioning separates fully-delegated from machine-polished reviews with AUC up to $1.0$ while remaining largely insensitive to surface rewriting. Moreover, as generators receive increasing amounts of externally-provided information, their scores move monotonically towards the human regime, unlike standard ATD baselines. High-temperature sampling can evade the estimator, but at the cost of output quality.
Original source
This story was published by arXiv cs.CL and written by Matthieu Dubois, Pablo Piantanida, Fran\c{c}ois Yvon. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


