SyncAI.news, a Varaisys broadcasting
ColorRef: Calibrating Verbal Feedback for Color Revision
PL

Pablo Loyola, Andres Hoyos-Idrobo, Edison Marrese-Taylor, Colin Rowat, Alfredo Solano

· 1 min read

ResearcharXiv cs.CL

ColorRef: Calibrating Verbal Feedback for Color Revision

arXiv:2611.25653v1 Announce Type: new Abstract: People rarely specify an exact color when asking someone to revise a design: they might say \textit{a little darker} or \textit{more blue} after seeing a proposal. A language-model assistant must then infer not only which way to change the color, but how far. We study this distinction with \textsc{ColorRef}, a color reference game in which a model guesses a color from a description and a teacher, knowing a recorded target hidden from the guesser, supplies verbal corrections. On 1{,}000 crowd-sourced description--target pairs, three rounds of deterministic oracle feedback reduce mean target distance from 42.33 to 22.15 $\Delta E_{76}$. However, those corrections provide additional information, and improvement alone does not establish well-calibrated feedback following. A controlled Qwen3-14B diagnostic reveals a more specific failure: following a requested direction and ordering graded phrases do not guarantee a suitable step size; strong modifiers can induce excessive changes. We therefore measure each receiver's typical response to \textit{a little}, \textit{somewhat}, and \textit{much} on separate colors and select wording matched to its observed steps. On 128 held-out starting colors, calibration reduces one-step mean error from 12.36 to 6.86 for Qwen3-14B and from 11.06 to 5.89 for Gemma 4 12B against a fixed graded-wording rule. The benefit is concentrated on large corrections, with many unchanged cases and no consistent increase in threshold success. Our findings show that following the direction of feedback is not the same as making an appropriately sized revision.

Original source

This story was published by arXiv cs.CL and written by Pablo Loyola, Andres Hoyos-Idrobo, Edison Marrese-Taylor, Colin Rowat, Alfredo Solano. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News