
YQ
Yufei Qi, Chonghe Jiang
· 1 min read
ResearcharXiv cs.LG
Prune to Probe: Causal Decision-Stability Probes for Efficient Reasoning
arXiv:2611.11034v1 Announce Type: new
Abstract: Reasoning models often continue generating after producing an answer, yet stopping prematurely may interrupt useful verification or revision. In this work, we investigate whether targeted interventions in a model's internal computation can provide a reliable signal for when to stop reasoning. We introduce Prune-to-Probe, an inference-time controller that uses causal activation interventions to probe the stability of a model's current answer. Specifically, we identify late-MLP coordinates that contribute to post-answer continuation while excluding those important for answer completion. Once an answer is stated, Prune-to-Probe temporarily suppresses the selected coordinates and measures the resulting stopping response relative to matched random interventions. Crucially, these interventions serve only as probes: the model either returns its existing answer or resumes generation from an untouched cache. On MATH, Prune-to-Probe reduces reasoning-token forwards by 2.60%, preserving all naturally correct trajectories while repairing six errors. On MMLU-Pro, it achieves 1.145% pooled savings with no observed harm. Further analysis shows that the intervention captures decision stability rather than correctness (AUROC 0.502). These results demonstrate the potential of causal activation probes for efficient inference-time control without permanent model modification.
Original source
This story was published by arXiv cs.LG and written by Yufei Qi, Chonghe Jiang. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


