
GL
Guanda Li, Xuefeng Bai, Yulong Chen, Zhiyong Wang, Kehai Chen, Min Zhang
· 1 min read
ResearcharXiv cs.CL
Learning to Reason Efficiently with Interventional Step Credit
arXiv:2610.25876v1 Announce Type: new
Abstract: Large reasoning models often produce lengthy chain-of-thought (CoT) traces mixing useful intermediate steps with unnecessary ones. Recent methods explore step-level signals such as attention mass and step entropy to identify and suppress unnecessary steps. Despite their effectiveness, such signals reflect the model's behavior at a step rather than that step's contribution to the answer. To address this, we propose the interventional step credit (ISC), which takes a causal-intervention view and assesses step importance to the reasoning through targeted parameter-level interventions. Building on ISC, we further propose IGPO, which uses ISC to guide fine-grained advantage rescaling in reinforcement learning, reducing redundant steps while preserving the important ones. Experiments across two model scales and nine benchmarks show that IGPO achieves up to 62% average token reduction and better overall performance among compared methods.
Original source
This story was published by arXiv cs.CL and written by Guanda Li, Xuefeng Bai, Yulong Chen, Zhiyong Wang, Kehai Chen, Min Zhang. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


