
JL
Jiangtao Lin, Bangyang Wei, Yihang Ding, Siyi Liu, Yuhan Dong
· 1 min read
ResearcharXiv cs.LG
Learn Here, Move Less Elsewhere: Input-Conditioned Plasticity from Retained-Domain Activation Atlases
arXiv:2609.34478v1 Announce Type: new
Abstract: Task-specific fine-tuning can rewrite a language model's answers beyond the training task, complicating updates that must preserve existing behavior. We introduce ATLAS, which turns retained-domain representations into an input-dependent rule for task adaptation. An activation atlas supplies local reference centers and directional filters to a shared low-rank residual. Target supervision learns the residual, while retained geometry shapes its action throughout training and inference. On Qwen3-8B, ATLAS achieves lower mean retained-output Kullback-Leibler (KL) divergence than all seven published baselines at shared coding-performance requirements, with consistent advantages across multiple training seeds. Structural comparisons identify the contributions of retained reference states and directional conditioning, and answer-level analyses show fewer rewritten mathematical answers and more stable commonsense choices. Experiments spanning five backbones and two retained domains further demonstrate coding gains with reduced retained-output movement. With compact storage and modest decoding overhead, ATLAS provides a practical mechanism for acquiring specialized skills while maintaining continuity in existing responses.
Original source
This story was published by arXiv cs.LG and written by Jiangtao Lin, Bangyang Wei, Yihang Ding, Siyi Liu, Yuhan Dong. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


