
WW
Wenlong Wang, Fergal Reid
· 1 min read
ResearcharXiv cs.AI
Residual Streams Read, Recurrent States Remember: The Global Workspace in Mamba Models
arXiv:2609.32102v1 Announce Type: new
Abstract: Can the global-workspace account of transformer representations extend to state-space language models? We fit Jacobian lenses to the residual streams and recurrent states of Mamba-1, Mamba-2 and Mamba-3, using the original 1000-prompt recipe. Joint residual--state readouts improve recovery of known intermediate concepts over the residual lens on at least five of six task families in every tested Mamba checkpoint. On Mamba-2, state alone exceeds residual and logit lenses on all six families; a normalised joint readout improves on both components on five. Temporal maps and word-list experiments show earlier content remaining state-readable as residual visibility changes. We also propose sign-guarded steering, which improves target top-five success over coordinate exchange on matched verbal-report trials in five models. Recurrent state alone supports this verbal access. These gains do not extend consistently to relational answers: guarded edits often output the edited concept itself, and Mamba-3's joint edits can disrupt successful state-only redirection. Recurrent state thus provides a complementary carrier of workspace content, whose recovery, persistence and causal uses require separate measurements.
Original source
This story was published by arXiv cs.AI and written by Wenlong Wang, Fergal Reid. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


