
NY
Natsuki Yoshino, Ren Uchida, Kazuki Matsumoto, Kohei Yatabe
· 1 min read
ResearcharXiv cs.LG
LipSSM: Structurally Lipschitz-Bounded Cascaded State-Space Model via Metric Transfer between Consecutive SSM Layers
arXiv:2609.30973v1 Announce Type: new
Abstract: Lipschitz continuity is a fundamental principle in the design of certifiably robust deep neural networks (DNNs), wherein adjusting the Lipschitz constant, which quantifies network robustness, is of central theoretical importance. A standard approach to enforcing Lipschitz continuity requires each layer of a DNN to be Lipschitz continuous, thereby guaranteeing overall Lipschitz continuity. However, this layer-wise approach typically imposes overly conservative restrictions by producing a loose estimate of the overall Lipschitz constant, which limits the expressive capacity of the DNN and degrades empirical performance at a prescribed level of robustness. To overcome this loose estimation, the recently proposed LipKernel transfers information across layers to yield a much tighter overall Lipschitz bound than conventional layer-wise construction. In this paper, we extend this concept to cascaded state-space models (SSMs) to construct Lipschitz-continuous DNNs capable of modeling longer-term dependencies. The proposed architecture, named LipSSM, is theoretically justified and empirically evaluated.
Original source
This story was published by arXiv cs.LG and written by Natsuki Yoshino, Ren Uchida, Kazuki Matsumoto, Kohei Yatabe. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


