SyncAI.news, a Varaisys broadcasting
LLN: Learnable Lens Networks for Parameter-Efficient Long-Horizon Dynamical Prediction
BY

Binbin Yong, Zhao Su, Lan Guo, Haoran Li, Jun Shen, Qingguo Zhou

· 1 min read

ResearcharXiv cs.LG

LLN: Learnable Lens Networks for Parameter-Efficient Long-Horizon Dynamical Prediction

arXiv:2609.34493v1 Announce Type: new Abstract: Explicit residual connections of the form (x+f(x)), often combined with normalization layers, have become a standard strategy for training very deep neural networks. However, residual addition primarily provides an algebraic shortcut for gradient propagation, while leaving the evolution of feature geometry across layers largely unconstrained. We introduce Learnable Lens Networks (LLN), a physics-inspired architecture that replaces direct feature-space residual accumulation with learnable optical transport in an augmented position-angle phase space. Each layer alternates between free propagation, which provides an implicit transport path, and a learnable lens field that performs nonlinear trajectory transformation and focusing. Theoretically, we establish that LLN transport is globally invertible and volume-preserving for any differentiable lens field, with the implemented coordinate-wise Gaussian transport further satisfying symplecticity. Importantly, these structural constraints do not limit expressivity: with unrestricted embeddings and readouts, LLN retain universal approximation of continuous end-to-end maps. Experiments across diverse dynamical systems demonstrate that LLN improves long-horizon prediction while using substantially fewer parameters than same-depth comparators. Further analysis reveals stable depth-wise gradient transport and interpretable learned dynamics under the coupled propagation and refraction design.

Original source

This story was published by arXiv cs.LG and written by Binbin Yong, Zhao Su, Lan Guo, Haoran Li, Jun Shen, Qingguo Zhou. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News