SyncAI.news, a Varaisys broadcasting
Attributing Preprocessing Invariance in Spectral Foundation Models
DW

Dongjun Wei, Hongyi Wu

· 1 min read

ResearcharXiv cs.AI

Attributing Preprocessing Invariance in Spectral Foundation Models

arXiv:2608.14227v3 Announce Type: replace Abstract: A spectral foundation model should remain useful when laboratories preprocess spectra differently. The standard test trains a classifier under one pipeline and evaluates under another, taking preserved accuracy as evidence of learned invariance. However, these models normalize each input before any learned parameter is applied. When normalization maps differently preprocessed spectra to the same vector, the encoder receives identical inputs and the measured invariance cannot be attributed to learning. We propose a normalization-only attribution control: compare the encoder against its normalization before interpreting transfer as learned invariance. On six Raman datasets the encoder does not measurably improve transfer over its normalization. A controlled experiment confirms invariance develops only when variation reaches the encoder past normalization. Across three systems, no encoder improves relative retention over its normalization. An audit of eighteen configurations across five modalities confirms the issue is widespread: the normalization-only control should be reported before crediting transfer to the encoder.

Original source

This story was published by arXiv cs.AI and written by Dongjun Wei, Hongyi Wu. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News