SyncAI.news, a Varaisys broadcasting
Beyond Alignment: Supervising the Generator for EEG-to-Image Reconstruction
SJ

Sangmin Jo, Wootaek Jeong, Heung-Il Suk

· 1 min read

ResearcharXiv cs.CV

Beyond Alignment: Supervising the Generator for EEG-to-Image Reconstruction

arXiv:2611.19232v1 Announce Type: new Abstract: Visual brain decoding translates neural activity into human-interpretable images. While recent EEG-to-image reconstruction methods rely on aligning EEG signals with pretrained visual embeddings to condition an image generator, we empirically demonstrate that stronger cross-modal alignment do not translate into comparable gains in reconstruction quality. This indicates that improving the input condition alone is insufficient; the generative process itself requires explicit supervision. Although Representation Alignment (REPA) offers a solution by guiding diffusion transformers with pretrained vision encoder features, we find that EEG-conditioned generators struggle to follow these fixed targets. To address this mismatch, we introduce generation-derived supervision (GDS): an image-conditioned teacher that translates static image-encoder features into the internal representation space of a diffusion transformer. Our EEG-conditioned student generator closely tracks these dynamic targets during denoising, discarding the teacher at inference. Evaluated on THINGS-EEG and THINGS-MEG, our approach consistently outperforms conditioning-centric baselines, achieving state-of-the-art reconstruction fidelity.

Original source

This story was published by arXiv cs.CV and written by Sangmin Jo, Wootaek Jeong, Heung-Il Suk. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News