
HS
Hyun Song, Taewan Cho, Kangmin Kim, Andrew Jaeyong Choi
· 1 min read
ResearcharXiv cs.CV
SPACE-CLIPv2: Decoding Local Geometry from Frozen CLIP for Monocular Depth Estimation
arXiv:2610.05029v1 Announce Type: new
Abstract: Vision-language foundation models such as CLIP provide strong semantic representations, but their patch tokens are not directly optimized for dense metric geometry. SPACE-CLIP showed that frozen CLIP features can support monocular depth estimation through layer-group feature fusion, yet it leaves open how neighboring CLIP tokens should be combined to recover fine local structure. We present SPACE-CLIPv2, a frozen-backbone depth decoder that aggregates fixed local neighborhoods in CLIP token space. At selected decoder stages, the model samples a fixed token stencil, predicts aggregation weights, and injects the resulting response through a gated residual update. A token-space high-pass branch further preserves shallow local contrast. On NYU Depth V2, SPACE-CLIPv2 improves over a matched SPACE-CLIP baseline, while five-seed experiments consistently favor fixed over learned-offset sampling. Zero-shot iBims-1 evaluation further improves boundary and planar-geometry measures. These results support constrained local token aggregation as a practical mechanism for decoding geometry from frozen CLIP representations.
Original source
This story was published by arXiv cs.CV and written by Hyun Song, Taewan Cho, Kangmin Kim, Andrew Jaeyong Choi. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


