
CL
Chunggi Lee, Hanspeter Pfister
· 1 min read
ResearcharXiv cs.CV
EgoJev: Finding Evidence in Egocentric Video by Reading VLM Decisions
arXiv:2611.24616v1 Announce Type: new
Abstract: Questions about long egocentric video often depend on one brief moment, such as the second a hand puts an object down. A vision-language model (VLM) that sees a few evenly spaced frames usually misses it. Training-free methods rank frames with a separate image-text model or ask the VLM to write a time. In a controlled test, the VLM itself locates the moment better when it chooses among labeled frames, and we read this choice from its output distribution. With the same candidates, this choice lands on the evidence more often than image-text scores or a written time span, and it compares all candidates in one decision. Based on this finding, we propose EgoJev, a training-free frame selector for wearable assistants. EgoJev reads where the evidence is from labeled thumbnails and looks again at the windows it points to. It places its few answer frames at the quantiles of the resulting distribution. One frozen VLM selects, answers and returns the evidence time, with no second model. A wearable device can encode its coarse thumbnails while it records. With Qwen3.5-4B and 8 answer frames, EgoJev raises QAEgo4D accuracy from 51.2% with uniform sampling to 62.0%, and it outperforms recent training-free frame selectors on QAEgo4D and MyEgo. A single-level version runs on a Mac and an iPhone.
Original source
This story was published by arXiv cs.CV and written by Chunggi Lee, Hanspeter Pfister. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


