SyncAI.news, a Varaisys broadcasting
Small Data in Long-Term Environmental Vision: Annotation Noise, Gamification, and Label-Budget Scaling
BB

Bryceton Bible, Hairong Qi, Masahiro Toyoura

· 1 min read

ResearcharXiv cs.CV

Small Data in Long-Term Environmental Vision: Annotation Noise, Gamification, and Label-Budget Scaling

arXiv:2611.18706v1 Announce Type: new Abstract: Long-running environmental camera networks produce abundant images but few reliable annotations. Using FujiView, a network of webcams around Mount Fuji, we study three linked questions: whether gamification affects annotation participation and agreement, how annotators disagree on ordinal visibility labels, and how label budget affects downstream classification. Across seven nonrandomized sessions with 22 labelers, gamification showed a more promising pattern for sustained participation than for labeling speed or agreement. In the closest remote-session comparison, the session recorded as gamified had longer active labeling time, while throughput and reference agreement remained similar. Annotation disagreement was substantial at fine granularity: crowd votes matched the single-annotator reference on 49.1% of exact visibility classes, versus 90.2% after grouping them into Good/Poor. In five-replicate label-budget experiments, models using 25% of the available label pool achieved held-out exact accuracy only 2.8 percentage points below the full-pool model on average. Together, these findings highlight the importance of designing reliable annotation targets, evaluating engagement mechanisms without assuming causal benefits, and using empirical scaling curves to plan labeling effort.

Original source

This story was published by arXiv cs.CV and written by Bryceton Bible, Hairong Qi, Masahiro Toyoura. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News