SyncAI.news, a Varaisys broadcasting
Let the Target Select for Itself: Data Selection via Target-Aligned Paths
HY

Huitao Yang, Hengzhi He, Tung Sum Thomas Kwok, Guang Cheng

· 1 min read

ResearcharXiv cs.CL

Let the Target Select for Itself: Data Selection via Target-Aligned Paths

arXiv:2605.09404v2 Announce Type: replace-cross Abstract: Targeted data selection seeks training examples from a candidate pool that improve downstream task performance. While trajectory-based selectors effectively guide this process, existing approaches typically construct reference states by warming up on the candidate pool itself, thereby inheriting pool-dependent distributional biases. To address this coupling, we introduce Target-Aligned Candidate Selection (TACS), which constructs a short, capacity-constrained reference path using a compact target-validation proxy. Candidates are ranked by their normalized loss reduction along this trajectory, requiring only forward passes and allowing the path to be reused across distinct pools for a fixed model-target pair. Empirically, TACS achieves competitive downstream performance across controlled logistic, vision, and NLP benchmarks, while slashing selection compute by up to 69% and candidate storage to less than 10 MB in large-scale instruction tuning.

Original source

This story was published by arXiv cs.CL and written by Huitao Yang, Hengzhi He, Tung Sum Thomas Kwok, Guang Cheng. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News