SyncAI.news, a Varaisys broadcasting
Strongly Adaptive Online Learning Achieves Uniform Discounted Regret
SY

Sifan Yang, Wenhao Yang, Lijun Zhang

· 1 min read

ResearcharXiv cs.LG

Strongly Adaptive Online Learning Achieves Uniform Discounted Regret

arXiv:2610.39292v1 Announce Type: new Abstract: Discounted regret measures the performance of an online learner by assigning exponentially decaying weights to past losses, reflecting the greater importance of recent losses in non-stationary online learning. While previous work obtains uniform discounted regret bounds over a continuous range of discount factors using a specialized meta-algorithm, its results are limited to convex functions. In this paper, we demonstrate that strongly adaptive regret bounds can directly imply uniform discounted regret guarantees for convex, strongly convex, and exp-concave loss functions. Our key observation is that discounted regret against a fixed comparator admits an exact decomposition into a convex combination of interval regrets. For convex functions, this reduction yields an $O(\sqrt{\log T/(1-\lambda)})$ discounted regret bound for all discount factors $\lambda\in(0,1)$, matching the previous rate over a broader range of discount factors. For strongly convex and exp-concave functions, we provide regret bounds of $O\left(\log T\left(1+\log\frac{1}{1-\lambda}\right)\right)$.

Original source

This story was published by arXiv cs.LG and written by Sifan Yang, Wenhao Yang, Lijun Zhang. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News