SyncAI.news, a Varaisys broadcasting
Does LinUCB Need Valid Confidence Sets?
AB

Ahmed Ben Yahmed, Marc Abeille, David Janz, Cl\'ement Calauz\`enes

· 1 min read

ResearcharXiv cs.LG

Does LinUCB Need Valid Confidence Sets?

arXiv:2611.04641v1 Announce Type: new Abstract: We show that replacing LinUCB's usual confidence width $\beta$ by any fixed $\alpha>0$ preserves sublinear regret when the action set is $M$-smooth and $m$-strongly convex. Our high-probability regret bound for this generalisation, $\alpha$-LinUCB, establishes that valid confidence sets are not necessary for the success of LinUCB. We identify the mechanism behind this result: action-set curvature drives $\alpha$-LinUCB to explore every direction, even when optimism is not guaranteed. To analyse this mechanism, we introduce a logarithmically capped spectral potential that, unlike the standard log-determinant potential, caps contributions from well-explored directions. This yields lower bounds on the smallest eigenvalue of the design matrix. At the standard confidence width $\alpha=\beta\asymp\sqrt{d\log T}$, our $T$-round regret bound in $d$ dimensions is $O\bigl(\frac{M}{m}d\sqrt{T\log T}\bigr)$, up to iterated-logarithmic factors, improving the horizon dependence of the classical LinUCB guarantee by a factor of $\sqrt{\log T}$.

Original source

This story was published by arXiv cs.LG and written by Ahmed Ben Yahmed, Marc Abeille, David Janz, Cl\'ement Calauz\`enes. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News