
NW
Neil Walton
· 1 min read
ResearcharXiv cs.AI
A Rate Transfer Method: Convergence Rates in Stochastic Gradient Descent via Stochastic Calculus
arXiv:2610.18739v1 Announce Type: cross
Abstract: We develop a rate-transfer method that converts finite-time Lyapunov estimates for an associated stochastic differential equation (SDE) into finite-time convergence bounds for stochastic gradient algorithms. Under generic moment and smoothness conditions, the convergence analysis of the stochastic gradient method reduces to a calculus argument verifying a Lyapunov generator inequality for the SDE. The method recovers established rates for classical stochastic gradient methods and provides a way to establish convergence rates for new optimization algorithms through calculus arguments applied to their associated SDEs.
Original source
This story was published by arXiv cs.AI and written by Neil Walton. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


