SyncAI.news, a Varaisys broadcasting
A Rate Transfer Method: Convergence Rates in Stochastic Gradient Descent via Stochastic Calculus
NW

Neil Walton

· 1 min read

ResearcharXiv cs.AI

A Rate Transfer Method: Convergence Rates in Stochastic Gradient Descent via Stochastic Calculus

arXiv:2610.18739v1 Announce Type: cross Abstract: We develop a rate-transfer method that converts finite-time Lyapunov estimates for an associated stochastic differential equation (SDE) into finite-time convergence bounds for stochastic gradient algorithms. Under generic moment and smoothness conditions, the convergence analysis of the stochastic gradient method reduces to a calculus argument verifying a Lyapunov generator inequality for the SDE. The method recovers established rates for classical stochastic gradient methods and provides a way to establish convergence rates for new optimization algorithms through calculus arguments applied to their associated SDEs.

Original source

This story was published by arXiv cs.AI and written by Neil Walton. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News