Independently-Normalized

Independently-Normalized
Independently-Normalized SGD for Generalized-Smooth Nonconvex Optimization

arXiv:2410.14054v1 Announce Type: cross
Abstract: Recent studies have shown that many nonconvex machine learning problems meet a so-called generalized-smooth condition that extends beyond traditional smooth nonconvex optimization. However, the existing algorithms designed for generalized-smooth non…