Skip to content
Sagan

Paper

Mixed-Precision Communication-Avoiding SGD for Generalized Linear Models on GPUs

Unreadunread

AI summary

arXiv:2606. 18463v1 Announce Type: cross Abstract: Distributed stochastic gradient descent (SGD) is limited by communication rather than computation, since each iteration requires an AllReduce across processes.