Skip to content
Sagan

Paper

Communication-Efficient, 2D Parallel Stochastic Gradient Descent for Distributed-Memory Optimization

Unreadunread

AI summary

arXiv:2501. 07526v2 Announce Type: replace-cross Abstract: Distributed-memory implementations of numerical optimization algorithm, such as stochastic gradient descent (SGD), require interprocessor communication at every iteration of the algorithm.