Skip to content
Sagan

Paper

Matching Rates and Optimal Allocation for Federated Probe-Logit Distillation under Heterogeneous Bandwidth Budgets

Unreadunread

AI summary

arXiv:2605. 29642v1 Announce Type: new Abstract: In federated language modeling, $K$ nodes each hold $n$ samples but cannot pool data or exchange full-precision gradients or weights.