Skip to content
Sagan

Paper

PADD: Path-Aligned Decompression Distillation for Non-Router Teacher to Guide MoE Student Learning

Unreadunread

AI summary

arXiv:2606. 10369v1 Announce Type: new Abstract: As large language models (LLMs) continue to scale, it becomes increasingly challenging to grow model capacity under fixed computation budgets.