Skip to content
Sagan

Paper

GQA-{\mu}P: The maximal parameterization update for grouped query attention

Unreadunread

AI summary

arXiv:2605. 15290v1 Announce Type: new Abstract: Hyperparameter transfer across model architectures dramatically reduces the amount of compute necessary for tuning large language models (LLMs).