Skip to content
Sagan

Paper

GQLA: Group-Query Latent Attention for Hardware-Adaptive Large Language Model Decoding

Unreadunread

AI summary

arXiv:2605. 15250v1 Announce Type: new Abstract: Multi-head Latent Attention (MLA), the attention used in DeepSeek-V2/V3, jointly compresses keys and values into a low-rank latent and matches the H100 roofline almost perfectly.