Skip to content
Sagan

Paper

Size Doesn't Matter: Cosine-Scored Sparse Autoencoders

Unreadunread

AI summary

arXiv:2606. 15054v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) detect features via inner product, so a feature's activation scales with both its directional alignment and the input's norm.