Skip to content
Sagan

Paper

Operator Fusion for LLM Inference on the Tensix Architecture

Unreadunread

AI summary

arXiv:2606. 09879v1 Announce Type: new Abstract: This study addresses on-device inference bottlenecks of Transformer models on Tenstorrent's Tensix architecture and proposes an operator fusion strategy that enhances data locality.