Skip to content
Sagan

Paper

PALS: Power-Aware LLM Serving for Mixture-of-Experts Models

Unreadunread

AI summary

arXiv:2605. 21427v1 Announce Type: new Abstract: Large language model (LLM) inference has become a dominant workload in modern data centers, driving significant GPU utilization and energy consumption.