Skip to content
Sagan

Paper

Cost-Optimal LLM Routing with Limited User Feedback under User Satisfaction Guarantees

Unreadunread

AI summary

arXiv:2606. 19376v1 Announce Type: new Abstract: Inference costs for large language model (LLM) applications are rapidly growing, driven by surging demand and rising infrastructure cost.