Skip to content
Sagan

Paper

Inference Cost Attacks for Retrieval-Augmented Large Language Models

Unreadunread

AI summary

arXiv:2606. 02643v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG)-enhanced LLM systems, while powerful, introduce substantial inference costs due to the inclusion of an extra multi-stage pipeline that dynamically retrieves and synthesizes information from external knowledge sources.