Skip to content
Sagan

Paper

CacheProbe: Auditing Prompt Cache Isolation in Gateway APIs

Unreadunread

AI summary

arXiv:2605. 30613v1 Announce Type: new Abstract: Over the past year, prompt caching in Large Language Models (LLMs) has become increasingly more popular across inference APIs.