arXiv:2605. 23147v1 Announce Type: new Abstract: Role prompts of the form As X, do Y admit a clean linear decomposition at one specific site in the residual stream: the prompt-to-answer transition -- the last prompt token together with the first two generated tokens -- in an early/mid layer band.
Paper
As X, Do Y: How Persona and Task Combine in Instruction-Tuned LLMs
Unreadunread