Where the KV cache lives