Cache bytes vs state bytes
pause
context
head dim d
64
128
256
layers × heads
32 × 8
32 × 32
80 × 64