Advertised vs effective length
run eval
pass bar
85%
Single needle (NIAH)
Multi-hop / variable tracking (RULER-style)
No literal match (NoLiMa-style)
illustrative pattern, not real benchmark scores
accuracy % · needle depth ↓ × context length →
fail
pass
lost in the middle: accuracy vs where the answer sits
4K
128K