More keys, flatter softmax
play
reset
context n
4K
plain softmax
length-aware temperature
needle logit z*
9.0
one query, n keys: the needle (teal) vs n−1 distractors with logits ~ N(0,1)
weight on the needle vs context length