RoPE spectrum · who gets stretched
target L′
32K
128K
tour
PI
NTK-aware
YaRN
LongRoPE
Bigger base
wavelength λ of each of the 64 RoPE pairs (tokens, log) — tick = original
stretch factor sᵢ = θᵢ / θ′ᵢ per pair (log)