Memory update rule · d = 6
2020 linear attn
2021 DeltaNet
2024 gated
2024 Gated DeltaNet
2025 KDA
erase (Delta)
per-channel α (KDA)
α
0.90
β
0.90
the board Sₜ
per-channel keep rate α — drag the bars
read every fact right now — how much survives?
—