Same answer, no L×L matrix
Standard attention
FlashAttention
play
step
reset
score matrix S = QKᵀ · 8 query blocks × 8 key blocks
sequence length L
128K