Packing · where the window comes from
play
reset
row length L
16
the corpus · documents of all lengths
packed into training rows of L tokens
how many times each position index got trained
no mask
doc mask