One sequence, many GPUs
Naive split
Zigzag split
All-to-all (Ulysses)
play
step
reset
GPUs
4