Prefill once, then decode one token at a time