Review a rollout worker before accepting its samples

Start from the bytes: what has to move from HBM per token, how many FLOPs ride on each byte, and which side of the ridge point that puts the step at batch 1 and at batch 64.

Then redo the chain with a different model shape and a different GPU, and say what breaks first when the context grows from 4K to 128K tokens.