19A speculative verifier returns correct tokens, but the next step diverges. Debug its cache commit boundary.▼hardNewOpenAIAnthropicNVIDIA◆ premiumAccepted, emitted and computed tokens are different counts. Trace rejection, full acceptance, EOS and an output cap to find the state that the next forward pass is allowed to read.Open full answer →
20Logits are identical, but a seeded request changes output after batch reordering. Repair the sampler's RNG contract.▼hardNewOpenAINVIDIATogether AI◆ premiumA fixed global seed reproduces a launch order, not a request. Build a random-draw address that survives compaction, extra draft work and continuation, then state what it cannot guarantee.Open full answer →