Skip to content
← Performance Debugging & Benchmarking / 28
hardNewOpenAIAnthropicxAI (SpaceXSI)

A rollout job has logged 503s for an hour and never failed. Is an engine dead, pushing back, or is the client hung?

An RL rollout driver retries every 503, so an hour of errors never stopped the job. The answer separates a dead engine, admission back-pressure and a hung client by which component wrote the 503 and whether tokens kept flowing, and finds the circuit breaker that turns a busy fleet into an outage.

Updated Nov 2026 · Worked answers on inference mechanisms, with calculations, implementation details, and follow-up questions.

An RL rollout driver retries every 503, so an hour of errors never stopped the job. The answer separates a dead engine, admission back-pressure and a hung client by which component wrote the 503 and whether tokens kept flowing, and finds the circuit breaker that turns a busy fleet into an outage.

10 answers per topic instead of 5, plus saved progress and bookmarks · costs nothingor unlock all 213 remaining answers · $25

Every worked answer and derivation in all 12 topics, every concept page, the full practice-test bank, and every code drill’s edge-case tests and reference solution.

6 months · One payment · No auto-renewal

UP NEXT ON YOUR JOURNEY
DISCUSSION · 0

Nobody has commented on this answer. Add a correction or another way to work it.