Unused logical KV pages can coexist with exhausted device memory. Reconcile expanded image tokens, retained embeddings and phase-specific peaks before changing a decoder token limit.
Updated Oct 2026 · Worked answers on inference mechanisms, with calculations, implementation details, and follow-up questions.
Unused logical KV pages can coexist with exhausted device memory. Reconcile expanded image tokens, retained embeddings and phase-specific peaks before changing a decoder token limit.
Every worked answer and derivation in all 12 topics, every concept page, and the full practice-test bank.
6 months · One payment · No auto-renewal
Collect tensor lifetimes with the allocation ledger. An encoder activation and a decoder activation should be added only when they coexist; a preallocated KV tensor remains physically resident even when most of its pages are available.
Nobody has commented on this answer. Add a correction or another way to work it.