#rollback • Tags • Transformer System

2 posts · Transformer System

Tag: #rollback

M7.8 - Speculative Serving: Scheduling, Evaluation, Release, and Rollback

🗓 2026-07-15 • Transformer System • ⏱ 40 min read

A derivation-, state-, scheduler-, and operations-level treatment of continuous-batch speculative decoding, adaptive draft budgets, goodput control, target and draft cache synchronization, evaluation, canary release, and rollback.

#numinens #transformer #speculative-decoding #llm-serving #continuous-batching #vllm

Read →

M8.10 - Deployment Evaluation, Release, and Rollback

🗓 2026-07-14 • Transformer System • ⏱ 60 min read

A statistical, systems, and release-engineering treatment of quantized deployment decisions: immutable candidate tuples, paired non-inferiority tests, workload-shaped latency and goodput curves, memory and energy ledgers, Pareto selection, shadow and canary release, production observability, and cache-safe rollback.

#numinens #transformer #quantization #deployment #evaluation #benchmarking

Read →

Su	Mo	Tu	We	Th	Fr	Sa
27	28	29	30	1	2	3
4	5	6	7	8	9	10
11	12	13	14	15	16	17
18	19	20	21	22	23	24
25	26	27	28	29	30	31

| #rollback

Tag: #rollback

M7.8 - Speculative Serving: Scheduling, Evaluation, Release, and Rollback

M8.10 - Deployment Evaluation, Release, and Rollback