M3.9 — Training Execution: Teacher Forcing, Masks, Loss, and Parallelism
A derivation- and code-path reconstruction of Transformer training: shifted supervision, causal/padding/packed/loss masks, cross-entropy and smoothing, accumulation, Adam, Noam scheduling, mixed precision, distributed parallelism, checkpoints, and reproducibility.