M7.4 - Multi-Token Prediction Foundations: Objectives, Gradients, and Prediction Heads
A derivation- and implementation-oriented study of multi-token prediction objectives, shifted labels, shared-trunk gradients, prediction-head designs, training memory, and the boundary between denser supervision and faster inference.