|

M5.8 - Multi-Head Latent Attention: Latent KV State, Weight Absorption, and FlashMLA

A tensor-, algebra-, and kernel-level reconstruction of Multi-Head Latent Attention: latent KV cache state, decoupled RoPE, weight absorption, DeepSeek reference paths, FlashMLA scheduling, FP8 cache layout, sparse variants, and parity diagnosis.