M5.4 - Long-Context KV Policies: Retention, Compression, and Budget Allocation
A systems-oriented study of long-context KV pressure, sliding windows, attention sinks, H2O, SnapKV, PyramidKV, PyramidInfer, layer/head budgets, and the accuracy contracts behind lossy cache policies.