A derivation- and implementation-oriented study of exact KV offload, compute-near-data attention, hierarchical residency, query-dependent retrieval, recallable memory, consistency, fallback, and serving evaluation.
A systems-oriented study of long-context KV pressure, sliding windows, attention sinks, H2O, SnapKV, PyramidKV, PyramidInfer, layer/head budgets, and the accuracy contracts behind lossy cache policies.
A derivation-, training-, runtime-, and evaluation-oriented reconstruction of context extension: positional extrapolation, interpolation, recurrence, learned segment summaries, frequency scaling, adaptation, and effective-context tests.