M6.1 - Routed Capacity: MoE Experts, Routers, and Token Dispatch
A cost- and shape-oriented study note on Mixture-of-Experts layers, dense FFN baselines, top-k routing, token dispatch, expert capacity, overflow, and total-vs-active parameter ledgers.