M6.6 - MoE Runtime Systems: Placement, Dispatch, Kernels, and Topology
A tensor-to-cluster study of MoE execution: logical and physical experts, variable-size dispatch, all-to-all communication, grouped and block-sparse kernels, prefill/decode modes, expert replication, topology, overlap, precision, observability, and failure recovery.