M6.9 - Routed, Shared, and Continual Adapters
A mechanism-level study of mixtures of LoRA adapters: routing granularity, joint versus post-hoc training, HydraLoRA factor sharing, router collapse, static and dynamic composition, continual low-rank state, and multi-adapter runtime integration.