INFORM: Disentangling Intrinsic Importance from Emergent Structure in Multi-Expert Orchestration

Jul 14, 2026

A new interpretability method called INFORM decouples expert interaction structure from functional importance in multi-expert LLM systems. The method demonstrates that experts frequently selected by routing policies may have limited actual influence, while less frequently used experts can be structurally critical. INFORM uses gradient sensitivity to identify intrinsically important experts, whose removal leads to a disproportionate collapse in the system's interaction structure. This approach reveals functional and structural dependencies that are not captured by standard routing or accuracy metrics.

Why it matters: This work offers a principled framework for understanding and optimizing multi-expert LLM systems, uncovering hidden dependencies that can inform more robust orchestration strategies.

Full story at: arXiv Multiagent Systems ↗