Mixture of Debaters Improves Multi-Agent AI Reasoning

A new AI framework, "Mixture of Debaters" (MoD), has been developed to overcome the limitations of traditional multi-agent debate systems. These older systems often suffer from fixed architectures and high computational costs due to needing multiple model instances. MoD innovates by allowing a single model to engage in dynamic self-debate, leveraging the Mixture-of-Experts (MoE) approach. The framework tackles key challenges by implementing dual-routing for flexible role allocation and process flow, momentum switching to smooth expert transitions, and unified self-debate that integrates diverse debating personas into lightweight expert modules. This design eliminates the need for inter-agent communication while preserving behavioral diversity. Extensive testing on multimodal benchmarks shows that MoD surpasses both single-model baselines and conventional multi-agent systems. It delivers higher accuracy with a 3.7x reduction in latency and an 87% decrease in token consumption, making it a more efficient and powerful approach to dialectical reasoning.