AI Capability Driven by Access Structure, Not Just Scale.

Wenhui Chen, Jianlin Chen, Ziyao Lin, Chi Man Vong· July 17, 2026 View original

Summary

This research proposes the Capability Convergence Hypothesis, arguing that AI model capability, under fixed inference budgets, converges based on access structure (hybrid architectures) rather than just scale. It introduces information-theoretic lower bounds and pre-registered experiments to support that hybrid models outperform purely scaled ones for certain tasks.

The prevailing belief, the Platonic Representation Hypothesis, suggests that as AI models scale, their internal representations converge towards a shared understanding of reality. This paper introduces a new perspective, the Capability Convergence Hypothesis, which posits that under a fixed per-token inference budget, representational convergence does not automatically lead to capability convergence. Instead, capability converges towards a specific class of "access-complete hybrid" architectures. These hybrid architectures combine a compressive O(1)-state channel with a scalable verbatim-index channel, allowing them to overcome fundamental resource limitations (Shannon, horizon, and circuit walls) that hinder purely scaled models. The research anchors this principle on a "Newton's-apple problem" witness task and provides information-theoretic lower bounds and pre-registered experimental results. These tests demonstrate a significant "scissors gap" where hybrid models dramatically outperform attention-only models for exact retrieval, confirming that access structure is a critical determinant of capability.

Why it matters

This challenges the "bigger is always better" paradigm in AI, guiding engineers and researchers to focus on architectural innovation (hybrid designs) for achieving advanced capabilities more efficiently, rather than solely relying on scaling up model size.

How to implement this in your domain

  1. 1Re-evaluate current AI model architecture strategies, considering hybrid designs over purely scaling up existing models.
  2. 2Investigate integrating both compressive state channels and scalable verbatim-index channels into your model designs.
  3. 3Benchmark hybrid architectures against traditional large models on tasks requiring long-term memory or precise retrieval.
  4. 4Prioritize architectural innovation and efficient resource utilization in AI development to achieve specific capabilities.

Who benefits

AI DevelopmentCloud ComputingRoboticsAutonomous SystemsData Science

Key takeaways

  • AI capability is not solely determined by model scale.
  • Access-complete hybrid architectures are crucial for capability convergence.
  • Hybrid models combine compressive state and verbatim-index channels.
  • Architectural innovation can overcome resource limitations more efficiently.

Original post by Wenhui Chen, Jianlin Chen, Ziyao Lin, Chi Man Vong

"arXiv:2607.14144v1 Announce Type: new Abstract: The Platonic Representation Hypothesis (PRH) holds that as models scale, representations of heterogeneous networks converge toward a shared model of reality. We propose its sequel and boundary, the Capability Convergence Hypothesis…"

View on X

Originally posted by Wenhui Chen, Jianlin Chen, Ziyao Lin, Chi Man Vong on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses