ProofCouncil LLM Agent Excels at Open Math Problems.

Johannes Schmitt, Tim Gehrunger, Jasper Dekoninck, Gergely B\'erczi, Uri Kreitner, Liam Price, David Holmes· July 13, 2026 View original

Summary

ProofCouncil is an LLM agent designed with an author-critic architecture to solve open mathematical problems, achieving top performance in the FirstProof challenge and demonstrating significant progress on other research-level problems. The agent-building library used to create it is now open source.

Large language models (LLMs) are showing increasing capability in tackling complex mathematical problems, but their performance can be further enhanced through specialized agentic workflows. Researchers have introduced ProofCouncil, an LLM agent specifically engineered to solve open mathematical problems using an author-critic architecture, mimicking human problem-solving processes. ProofCouncil participated in the FirstProof challenge, which involved 10 real-world mathematical problems requiring autonomous agent solutions. The agent's submissions for six of these problems were judged as correct, requiring at most minor revisions, positioning it as the top performer among participating teams. Beyond the challenge, ProofCouncil was evaluated on 30 additional open problems sourced from mathematical researchers. Out of 21 solutions that received human feedback, five were deemed completely correct, two were promising pending final verification, and eight provided useful partial progress. The underlying agent-building library used to develop ProofCouncil has been released as open source, enabling broader community use and development.

Why it matters

This demonstrates a significant leap in AI's ability to autonomously tackle complex, unsolved mathematical problems, potentially accelerating research and discovery in various scientific and engineering fields.

How to implement this in your domain

  1. 1Explore the open-source ProofCouncil agent-building library for developing specialized problem-solving AI.
  2. 2Investigate author-critic architectures for improving the reliability and accuracy of LLM outputs in complex domains.
  3. 3Consider integrating LLM agents into research workflows for hypothesis generation or proof verification.
  4. 4Apply similar agentic design principles to other domains requiring rigorous, multi-step reasoning.
  5. 5Collaborate with mathematical experts to refine and validate AI-generated solutions.

Who benefits

AcademiaResearch & DevelopmentSoftware EngineeringFinanceCryptography

Key takeaways

  • LLM agents can achieve high performance in solving open mathematical problems.
  • An author-critic architecture is effective for rigorous, multi-step reasoning tasks.
  • ProofCouncil demonstrated leading performance in a competitive mathematical challenge.
  • The underlying agent-building library is open-source, fostering further development.

Original post by Johannes Schmitt, Tim Gehrunger, Jasper Dekoninck, Gergely B\'erczi, Uri Kreitner, Liam Price, David Holmes

"arXiv:2607.09474v1 Announce Type: new Abstract: Large language models (LLMs) have shown increasing promise in solving open problems in mathematics. However, their performance can be further improved through agentic workflows tailored to real-world mathematical practice. To this e…"

View on X

Originally posted by Johannes Schmitt, Tim Gehrunger, Jasper Dekoninck, Gergely B\'erczi, Uri Kreitner, Liam Price, David Holmes on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses