Multi-Agent Framework Reduces LLM Hallucinations in Science

Runzhe Liu, Biquan Bie, Zihao Wang, Yuchao Ma, Yexin Liu, Xinghai Li, Harry Yang, Wenbo Yang, Jinzhe Cao, Shengyang Tao· July 10, 2026 View original

Summary

G-Frame, an adaptive multi-agent framework integrating Bayesian and team game principles, significantly reduces hallucinations in lightweight Large Language Models (LLMs) for rule-based scientific domains. It achieves this by synthesizing high-quality, domain-constrained data and training specialized models like OmniChem, which performs comparably to GPT-4o mini with 79% fewer hallucinations.

Lightweight Large Language Models (LLMs) often struggle in scientific domains governed by strict rules, frequently generating "hallucinations" by mimicking linguistic patterns instead of applying axiomatic reasoning. This limitation severely restricts their practical application in fields requiring high accuracy. Researchers have introduced G-Frame, an adaptive multi-agent framework designed to mitigate these hallucinations. G-Frame uses Bayesian and team game principles to create an automated, closed-loop system for synthesizing high-quality data and training models. By forcing LLMs to internalize domain constraints through structured reasoning, the framework generated a specialized corpus of chains-of-thought and question-answer pairs. This process led to the development of OmniChem, a 7B parameter model that achieves performance parity with GPT-4o mini on specific benchmarks while demonstrating a 79.46% reduction in hallucinations compared to its base architecture. OmniChem also shows advanced capabilities in molecular design and synthesis planning, establishing a scalable paradigm for accelerating knowledge discovery in specialized scientific fields.

Why it matters

Professionals in scientific research, drug discovery, and materials science can leverage this framework to develop more reliable and accurate AI tools, accelerating innovation by overcoming a major limitation of current LLMs in rule-based domains.

How to implement this in your domain

  1. 1Explore integrating multi-agent frameworks like G-Frame into LLM development for specialized scientific or technical domains.
  2. 2Develop domain-specific data synthesis pipelines that enforce axiomatic reasoning and reduce hallucination.
  3. 3Benchmark lightweight LLMs against larger models using custom, rule-based datasets to assess hallucination rates.
  4. 4Apply this approach to enhance AI assistants or knowledge discovery tools in fields like chemistry, biology, or engineering.

Who benefits

PharmaceuticalsBiotechnologyChemicalsResearch & DevelopmentMaterials Science

Key takeaways

  • Lightweight LLMs often hallucinate in rule-based scientific domains due to mimicking linguistic patterns.
  • G-Frame, a multi-agent framework, significantly reduces hallucinations by enforcing domain constraints.
  • The framework synthesizes high-quality, structured data for specialized model training.
  • OmniChem, a 7B model, achieved GPT-4o mini parity with 79% fewer hallucinations in chemistry tasks.

Original post by Runzhe Liu, Biquan Bie, Zihao Wang, Yuchao Ma, Yexin Liu, Xinghai Li, Harry Yang, Wenbo Yang, Jinzhe Cao, Shengyang Tao

"arXiv:2607.08403v1 Announce Type: new Abstract: The application of lightweight Large Language Models in rule-based scientific domains remains severely limited by their tendency to mimic linguistic patterns rather than reproduce axiomatic reasoning, causing frequent hallucinations…"

View on X

Originally posted by Runzhe Liu, Biquan Bie, Zihao Wang, Yuchao Ma, Yexin Liu, Xinghai Li, Harry Yang, Wenbo Yang, Jinzhe Cao, Shengyang Tao on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses