Verifiable Knowledge Expansion with Retrieval-Grounded FCA

Yujin Yang, Heejung Lee· July 3, 2026 View original

▶ The 2-minute explainer

Key takeaways

  • The framework combines retrieval-augmented SLMs with FCA for verifiable knowledge expansion.
  • FCA acts as a symbolic verification loop, validating proposed knowledge structures.
  • The system provides inspectable judgments, counterexamples, and corrections.
  • Identifying positive object-attribute pairs remains a key challenge in knowledge expansion.

Who benefits

HealthcareLife SciencesKnowledge ManagementSemantic WebAI Development

Summary

This paper proposes a retrieval-augmented small language model (SLM) framework that uses Formal Concept Analysis (FCA) as a symbolic verification loop for verifiable knowledge expansion. It validates proposed knowledge structures from text, addresses inconsistencies, and supports inspectable judgments, demonstrating its utility in a rare ataxia setting.

Constructing ontologies and expanding knowledge bases requires careful validation of objects, attributes, and their structural relationships. While language models can propose such structures from text, their outputs often lack verifiable support or consistency. To address this, researchers introduce a novel framework that combines a retrieval-augmented small language model (SLM) with Formal Concept Analysis (FCA) as a symbolic verification loop for knowledge expansion. The framework begins with seed attributes, from which FCA proposes logical implications over a growing formal context. A retrieval-grounded SLM oracle then validates each proposed implication, providing either confirmation or a counterexample. This oracle also handles incidence judgments, consistency checks, and attribute proposals, ensuring that all accepted implications, counterexamples, contradictions, and corrections are inspectable and traceable. In a case study focused on rare ataxia, using resources from Orphadata, the system achieved relation F1 scores of 0.29-0.52 and closure-based implication F1 scores of 0.22-0.30. Larger seed sets generally improved implication F1, though lower scores for implications reflect a stricter evaluation. Ablation studies confirmed that incidence judgments can improve scores in fixed object-attribute settings, but identifying positive object-attribute pairs remains challenging.

Why it matters

For professionals building knowledge graphs, ontologies, or expert systems, this framework offers a verifiable and transparent method for expanding knowledge from text, mitigating the risks of unsupported or inconsistent information generated by language models.

How to implement this in your domain

  1. 1Explore integrating Formal Concept Analysis (FCA) with retrieval-augmented SLMs for verifiable knowledge expansion.
  2. 2Develop symbolic verification loops to ensure consistency and support for knowledge extracted by language models.
  3. 3Implement mechanisms for inspectable judgments, counterexamples, and corrections in knowledge base construction.
  4. 4Utilize retrieval-augmented generation (RAG) to ground SLM outputs in factual evidence for ontology building.
  5. 5Apply this framework to specialized domains requiring high accuracy and verifiability, such as medical or legal knowledge bases.

Original post by Yujin Yang, Heejung Lee

"arXiv:2607.01773v1 Announce Type: new Abstract: Ontology construction requires deciding which objects, attributes, and structural relations should be accepted as valid knowledge. Language models can propose such structures from text, but their outputs can still be unsupported or…"

View on X

Originally posted by Yujin Yang, Heejung Lee on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses