Agentic Data Cleaning Explored Without Clean Reference Data

Hadi Fadlallah· August 18, 2026 View original

Key takeaways

  • Reference-free agentic data cleaning presents significant challenges and trade-offs.
  • Combining LLM reasoning with structured context and executable checks is promising.
  • No single agent configuration excels across all data cleaning criteria.
  • Conservative repair and evidence grounding are crucial for trustworthy automated cleaning.

Who benefits

Data ScienceHealthcareFinancial ServicesEnvironmental MonitoringAI/ML Engineering

Summary

This paper experimentally studies how different agent capabilities affect reference-free data cleaning, proposing an evidence-grounded framework combining structured context, LLM reasoning, and executable checks. It evaluates seven configurations across various datasets, revealing trade-offs between detection, repair, evidence grounding, and operational cost.

This research investigates the complexities of data cleaning when a trusted "clean" reference dataset is unavailable, a common challenge where unusual values could be either errors or valid observations. The study proposes an evidence-grounded framework for agentic data cleaning that integrates various capabilities, including structured context, LLM reasoning, executable checks, controlled evidence retrieval, and conservative repair strategies. Seven distinct configurations of this framework were experimentally evaluated across financial, clinical, and environmental datasets, using both synthetic corruption and descriptive analysis of original data. The findings indicate that while a deterministic profiling baseline achieved the highest detection F1-score, no single LLM-based configuration consistently outperformed others across all criteria. The research highlights that adding more capabilities often introduces trade-offs among detection accuracy, repair effectiveness, evidence grounding, conservative behavior, reproducibility, and operational costs, rather than providing universal improvements.

Why it matters

Data quality is fundamental for reliable AI models and business intelligence. This research provides crucial insights into the challenges and trade-offs of automated data cleaning, especially in scenarios lacking a perfect reference, which is common in real-world data environments.

How to implement this in your domain

  1. 1Assess current data cleaning workflows for reliance on clean reference data and identify gaps.
  2. 2Experiment with LLM-based agents for initial data profiling and anomaly detection.
  3. 3Implement executable checks and controlled evidence retrieval to ground agentic cleaning decisions.
  4. 4Adopt conservative repair strategies and provenance logging for transparency and reversibility in data cleaning.

Original post by Hadi Fadlallah

"arXiv:2608.14765v1 Announce Type: new Abstract: Data cleaning without a trusted clean reference is challenging because unusual values may represent either genuine errors or valid observations. This paper studies how different agent capabilities affect reference-free data cleaning…"

View on X

Originally posted by Hadi Fadlallah on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses