New Framework Analyzes Trust Subversion in AI-Human Communication

Mihnea C. Moldoveanu, Joel A. C. Baum· July 10, 2026 View original

Key takeaways

  • Adversarial Social Epistemology (ASE) offers a new lens for analyzing trust in AI-human communication.
  • Trust can be subverted by exploiting normal communicative commitments and entitlements.
  • The framework proposes mechanisms to audit and redress trust breaches.
  • Understanding ASE is crucial for building resilient information systems.

Who benefits

Social MediaCybersecurityGovernmentJournalismAI Development

Summary

This paper introduces Adversarial Social Epistemology (ASE) to analyze how trust is exploited in complex communicative environments involving humans and large language models. It outlines mechanisms that subvert trust in scaffolded public communications and proposes machinery for auditing and redressing such breaches.

Researchers have proposed a new framework called Adversarial Social Epistemology (ASE) to understand how trust can be undermined in communication landscapes where humans and large language models (LLMs) interact extensively. This framework goes beyond traditional concepts like echo chambers or misinformation, focusing instead on how agents strategically manipulate the commitments and entitlements that typically make shared assertions reliable. The paper details specific mechanisms through which trust in public communications, built on chains of testimony, inference, and institutional certification, can be subverted. It provides a specialized language for this analysis and outlines methods for auditing and rectifying trust breaches. The proposed machinery draws on epistemic networks and an inferentialist semantics to interpret assertions, aiming to restore accountability in inferential chains.

Why it matters

Professionals need to understand the sophisticated ways trust can be eroded in AI-augmented communication to build more resilient systems and strategies for information verification.

How to implement this in your domain

  1. 1Integrate principles of adversarial social epistemology into content moderation and platform design.
  2. 2Develop auditing tools to track the provenance and inferential chains of information generated by LLMs.
  3. 3Educate teams on the subtle ways AI can be used to distort or fabricate information.
  4. 4Implement robust verification protocols for critical information derived from AI-human interactions.

Original post by Mihnea C. Moldoveanu, Joel A. C. Baum

"arXiv:2607.07760v1 Announce Type: new Abstract: We outline an adversarial social epistemology (ASE) for densely interactive communicative landscapes in which public assertions are scaffolded by chains of testimony, inference, institutional certification, and tacit trust. In such…"

View on X

Originally posted by Mihnea C. Moldoveanu, Joel A. C. Baum on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research