New Architecture Routes Agent Memory Queries for Enhanced Performance

Joshua Tobkin, David Yang· July 22, 2026 View original

Summary

Supra Cognitive Modes (SCM) is a novel architecture that intelligently routes agent memory queries to specialized retrieval and synthesis payloads based on query type. This system combines various lookup methods over a shared ingest substrate, demonstrating strong performance across multiple memory benchmarks.

A new architectural design called Supra Cognitive Modes (SCM) has been proposed to optimize how AI agents manage and access their memory. Agent memory workloads are diverse, ranging from simple factual lookups to complex multi-hop reasoning and broad synthesis over extensive historical data. SCM addresses this by dynamically mapping explicit or automatically selected query modes to appropriate retrieval and synthesis mechanisms, all operating on a unified data ingest substrate. The architecture features a frozen semantic classifier and runtime gates that direct queries to fused lexical and dense lookup, graph-based or iterative multi-hop processing, or stratified long-form synthesis. The underlying substrate integrates multi-granularity embeddings, extracted triples, and fact-version metadata. Evaluated on benchmarks like Long-term Conversational Memory (LoCoMo), MemoryAgentBench (MAB), and LongMemEval, SCM achieved strong results, indicating its effectiveness in handling diverse memory tasks and improving agent performance.

Why it matters

Professionals developing advanced AI agents, virtual assistants, or knowledge management systems can leverage this routed memory architecture to improve the efficiency, accuracy, and scalability of their agents' long-term memory capabilities.

How to implement this in your domain

  1. 1Design agent memory systems with a modular, routed architecture that dispatches queries based on their cognitive mode.
  2. 2Implement a shared ingest substrate that supports various data representations, including embeddings, triples, and metadata.
  3. 3Develop semantic classifiers to automatically identify the appropriate retrieval and synthesis strategies for incoming queries.
  4. 4Benchmark different memory routing configurations to optimize performance for specific agent workloads.

Who benefits

Software DevelopmentAI/MLCustomer ServiceKnowledge ManagementRobotics

Key takeaways

  • Agent memory workloads are diverse, requiring different retrieval and synthesis strategies.
  • Supra Cognitive Modes (SCM) is an architecture that intelligently routes queries to specialized memory components.
  • It uses a shared ingest substrate and combines various lookup methods for efficiency.
  • SCM demonstrated strong performance on multiple agent memory benchmarks.

Original post by Joshua Tobkin, David Yang

"arXiv:2607.19096v1 Announce Type: new Abstract: Agent-memory workloads mix direct factual lookup, relation-chain and current-state reasoning, and broad synthesis over long histories. We describe Supra Cognitive Modes (SCM), an architecture that maps explicit or automatically sele…"

View on X

Originally posted by Joshua Tobkin, David Yang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses