LLM Agents Struggle with Memory Updates, New Training Environment Helps.

Large language model agents often struggle with maintaining accurate information over extended, multi-session interactions, particularly when facts change. This research pinpoints a "memory-update gap," demonstrating that even frontier models like GPT-5.4 significantly drop in accuracy when relying on self-maintained memory instead of full context, indicating a bottleneck in memory maintenance rather than comprehension. The problem worsens with conversation length, and simply increasing memory size doesn't resolve it. To address this, the researchers developed Supersede, an open reinforcement learning environment designed to train agents on temporal fact currency. Agents are rewarded for using current information and penalized for stale facts. Fine-tuning a smaller open model (Qwen2.5-3B) within this environment nearly doubled its accuracy in handling superseded information on unseen conversations, providing the first evidence that this specific memory gap can be effectively trained down.