AI Improves Medical RL by Removing Redundant Clinical Notes

Reinforcement learning (RL) holds significant promise for optimizing dynamic medical interventions like mechanical ventilation. However, current RL approaches in healthcare often rely on structured electronic health record (EHR) data, overlooking the rich context found in free-text clinical notes. A major challenge in integrating these notes is the pervasive temporal redundancy, such as copied text or templates, which can dilute crucial time-local updates and degrade the quality of state representations. To address this, researchers developed a redundancy-aware multimodal state representation framework. This framework systematically removes duplicated note text over time before the policy learning phase. They explored two efficient methods for this temporal decomposition: one using singular value decomposition in embedding space and another employing a sentence-level diff operation to filter out previously documented sentences. Evaluations using real-world ICU data demonstrated that state representations built by stripping this temporal redundancy significantly outperformed baselines that used only structured data or raw, unfiltered notes. The findings indicate that isolating new clinical information from repetitive text directly enhances RL performance for clinical decision support systems.