LLM Summaries Can Distort Financial Decisions, Study Finds

Financial professionals often rely on LLMs to summarize vast amounts of information, but new research highlights a critical risk: these summaries can inadvertently distort the underlying investment decisions. The study defines this issue as "information fidelity loss," where LLM compression, despite producing fluent and factually plausible text, changes the judgment an investor would make based on the original source. This fidelity loss often stems from "decontextualization," where key evidence is retained but separated from crucial caveats, and "model dependency," where different LLMs yield varying interpretations. To counter this, the researchers propose Agentic Context Compression, a method that generates multiple summary candidates and audits their discrepancies against the original document to ensure decision-relevant context is preserved.