Managing context in long-run agentic applications

Summary

Long-running multi-agent systems struggle with context management because accumulating raw message histories degrades inference quality, increases latency, and exceeds context window limits. In a collaborative security investigation platform, passing unrestricted history can also introduce confirmation bias across specialized agents. To maintain coherence across unbounded rounds of investigation, the system eliminates raw message history carryover between invocations. Instead, it coordinates agents through three structured context channels: a Director's Journal for orchestration memory, a Critic's Review that scores findings to filter hallucinations, and a Critic's Timeline of validated chronological events. This architecture provides agents with tailored context without overwhelming their inference capacity.

Takeaways

1. 1

   Rather than passing full raw message histories across invocations, long-running agent workflows can prevent context window exhaustion by utilizing structured online context summarisation channels.

2. 2

   The Director's Journal acts as a shared working memory categorized into six entry types: decisions, observations, findings, questions, actions, and hypotheses.

3. 3

   The Critic agent filters hallucinations and misinterpretations by validating expert findings against cited tool artifacts and assigning credibility scores to generate reviews and timelines.