Working memory is the agent’s “mental workspace”—it holds everything needed to solve the current task, from retrieved context to intermediate reasoning steps. Unlike other memory types, it’s temporary by design. It’s the bridge between long-term knowledge and immediate action—where thinking happens.
Working memory operates as a volatile, task-scoped, high-bandwidth system that constantly refreshes. Think of it as RAM for AI agents: the current task definition, relevant context pulled from long-term storage, a scratchpad for intermediate reasoning, and tool outputs being processed.
Two Scopes of Working Memory
Single-Turn: Within one request-response cycle. The user query comes in, working memory holds reasoning steps and tool calls (Chain-of-Thought, ReAct, Scratchpad), generates a response, then clears after completion.
Multi-Turn: Across a conversation or session. Working memory accumulates state across turns—Turn 1 (“Find…”), Turn 2 (“Filter…”), Turn 3 (“Book it”)—building session context that persists during the interaction but clears when the session ends.
Key Characteristics
Volatile: Disappears after use—this is a feature, not a bug. It prevents cognitive overload from persistent accumulation.
High Bandwidth: Rich, detailed state with full context available for immediate processing.
Task-Scoped: Focused entirely on the current goal, filtering irrelevant information.
Active: Constantly updating as new information arrives and reasoning progresses.
Representative Systems
Multiple approaches implement working memory: ReAct (Reason+Act), MemGPT (OS-inspired virtual context), Cognitive Architectures (Inner Monologue), ProAgent (Multi-turn Tool Use), ReST-MCTS (Tree search), and Scratchpad (Temporary storage). Each balances the trade-off between context richness and processing efficiency.
Gennaro is the creator of FourWeekMBA, which reached about four million business people, comprising C-level executives, investors, analysts, product managers, and aspiring digital entrepreneurs in 2022 alone | He is also Director of Sales for a high-tech scaleup in the AI Industry | In 2012, Gennaro earned an International MBA with emphasis on Corporate Finance and Business Strategy.
