Context Window
The bounded span of tokens a model can attend to in a single request.
The context window is the maximum number of Tokens a Large Language Model can consider at once. Everything the model knows about the immediate situation — instructions, conversation history, tool definitions, retrieved files, tool results — must fit inside it.
Its boundedness is the central constraint of applied language-model work. As windows have grown from a few thousand tokens to a million, the constraint has changed character rather than disappeared: the question is now less "will it fit" and more "does including this help". Filling a window with marginally relevant material measurably degrades attention to the material that mattered.
This makes context engineering the real discipline: choosing what to load, when, and in what form. The recurring techniques are to summarise rather than paste, to store artifacts outside the window and pass handles to them, to retrieve on demand rather than pre-loading, and to prune instructions describing capabilities that no longer exist.
Long-running work eventually exceeds any window. The usual answers are summarising older turns into a compact form, delegating self-contained work to a Subagent with its own window, and persisting durable facts to Agent Memory.
See also4
Hand-picked in the note itself — the neighbours worth reading next.
Token Budget
The finite allowance of model usage a task may consume, and the design decisions it forces.
Agents & Language Models11 connections
Prompt
The text supplied to a language model to elicit a response.
Agents & Language Models12 connections
Agentic Loop
The cycle of model turn, tool call, observation, repeat — the basic mechanism of an AI agent.
Agents & Language Models12 connections
Multi-Agent Orchestration
Coordinating several model instances on one body of work, each with its own context.
Agents & Language Models10 connections
Related2
Nearby in the graph rather than deliberately chosen. Looser, sometimes surprising.
Linked from12
Notes elsewhere in the wiki that reach for this one.
- Agent MemoryAgents & Language Models
Durable facts stored outside the context window and recalled into later sessions.
- Agentic LoopAgents & Language Models
The cycle of model turn, tool call, observation, repeat — the basic mechanism of an AI agent.
- Fan-Out and Fan-InAgents & Language Models
Splitting work across parallel workers and recombining their results.
- Human in the LoopAgents & Language Models
Requiring a person's judgement at chosen points in an otherwise automated process.
- Large Language ModelAgents & Language Models
A neural network trained to predict text, used as a general-purpose instruction-following system.
- Model Context ProtocolAgents & Language Models
An open protocol for exposing tools, data, and prompts to AI applications through a uniform interface.
- Multi-Agent OrchestrationAgents & Language Models
Coordinating several model instances on one body of work, each with its own context.
- PromptAgents & Language Models
The text supplied to a language model to elicit a response.
- Prompt InjectionAgents & Language Models
Untrusted content that reaches a model's context and is treated as instruction.
- SubagentAgents & Language Models
A model instance spawned by another to handle a scoped task with its own context.
- TokenAgents & Language Models
The sub-word unit a language model actually reads and writes; the unit of cost and of context.
- Token BudgetAgents & Language Models
The finite allowance of model usage a task may consume, and the design decisions it forces.