Fundamentals

Context Window

A context window is the amount of conversation, instructions, and source material an AI model can consider at once, measured in tokens.

The context window is the model’s active workspace

A context window is the maximum amount of information an AI model can use at one time. It includes the current conversation, instructions, uploaded documents, and often tool results. Its size is measured in tokens.

A useful analogy is a desk: the model can work with the material currently spread across it. A larger desk holds more material, but organization still affects how well the material is used.

Why does an AI forget earlier instructions?

In a very long conversation, earlier details may fall outside the context window or receive less attention. This is a system limitation rather than intentional disregard.

Current models can accept far more material than earlier chatbots, sometimes longer than a book. Every model still has a limit, and accuracy can decline when the workspace becomes crowded.

Services handle overflow differently. Some reject the request; others remove or summarize older messages.

How to work within the limit

  • Start a new conversation when the subject changes
  • Restate essential conditions during a long task
  • Split a large source or summarize completed stages
  • Ask the AI to create a checkpoint summary before moving on

A service’s long-term memory feature is separate from its context window. The context window is the active desk for this task; memory is closer to a note saved in a drawer for future conversations.

Related terms

Sources and review information

Last reviewed July 16, 2026

Back to the AI Glossary

Search this site