Context Window
A context window is the maximum amount of text — measured in tokens — that a language model can process in a single inference call.
Technical implementation · Emerging
A context window is the maximum amount of text — measured in tokens — that a language model can process in a single inference call.