Your organization’s administrators can set default context and output token limits that apply to every session. When you create a session, you can override those defaults for that session only.
Use an override when one session needs a different budget than usual. For example, a large refactor may need more context, or a quick fix may not need the full default window.
Set limits for a new session
You can only set session limits when you create the session. After the initial prompt, the session keeps the limits it started with.
- Open the New Session page.
- In the message composer, select the Token Limits button. It shows
Default when no override is set and Custom when one is.
- In the
Adjust Session Token Limits dialog, enter a Context Limit, an Output Limit, or both. Each field’s placeholder shows the default that applies to the selected model.
- Select Save.
To go back to your organization’s defaults, reopen the dialog and reset the values.
If the selected model has a maximum context size configured by your administrators, the dialog shows it and caps your input at that value.
Setting a limit above the model’s actual maximum may result in unexpected behavior.
API
You can set limits when creating a session programmatically by passing the optional limits object:
Both context and output accept integers between 1 and 10,000,000. Omit the limits object to use your organization’s defaults. 