When to use a warm session
- Your users start sessions often and notice the wait while a new session provisions.
- Your cluster can afford one extra session pod running at all times. The spare consumes compute and storage even when nobody is using it.
Prerequisites
- You are signed in as an administrator.
Turn on a warm session
- Sign in to Cake Agents as an administrator.
- Open
Settings → Organization → General. - Toggle Keep a session warm on.
How the warm session works
- The spare is owned by an internal service account and is always private. It does not appear in anyone’s session list.
- When you create a session, Cake Agents assigns the ready spare to you with your title, model, privacy setting, and Slack thread, if any.
- The spare’s pod waits in a paused state until someone claims it. When you claim it, Cake Agents tells the paused pod to finish starting up with your configuration, such as your providers and instructions. The pod doesn’t restart, so the session is usually ready to answer within seconds.
- After a spare is claimed, Cake Agents provisions a new spare in the background for the next session.
- If no spare is ready, for example because two sessions start at the same time, Cake Agents creates the session the usual way.