Replies: 1 comment
|
Not necessarily, it depends on where the Speed setting lives in the request, not just whether you toggle it. Prompt caching (on both OpenAI and Anthropic's APIs) works on an exact-prefix match... |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Does switching Fast Speed on and off during a session invalidate the prompt cache in Codex app?
I have been using [mattpocock/skills](https://github.com/mattpocock/skills) frequently recently.
My usual workflow in the Codex app is:
So within a single session, I may switch between Fast Speed and Standard Speed multiple times.
My question is:
Environment
What I found
In Claude Code’s documentation, it says that since Claude Code v2.1.86, if Fast Mode is enabled first, then turning it off or turning it back on later still preserves the cache.
I would like to know whether Codex app has similar behavior for GPT models.
I checked the OpenAI prompt caching documentation, but I could not find information specifically about how Speed mode switching in Codex app affects prompt cache behavior:
https://developers.openai.com/api/docs/guides/prompt-caching
Reference from Claude Code:
https://code.claude.com/docs/en/prompt-caching#turning-on-fast-mode
All reactions