You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
LLM Sometimes Fails to Request Permission Escalation on Sandbox Error #3692
Because this behavior depends on the LLM’s output, there is no stable way to reproduce it.
When Approval Mode is set to Auto, my project fails unit tests with the error:
sandbox error: command was killed by a signal
In many cases, the LLM correctly recognizes this as a sandbox issue and re‑suggests the same command via Proposed Command, which allows me to choose Allow Command to run it.
However, when I use Codex heavily, there are times when the LLM skips proposing the command altogether. Instead, it simply terminates execution and tells me to run the test myself.
Even worse, sometimes when I ask the LLM to fix a failing test, it encounters a sandbox error and then tries to "solve" the problem by only reading the code and making changes without even running the test. That feels like a very bad idea.
Suggestions for improvement:
When a sandbox error occurs, don’t let the LLM decide whether to generate a Proposed Command. Always ask me directly if I want to run it.
Consider improving the handling strategy through prompt engineering or training, so that the LLM consistently proposes the command whenever possible.
Thanks for the bug report. We've shared the feedback with the team members who are responsible for training our codex models. We're tracking this feedback and similar reports so we can make the model more robust in future iterations.
If you see other model behavior that you'd like to report, please use the recently-added /feedback command in the CLI. That will provide us with additional details including logs and conversation text.
Activity
etraut-openai commentedon Nov 10, 2025
Thanks for the bug report. We've shared the feedback with the team members who are responsible for training our codex models. We're tracking this feedback and similar reports so we can make the model more robust in future iterations.
If you see other model behavior that you'd like to report, please use the recently-added
/feedbackcommand in the CLI. That will provide us with additional details including logs and conversation text.