Skip to content

LLM Sometimes Fails to Request Permission Escalation on Sandbox Error #3692

Closed

Description

@zzh1996

What version of Codex is running?

codex-cli 0.36.0

Which model were you using?

gpt-5-codex medium

What platform is your computer?

Darwin 25.0.0 arm64 arm

What steps can reproduce the bug?

Because this behavior depends on the LLM’s output, there is no stable way to reproduce it.


When Approval Mode is set to Auto, my project fails unit tests with the error:

sandbox error: command was killed by a signal

In many cases, the LLM correctly recognizes this as a sandbox issue and re‑suggests the same command via Proposed Command, which allows me to choose Allow Command to run it.

However, when I use Codex heavily, there are times when the LLM skips proposing the command altogether. Instead, it simply terminates execution and tells me to run the test myself.

Even worse, sometimes when I ask the LLM to fix a failing test, it encounters a sandbox error and then tries to "solve" the problem by only reading the code and making changes without even running the test. That feels like a very bad idea.


Suggestions for improvement:

  1. When a sandbox error occurs, don’t let the LLM decide whether to generate a Proposed Command. Always ask me directly if I want to run it.
  2. Consider improving the handling strategy through prompt engineering or training, so that the LLM consistently proposes the command whenever possible.

What is the expected behavior?

No response

What do you see instead?

No response

Additional information

No response

Activity

  1. etraut-openai commented on Nov 10, 2025

    @etraut-openai
    Contributor

    Thanks for the bug report. We've shared the feedback with the team members who are responsible for training our codex models. We're tracking this feedback and similar reports so we can make the model more robust in future iterations.

    If you see other model behavior that you'd like to report, please use the recently-added /feedback command in the CLI. That will provide us with additional details including logs and conversation text.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingmodel-behaviorIssues related to behaviors exhibited by the model

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions