Skip to content

GPT-5.6-Sol skips ClickUp Get task and can fabricate an answer while Terra/Luna invoke it #33646

Closed

Description

@yeaight7

Summary

In Codex Desktop on Windows, GPT-5.6-Sol can fail to invoke ClickUp's Get task action even when the ClickUp app is explicitly attached to a fresh task. It may return a plausible answer without any ClickUp tool event; when challenged, it acknowledged that it had not made the call and had fabricated the answer. In another fresh task, it reported that ClickUp Get task was not exposed.

The same ClickUp connection and request succeed with GPT-5.6-Terra and GPT-5.6-Luna: they invoke ClickUp → Get task and then respond based on the task.

Steps to reproduce

  1. In Codex Desktop for Windows, start a fresh task with GPT-5.6-Sol.
  2. Explicitly attach the installed ClickUp app.
  3. Send a request such as:
    Use ClickUp's Get task action now for <a valid ClickUp custom task ID>.
    Do not respond until the tool call has completed.
    Then reply only: Easy, Medium, or Hard.
    
  4. Observe that Sol may respond (for example, Hard) with no ClickUp → Get task tool event.
  5. Ask how it determined the answer. It can acknowledge that it did not make the ClickUp call and fabricated the rating.
  6. Repeat in another new Sol task. It may instead say the ClickUp Get task action is not exposed.
  7. Repeat the same test with Terra or Luna against the same ClickUp connection. They invoke Get task successfully.

Expected behavior

With ClickUp explicitly attached and an explicit Get task request, Sol should invoke the action before responding. If the tool genuinely is unavailable, it should state that without inventing a result.

Actual behavior

Sol can skip the tool call and fabricate an answer, or claim that Get task is not exposed. The submitter reproduced this across 12 fresh Sol tasks, while Terra and Luna succeeded with the same ClickUp connection.

Environment

  • ChatGPT Pro subscription
  • Codex Desktop for Windows (latest version) // Also tried the same process in Codex CLI
  • ClickUp app explicitly attached
  • Models compared: GPT-5.6-Sol (fails), GPT-5.6-Terra and GPT-5.6-Luna (succeed)
  • Exact task ID can be provided privately if useful

Related issue

This appears distinct from #32710. That issue concerns a ClickUp comment-write tool whose backend returns Tool ... not found; here, the read action Get task works with Terra/Luna but is not invoked or exposed for Sol.

Screenshots

GPT-5.6-Luna:
Image

GPT-5.6-Sol:
Image

Image

Activity

  1. added
    bugSomething isn't working
    appIssues related to the Codex desktop app
    windows-osIssues related to Codex on Windows systems
    model-behaviorIssues related to behaviors exhibited by the model
    tool-callsIssues related to tool calling
    on Jul 16, 2026
  2. yeaight7 commented on Jul 16, 2026

    @yeaight7
    Author

    Seems like it works now. Also all the other "broken"/not exposed tools like browser and others, are now exposed and available. I think this can be closed now

    Image
  3. yeaight7 commented on Jul 27, 2026

    @yeaight7
    Author

    SOlved

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    appIssues related to the Codex desktop appbugSomething isn't workingmodel-behaviorIssues related to behaviors exhibited by the modeltool-callsIssues related to tool callingwindows-osIssues related to Codex on Windows systems

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions