Skip to content

DOT substitutes its own implementation plan for user instructions and reports completion despite unmet requirements #52157

Open

Description

@CanisDirusPrime

#ignored instructions #lost work #incorrect reporting #failed directions #failed to follow planning

DOT Instruction_Accountability_Data_2026-10-08.json
DOT Instruction_Accountability_Report_2026-10-08.docx

The dot implementation failed to preserve the user’s requirements across a multi-step development task. The agreed goal was one progressively trained model, introducing one parameter at a time and reinforcing earlier learning with specified training-data mixtures. Instead, dot built separate detectors and used earlier examples only to evaluate frozen models rather than train them. An initial hue-only run also included saturation and brightness changes, violating the explicit one-parameter restriction.
Individual runs were reported as completed without adequately identifying that the overall implementation did not satisfy the agreed goal. The user discovered the architectural divergence by asking whether all the learning was in one model. Although a separate detector and frozen earlier model had been mentioned before one run, dot did not resolve that design’s conflict with the progressive shared-model plan.
The impact included hours of planning, discussion, waiting, review, and correction spent on work that did not produce the requested result. Producing an accountability report required further corrections: dot initially used an incomplete measure of lost time, retained that rejected measure after correction, and failed to consult available official documentation before answering a model-identification question. Incomplete accessible records also prevented a fully exhaustive audit.
The core problem is failure to carry user constraints through planning, delegation, execution, verification, and reporting. Completing individual tasks was treated as success without checking whether those tasks still fulfilled the user’s actual request.

Activity

  1. added
    bugSomething isn't working
    dotsIssues involving setting up ChatGPT dots or managing their ongoing work.
    model-behaviorIssues related to behaviors exhibited by the model
    on Oct 8, 2026
  2. vukasinbucur-stack commented on Oct 9, 2026

    @vukasinbucur-stack

    The unwanted substitution of the assistant's own solution matches my experience in a different task. In Blender I explicitly requested a mockup retaining my reference shapes. Codex created simplified solid envelopes instead, changing the exterior geometry without my approval. I had to object, and it then acknowledged the mistake and removed the mockup.

    I later clarified that the purpose was a hollow, nonfunctional shell for assessing dimensions and grip comfort in my hand. Preserving the exterior shape was essential to that purpose. My report is #52507. I am not confirming the details of your training implementation, but I am confirming the broader failure to carry the user's actual requirements through to the result.

  3. SplitMilky commented on Oct 13, 2026

    @SplitMilky

    I'm seeing a related instruction-retention problem in a long-running OpenAI dot conversation. Clear requests for concise answers and corrections about unwanted explanations gradually stop sticking, so I have to repeat them. Recent occurrences were on October 12–13, 2026 (UTC). I use dot on Windows web and Android, with the same ongoing conversation.

    One example, paraphrased: I suggested that reading old test clients in a backup could have triggered Windows Defender cloud scans. dot added that this didn't mean the clients had launched, although I hadn't claimed they had. The extra distinction was exactly the kind of unnecessary explanation I'd already asked it to avoid.

    Expected: the latest explicit response-style instructions and corrections remain effective throughout the conversation. The impact is repeated correction and extra text instead of a direct answer.

    The dot model, client build and compaction history are unknown. This is an experience report, without a controlled reproduction or diagnostic logs. Long-thread/context drift is a hypothesis.

    Potentially related comparisons: #42930 (latest-instruction loss and overexplaining) and #46953 (completed requests resurfacing after compaction). These describe Astra/Codex incidents; a shared cause with this dot behavior hasn't been established.

    Could maintainers check whether dot's context/instruction retention is related, and advise which non-sensitive diagnostics would help?

  4. SplitMilky commented on Oct 13, 2026

    @SplitMilky

    Following up on my earlier comment with four more observations from 13 October 2026 (UTC), from my long-running dot conversation and its game-development task:

    1. dot skipped an established project index. I had to remind it that the index was built so it could give agents specific pointers instead of having them search blindly. It then acknowledged skipping that navigation step.
    2. dot interpreted our existing terrain “blobs/boobs” design as procedural creatures and offered choices about shapes, movement, and variety. I had to restate that blobs were terrain/content patches and that larger recipes composed blob types and counts.
    3. dot searched the wrong history source for that design. Searching the dot conversation recovered the original 5 October definition and acronym, intact. It acknowledged that it had used the wrong source.
    4. A game task promised to finish remaining tests and patches, then ended after answering a side question about chat compaction. It needed another instruction to resume, after which it continued and returned implementation results.

    These incidents required repeated explanation and extra coordination. Large chats are still problematic in everyday project work.

    Please improve:

    • Following established project indexes before broad searches or delegation
    • Searching the correct conversation history and making source coverage clear
    • Retaining accepted design definitions and unfinished tasks across side questions and context changes
    • Keeping task status fresh, with a clear distinction between active work, waiting, and completion, plus the last actual progress
  5. COOLak commented on Oct 14, 2026

    @COOLak

    I found related failures in my dot-coordinated development work on October 13–14, 2026. The full timestamped audit distinguishes user observations, assistant acknowledgments and corroborating saved artifacts.

    Instruction-specific examples (UTC):

    • October 13, 19:36 and 20:50: the assistant acknowledged misinterpreting a small window-behavior request and overreading a request for stable testing into a blanket GUI restriction.
    • October 14, 04:12: it acknowledged that an old no-files restriction came from its own earlier task, while later user-authorized uploads were still blocked by that obsolete scope.
    • October 14, 14:19–14:20: it acknowledged reversing the requested order of work, slicing an existing composition after I had asked for separately generated elements followed by composition.
    • October 14, 18:58–19:04: it acknowledged that the delivered build retained the old overall composition, that my graphics-per-build requirement had not reached the build process, and that the asset audit reported unconnected new layers and older assets selected.
    • October 14, 20:39: it acknowledged that a task message had been accepted through a native messaging tool despite my explicit browser-only instruction.

    The audit covers the full accessible room history, not all account or backend history. These examples establish repeated interpretation, propagation and acceptance failures; they do not establish one underlying backend cause. Please preserve current requirements and explicit supersessions through delegation and verify the delivered result against them. Repeated user corrections should not be the mechanism that keeps active work aligned.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingdotsIssues involving setting up ChatGPT dots or managing their ongoing work.model-behaviorIssues related to behaviors exhibited by the model

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions