Repository navigation
macOS Computer Use: fresh Safari state succeeds, then coordinate click fails with -10005 noWindowsAvailable after app restart #36459
Description
Summary
On macOS, Computer Use can successfully return a fresh full screenshot and accessibility tree for the visible Safari window, and accessibility-index plus keyboard actions work, but a coordinate click derived from that same screenshot immediately fails with:
SkyComputerUseError: Computer Use server error -10005: noWindowsAvailable
The first occurrence was reproduced immediately after quitting and reopening the ChatGPT desktop app. A fresh reproduction about 30 hours later produced the same split-path result. The failure is not tied to a hidden, narrow, off-screen, or multi-display Safari window.
Environment
- ChatGPT desktop app:
26.727.40816(bundle build6067), bundle IDcom.openai.codex - Computer Use JS client:
@oai/sky 0.6.2 - Signed helper:
com.openai.sky.CUAService 26.727.1000550(build1000550), Developer ID team2DC432GLL2; strict signature validation passed - macOS:
26.5.1(25F80), Apple Siliconarm64 - Active display topology: one built-in display,
1512 x 945 @ 120 Hz, main/online, CoreGraphics bounds(0,0) 1512x945 - Safari test window: one normal large window; screenshot
1386x768; no full-screen, Split View, tiling, negative position, or geometry recovery was required - Helper count:
1activeSkyComputerUseService - Main ChatGPT app-server direct
node_replchildren not belonging to this reproduction:7stale candidates, aged approximately 35 minutes to 28 hours at capture; none were killed - System-wide
node_repl:9; stdio app-server:2;SkyComputerUseClient mcp:0 - Zombie processes:
0system-wide,0under the ChatGPT GUI parent,0under its main app-server
Exact reproduction
-
Keep an existing normal Safari window open. Inventory all existing tabs; do not close or overwrite them.
-
Request a fresh full state:
await sky.get_app_state({ app: "com.apple.Safari", disableDiff: true })
-
Confirm the response contains both a screenshot and accessibility tree for the same visible Safari window.
-
Choose a benign blank point inside the page viewport, away from browser chrome and site controls. In this run the first verified point was
(865, 570). -
Execute:
await sky.click({ app: "com.apple.Safari", x: 865, y: 570 })
-
Observe the immediate exception:
SkyComputerUseError: Computer Use server error -10005: noWindowsAvailable
The same error was reproduced at a second screenshot-verified page-content point (975, 250).
Recovery matrix
All six progressive recovery methods were completed without bypassing authentication, changing permissions, restarting Safari/WindowServer, or changing external state:
- Waited, then fetched a fresh full Safari state: screenshot and accessibility tree succeeded; coordinate click failed
-10005. - Pressed
Escapeto dismiss any overlay, then fetched a fresh full state: both succeeded; coordinate click failed-10005. - Captured and visually inspected a new screenshot from the large on-screen window, then used a new page-content coordinate: failed
-10005. - Restored keyboard focus with
Tab, then fetched a fresh full state: both succeeded; coordinate click failed-10005. - Opened the exact URL in one fresh task-owned tab, verified the same pre-existing signed-in account and loaded state, dismissed the account overlay, and fetched a fresh full state: coordinate click failed
-10005. - Captured one final screenshot from the recovered task tab and made a final screenshot-guided page-content click: failed
-10005.
The task-owned tab was closed afterward. Focus returned to the pre-existing Analytics tab, the window remained large, and the original two tabs remained open. No composer opened, no text was typed into a site, and no public action occurred.
Expected behavior
A coordinate action should resolve and target the same normal Safari window that the immediately preceding full-state request successfully captured. A healthy screenshot/accessibility request should not be followed by noWindowsAvailable for the same app/window.
Bounded diagnostic evidence
Client-side exception prefix:
SkyComputerUseError: Computer Use server error -10005: noWindowsAvailable
at @oai/sky/.../targets/mac/native-pipe.js
A bounded unified-log query covering 2026-08-01 19:34:30–19:42:30 AEST for SkyComputerUseService, ChatGPT, ComputerUseIPC, noWindowsAvailable, timeoutReached, AccessibilitySupport, and ScreenCaptureKit returned no matching records. This is recorded as a zero-result query rather than expanding the collection window or attaching unrelated logs.
Official update observed locally
Sparkle has staged a correctly signed ChatGPT app update 26.727.51351 (bundle build 6119) while 26.727.40816 (build 6067) remains installed. The staged app still contains @oai/sky 0.6.2 and helper 26.727.1000550, identical to the installed Computer Use components. The update was not installed, copied, launched, or modified; its fix status is unknown.
Related reports
- Codex for macOS accumulates Computer Use / MCP helper processes and unreaped zombie children, causing HID lag and WindowServer/TCC stalls #25744 — accumulated Computer Use/MCP helpers and WindowServer/TCC stalls
- Privacy/security risk: Codex Computer Use captures wrong macOS Space/window instead of target app #21668 — target-window/macOS Space mis-correlation
- Computer Use screenshots can capture unrelated windows instead of the target window #24301 — screenshots resolving to an unrelated target window
This report may share lifecycle or target-correlation code with those issues, but adds the deterministic state-success/action-failure split and the exact -10005 noWindowsAvailable result.
Activity
github-actions commentedon Aug 1, 2026
Potential duplicates detected. Please review them and close your issue if it is a duplicate.
Powered by Codex Action
rootsid-GovernSafe commentedon Aug 11, 2026
Update from a newer bundled build, reproduced 2026-08-11:
26.803.415151.0.1000633@oai/sky0.6.2SkyComputerUseError: Computer Use server error -10005: noWindowsAvailable.Repost with your thoughtsnorRepost now.This shows plugin
1.0.1000633also does not resolve the state-success/action-failure split reported here. Can the Computer Use maintainer confirm whether a build newer than1.0.1000633contains the Safari window-to-pointer targeting fix, or provide the installable build/version that should be retested?niyoufei commentedon Sep 3, 2026
Additional independently observed reproduction on build 26.831 (2026-09-03)
Adding a newer-build reproduction with the same error and read/coordinate-action split, observed in Figma and System Settings. This may be related to this issue and the cross-app report #38508; a common internal root cause has not been established.
Observed failure
Public native CUA coordinate clicks return:
Native AX and screenshots remain readable. Semantic AX clicks successfully navigate System Settings and open a Figma top-level Help menu. A subsequent read confirmed that menu was closed without invoking any menu command.
Environment
Reproduction evidence
Targets were identified from public AX/screenshot observations. Screenshot dimensions were independently verified during the investigation from JPEG SOF markers in the bytes returned by public screenshot methods; not every earlier attempt included an advance raw-dimension check. The returned images were JPEG, despite a PNG-oriented wrapper/example.
The following table summarizes distinct target cases, not the complete chronological attempt log. Some targets were tested again after a specific recovery intervention, as described below.
Coordinates are specific to these observed windows, not reusable instructions. No document-editing or permission-toggle controls were clicked. This is not an NSOpenPanel reproduction: no file picker was opened in this investigation.
Bounded recovery attempts
makeKeyAndOrderFront): semantic action succeeds; coordinate failure persists.Latest exact reproduction: 2026-09-03 00:22:39.178–00:22:39.205 UTC. A single content-area click in the fresh helper/client combination returned the error. The subsequent AX/screenshot showed the original document and page, without a modal or visible change.
Static boundary checks
The bundled JavaScript maps
click([x,y])to numeric x/y, preserves the policy-resolved app target, and forwards a coordinate action. No JavaScript-level field loss or resampling defect was identified. The bundled type comment defines x/y as app-window screenshot coordinates. No native window ID or display-selection option is exposed by the public App binding inspected here.These checks do not establish the native implementation's exact failing branch. The failure should not be diagnosed as missing macOS permission merely from its name.
Requested investigation
Please inspect native coordinate-action window discovery/matching versus semantic AX targeting. Coordinate clicks failed in Figma and System Settings. After rebuilding the native helper and resetting the public REPL client, a Figma content-area coordinate click still returned the same error. Please advise a supported component fix or a build known to address this failure, with an acceptance check using a real coordinate click and observable UI response.
Privacy and scope
This report omits user names, local workspace paths, document/file identifiers, thread IDs, screenshots, business data, pairing codes, tokens, and credentials. It contains no full session transcript. No plugin was imported or run, no companion was started, and no business task/model operation occurred during these tests.
ozzyozbourne commentedon Sep 4, 2026
Additional reproduction observed September 3–4, 2026, using macOS Calculator as a minimal target.
Read succeeds, coordinate click fails
cua.getApp("Calculator").app.click([x, y]).Computer Use server error -10005: noWindowsAvailable.In the observed 230 × 408 screenshot, the AC center was approximately (88, 157). Nearby points inside the same button also failed. These coordinates are specific to that screenshot, not reusable targets.
Desktop and terminal CLI
The same Calculator read/accessibility-success versus coordinate-failure split was reproduced from the desktop task and from a standalone
codex exec --yolo --ephemeraltask. The terminal CLI reported 0.153.1 and the desktop bundled executable reported 0.153.0 when checked during the investigation. The CLI retry could access Calculator and complete 2 + 3 through accessibility, but coordinate activation still failed. This does not establish which component contains the defect.Window restoration observation
With Chrome minimized, selecting the app returned
noWindowsAvailable, and requesting its screenshot through the prior binding returnedtimeoutReached. The human observer saw Chrome restore to its previous window size and take focus during those requests, although no screenshot was returned. Thus an error did not imply that no UI side effect occurred.Fresh bindings and re-enabling the Computer Use MCP server did not resolve the observed coordinate failure. Separately, a local Flutter app has intermittent accessibility-action failures; we are not treating those as proven to share this root cause.
Could maintainers provide a supported recovery procedure or a build that fixes coordinate targeting? A useful acceptance check is an observable Calculator coordinate click, not merely successful screenshots or accessibility reads.
No private paths, screenshots, credentials, or raw session logs are included.
TheSeamau5 commentedon Sep 6, 2026
running into this same issue
Computer Use server error -10005: noWindowsAvailable
rayshineeeee commentedon Sep 6, 2026
same issue here
perpetua-engineering commentedon Sep 30, 2026
Additional reproduction on September 30, 2026, in macOS System Settings, with the same screenshot/AX-success versus coordinate-input-failure split.
Environment
26.928.21956, bundle build12404, bundle IDcom.openai.codex(read from the installed app after the operator restarted it).27.0, build26A428, Apple Silicon (arm64).cua_replAPI, targetingcom.apple.systempreferences.Minimal reproduction
await app.click([x, y])at its center. Our post-restart screenshot was 1480 × 1818 and the observed point was[174, 974]; these coordinates are specific to that screenshot and must be recomputed for other window layouts.No preference was changed, no update was initiated, and the original Settings page was restored.
Recovery results
The coordinate failure persisted after each of:
Raisesecondary action and taking a fresh observation.Accessibility-index navigation continued working after the failed coordinate clicks. This minimal reproduction required no Simulator or application-under-test interaction. It does not establish the native root cause or whether every application is affected.
Could maintainers investigate coordinate-action window resolution versus accessibility targeting, and identify a supported recovery or fixed build? An acceptance check should include a screenshot-guided coordinate click with a verified visible transition, not only successful capture/AX reads.
No screenshots, account identifiers, private project details, local paths, or raw session logs are attached.
SandroMaglione commentedon Oct 3, 2026
Additional cross-app reproduction on October 3, 2026
I am still affected by
Computer Use server error -10005: noWindowsAvailable. It prevents practical Computer Use workflows in Blender and drawing apps. The failure has been present for at least several weeks. Local test records from September 5 also document coordinate failures in CLIP STUDIO PAINT and TextEdit.This report adds a fresh Calculator comparison, TextEdit reproduction, and a Blender activation/fullscreen recovery matrix. It may also relate to #38508.
Environment verified on October 3
com.openai.codex@oai/sky0.7.5com.openai.sky.CUAServiceThe current reproduction used the public
cua_replAPI. The ChatGPT GUI was not running during these fresh tests; its bundled Computer Use runtime was in use. Please keep this distinction when triaging the host.Earlier in this same investigation, System Settings visibly showed Codex Computer Use enabled in both Accessibility and Screen Recording. No permission settings were changed. Strict deep code-signature verification of the installed helper passed again today. Its executable matches the helper bundled with ChatGPT, with SHA-256:
Fresh minimal reproduction in Calculator
await cua.getApp("com.apple.calculator").0.2button using screenshot coordinates.2.0.In this specific 460 × 816 screenshot, the button center was
[176, 639]and the returned AX index forTwowas18. Both must be derived again for other sessions.Observed timestamps in UTC:
2026-10-03T10:03:54.668Z, tool duration about 0.024 seconds.2026-10-03T10:03:59.470Z.2026-10-03T10:05:18.181Z.Cross-app evidence
[565, 32]and viewport scroll both failed with the same error.Twoclick fails; AX activation ofTwosucceeds visibly.[1425, 835]in a 1760 × 900 screenshot fails at2026-10-03T10:03:32.808Z. This fresh reproduction used an NSOpenPanel, not the text canvas.The Mac was unlocked. A one-time manual activation did not establish reliable continued background control. The temporary normal-window recovery resembles the observation in this comment, but fullscreen plus another manual click did not recover control here.
Other Blender recovery attempts in this investigation failed: fresh binding, keyboard activation, AX Raise, the native Window menu document entry, native Zoom, REPL reset, and one graceful helper restart followed by reconnect. The later manual title-bar activation was the intervention after which visible coordinate actions succeeded.
Additional debug evidence
A fresh process inventory found one
SkyComputerUseService, PID87162, parent PID1, twoSkyComputerUseClientprocesses, and fournode_replprocesses. Multiple client processes are recorded as context, not a confirmed cause.A bounded unified-log query for the helper covering
19:03:25–19:04:10 JSTreturned no messages matchingnoWindowsAvailable,cgWindowNotFound,windowNotFound, ordenied. ScreenCaptureKit window-enumeration messages were present in that interval. For example:That frame is 230 × 408 logical points, the size of the captured Calculator image at 2× scale. The log hides the owner/title, so size alone does not establish that it is Calculator or prove a Space/filtering defect.
Catching the repeated coordinate exception exposed only the public runtime wrapper frames. Temporary-directory prefixes have been removed:
Requested investigation
Please investigate native coordinate-action window discovery/matching and its handling of activation and macOS Spaces/fullscreen, compared with screenshot capture and AX activation. The precise native failing branch remains unknown.
Could maintainers identify a fixed build or supported recovery procedure, and the specific diagnostic logging needed to resolve this? A useful acceptance test is an observable coordinate click, scroll, and drag, followed by continued control while the user works in another app. Successful screenshots alone do not verify recovery. The official Computer Use documentation describes scoped background work on macOS.
No account credentials, private paths, artwork, screenshots, or full session logs are attached. Calculator was cleared after testing; no text document was opened or edited for the fresh TextEdit test.