Bug: NVIDIA API models (NIM) hang indefinitely during generation (Build/Thinking phase) despite successful model fetching #28385

Activity

1. github-actions

   assigned

   jlongster

   on May 19, 2026
2. github-actions commented on May 19, 2026

   

   github-actionsBot

   on May 19, 2026 – with GitHub Actions

   Contributor

   More actions

   This issue might be a duplicate of existing issues. Please check:

   • NVIDIA API models hang indefinitely with "Aborted process" - all models affected (DeepSeek V4, Llama, Mistral, Minimax) #24516: NVIDIA API models hang indefinitely with "Aborted process" - all models affected (DeepSeek V4, Llama, Mistral, Minimax)
   • Nvidia NIM API hangs for DeepSeek v4 reasoning models without chat_template_kwargs #24264: Nvidia NIM API hangs for DeepSeek v4 reasoning models without chat_template_kwargs (includes a likely root cause: missing chat_template_kwargs in the request payload)

   If your issue is the same, please consider adding a thumbs-up or comment to the existing issue rather than opening a new one.

   👍React with 👍1Reacted by Ahmedbhayat22
3. mahad-writes commented on Jun 26, 2026

   

   mahad-writes

   on Jun 26, 2026

   More actions

   Additional debugging information:

   I verified that this is not an authentication or NVIDIA API issue.

   Using the same NVIDIA API key, same endpoint (https://integrate.api.nvidia.com/v1), and same model (nvidia/nemotron-3-ultra-550b-a55b), NVIDIA's official Python example using the OpenAI SDK streams successfully and returns the expected response.

   I then configured OpenCode to use the exact same API key via /connect. The model still hangs indefinitely in the Build/Thinking phase with no streamed tokens or error.

   Other NVIDIA NIM models continue to work correctly in OpenCode.

   This appears to be specific to OpenCode's handling of nvidia/nemotron-3-ultra-550b-a55b, rather than an issue with the API key, endpoint, or NVIDIA service.

   Since this issue has been linked to #24264 and #28385, it may indicate that Nemotron 3 Ultra requires additional handling beyond the previous options.extraBody propagation fix.

   😕React with 😕1Reacted by Ritam
4. github-actions commented on Aug 26, 2026

   

   github-actionsBot

   on Aug 26, 2026 – with GitHub Actions

   Contributor

   More actions

   To stay organized issues are automatically closed after 60 days of no activity. If the issue is still relevant please open a new one.
5. github-actions

   closed this as not plannedon Aug 26, 2026