Skip to content

[v0.14.7] Read tool incorrectly detects model as non-image-capable #3084

Closed

Description

@Raviguntakala

In the latest release v0.14.7, the read tool now supports reading images.However, there seems to be a small issue with the model capability check.

When I run read image.png, it says my model doesn’t support images.But when I pass the same image using @image.png, it works fine.

I’m using Sonnet 4, which supports both text and image inputs.

Attaching screenshot for reference 👇

Image Image

Expected behavior: The read tool should correctly detect that the model (Sonnet 4) supports images and proceed without throwing the unsupported model error.

Version: 0.14.7

Activity

  1. rekram1-node commented on Oct 10, 2025

    @rekram1-node
    Contributor

    I think we need to update models.dev to track it correctly..

    is this a custom claude sonnet 4? I see "Nexus Claude Sonnet 4" in your screenshot

    But the other part looks like normal?

    What provider is this?

  2. self-assigned this
    on Oct 10, 2025
  3. Raviguntakala commented on Oct 10, 2025

    @Raviguntakala
    ContributorAuthor

    I think we need to update models.dev to track it correctly..

    is this a custom claude sonnet 4? I see "Nexus Claude Sonnet 4" in your screenshot

    But the other part looks like normal?

    What provider is this?

    Nexus is my client’s internal API gateway

  4. rekram1-node commented on Oct 10, 2025

    @rekram1-node
    Contributor

    @Raviguntakala can u show your opencode.json if this is a custom model you need to specify the modalities currently...

    ill show you, here is an example:

    {
      "$schema": "https://opencode.ai/config.json",
      "provider": {
        "myprovider": {
          "npm": "@ai-sdk/openai-compatible",
          "name": "My AI ProviderDisplay Name",
          "options": {
            "baseURL": "https://api.myprovider.com/v1"
          },
          "models": {
            "my-model-name": {
              "name": "My Model Display Name",
              "modalities": {
                "input": ["text", "image"],
                "output": ["text"]
              }
            }
          }
        }
      }
    }
    
  5. Raviguntakala commented on Oct 11, 2025

    @Raviguntakala
    ContributorAuthor

    "modalities": {
    "input": ["text", "image"],
    "output": ["text"]

    Thanks @rekram1-node! After adding modalities, it is working.

    Image
  6. rekram1-node commented on Oct 11, 2025

    @rekram1-node
    Contributor

    sweet

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions