You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
feat: vision sub-model fallback for non-multimodal models #31936
When the primary model doesn't support image input (e.g., mimo-v2.5-pro has image: false in models.dev), the TUI blocks clipboard paste and drag-drop with "this model does not support image input". There is no way to configure a fallback vision model.
Motivation
Many strong coding models (like mimo-v2.5-pro) don't support images natively, but their providers often have a companion vision model (like mimo-v2.5 or mimo-v2-omni). Currently users must choose between:
A strong non-vision model (no image support)
A weaker vision-capable model
This is a common pattern in the ecosystem — both Hermes and Claude Code solve this with a dedicated vision sub-model configuration:
Hermes: auxiliary.vision config section with separate provider, model, base_url, api_key
Claude Code: automatic vision sub-agent delegation
Proposed Solution
Add a vision_model or auxiliary.vision configuration option that specifies a fallback model for image processing:
{
"model": "xiaomi/mimo-v2.5-pro", // main model (no image support)"vision_model": "xiaomi/mimo-v2.5"// fallback for images
}
When the user pastes an image or drags in a file:
If the main model supports images → send directly (current behavior)
If not, and vision_model is configured → send image to vision model, get text description, pass to main model
If neither → show current error
Alternatives Considered
Switching to a vision-capable model entirely (loses reasoning quality)
Using a custom tool/script to pre-process images (poor UX)
Additional Context
This affects any provider where the strongest model lacks multimodal support but a weaker model has it. Common with Xiaomi/MiMo models, and likely other providers too.
Please review those issues (especially #24948, which even references a linked PR) and consider adding your input there rather than opening a new issue.
Activity
github-actions commentedon Jun 11, 2026
This issue might be a duplicate of existing issues. Please check:
vision_modelconfig field and automatic fallback when the active model lacks image supportPlease review those issues (especially #24948, which even references a linked PR) and consider adding your input there rather than opening a new issue.