Unable to use Devstral Small: error due to max tokens

Some models (Devstral Small on Chutes, Mercury Coder, many more near the bottom of this list) have context lengths of 32k tokens. Since opencode always sets max tokens to 32k and sends more tokens as context, errors result:

This is likely due to an incorrect context length in models.dev. opencode should adapt its request to use a shorter max tokens (in case the data is incorrect) and/or switch to using data from the models endpoint (always use correct data).

can you set output tokens number to be 16K or something smaller?

That would theoretically fix it, but ideally anomalyco/models.dev#49 would be merged and then something like this would be added:

- const outputLimit = Math.min(model.info.limit.output, OUTPUT_TOKEN_MAX) || OUTPUT_TOKEN_MAX
+ let outputLimit = OUTPUT_TOKEN_MAX;
+ if (model.info.limit.output && model.info.limit.output < outputLimit) outputLimit = model.info.limit.output;
+ const tokens = previous && previous.tokens && (previous.tokens.input + previous.tokens.cache.read + previous.tokens.cache.write + previous.tokens.output);
+ const tokensRemaining = model.info.limit.input - tokens;
+ if (tokensRemaining && tokensRemaining < outputLimit) outputLimit = tokensRemaining;

Merge pull request anomalyco#926 from xingzihai/feature/pre-commit-qu…

fix(session): prioritize common providers and hide redundant ChatGPT …

fix: imessage send + read resolve lead ID and contact name (anomalyco…

Navigation Menu

Repository navigation

Unable to use Devstral Small: error due to max tokens #926

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Unable to use Devstral Small: error due to max tokens #926

Description

Activity

thdxr commented on Jul 14, 2025

KTibow commented on Jul 14, 2025

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions