[FEATURE]: automatic model switch upon rate limitation

It is inefficient to have a cool down mechanism when a model reaches its rate limitation.
we don't have time waiting.
make it smart, thanks.

This issue might be a duplicate of existing issues. Please check:

feat: OAuth Marathon - multi-account credential rotation #8591: feat: OAuth Marathon - multi-account credential rotation (automatic failover when one account hits rate limits)
[FEATURE]: Native Model Fallback / Failover Support #7602: [FEATURE]: Native Model Fallback / Failover Support (native model switching on rate limits)
[FEATURE]: model fallback in specific agents #9575: [FEATURE]: model fallback in specific agents (model fallback configuration for agents)
Implement exponential back-off when hitting rate limits #1712: Implement exponential back-off when hitting rate limits (automatic retry logic)
[FEATURE]: Retry: allow user to change "exponential backoff" to "fixed interval" #8769: [FEATURE]: Retry: allow user to change "exponential backoff" to "fixed interval" (customizable retry strategy)

Feel free to ignore if none of these address your specific case.

To stay organized issues are automatically closed after 60 days of no activity. If the issue is still relevant please open a new one.

Navigation Menu