pullrequests Search Results · bucket language:JavaScript language:JavaScript language:JavaScript language:Python language:Java
Filter by
1.1M results
dependencies
python:uv
...
How it solves it:
- The window and pools are keyed by provider bucket: the organization of the deployment that serves the call plus its
model class
- Admission moves to the router stage that ...
bug
dependencies
documentation
enhancement
python
dependencies
python
Motivation
bdc1acf6cd (#2761, 2025-01-07) moved the first bucket of sglang:time_to_first_token_seconds from 0.001 s to 0.1 s and
stretched the tail from 30 s to 160 s, without saying why. Since then ...