Skip to content

pullrequests Search Results · bucket language:JavaScript language:JavaScript language:JavaScript language:Python language:Java

Filter by

1.1M results  (455 ms)

1.1M results

dependencies
python:uv

... How it solves it: - The window and pools are keyed by provider bucket: the organization of the deployment that serves the call plus its model class - Admission moves to the router stage that ...

bug
dependencies
documentation
enhancement
python

Motivation bdc1acf6cd (#2761, 2025-01-07) moved the first bucket of sglang:time_to_first_token_seconds from 0.001 s to 0.1 s and stretched the tail from 30 s to 160 s, without saying why. Since then ...