pullrequests Search Results · bucket language:JavaScript language:JavaScript language:Python language:Java language:JavaScript
Filter by
1.1M results
Motivation
bdc1acf6cd (#2761, 2025-01-07) moved the first bucket of sglang:time_to_first_token_seconds from 0.001 s to 0.1 s and
stretched the tail from 30 s to 160 s, without saying why. Since then ...
Reduce repeated datastore work on watcher and dashboard requests, and stream large exports with bounded event memory.
Changes:
- Reuse bucket handles and direct existence checks instead of ...
dependencies
python
dependencies
python
dependencies
python
dependencies
python