Skip to content

pullrequests Search Results · bucket language:JavaScript language:Java language:Python language:JavaScript language:JavaScript

Filter by

1.1M results  (504 ms)

1.1M results

Motivation bdc1acf6cd (#2761, 2025-01-07) moved the first bucket of sglang:time_to_first_token_seconds from 0.001 s to 0.1 s and stretched the tail from 30 s to 160 s, without saying why. Since then ...

Reduce repeated datastore work on watcher and dashboard requests, and stream large exports with bounded event memory. Changes: - Reuse bucket handles and direct existence checks instead of ...

dependencies
python