Skip to content

pullrequests Search Results · bucket language:JavaScript language:Java language:Python language:JavaScript language:JavaScript

Filter by

1M results  (429 ms)

1M results

Overview When _get_kv_cache_groups_uniform_page_size groups KV cache specs by (is_draft, type_id, page_size_bytes), it previously computed min_num_layers across all buckets—including draft-only ...
bug
kv-cache-manager

Summary Writes to Rapid Cache Ultra (RCU) buckets now go through the gRPC appendable writer (AsyncAppendableObjectWriter) that zonal buckets already use, with storage_class= RAPID . An RCU bucket ...

Bug
Performance
SQL
tandem

s3_bucket_exists converts every S3 error code to an integer. Named codes such as NoSuchBucket and AccessDenied therefore raise ValueError, interrupting the bucket check used by aws configservice ...

🚨 Severity: HIGH 💡 Vulnerability: get_user_id used get_unverified_claims to extract the user ID for rate limiting, allowing an attacker to spoof tokens and poison other users rate limit buckets ...

... - minio_s3_bucket_replication no longer pairs a rule with the remote target of the rule that used to sit at the same position (# #8203;1250). Removing a rule that is not the last one used to send ...

Motivation get_batch_sizes_to_capture drops the top decode bucket when --cuda-graph-max-bs is below the request pool and not a multiple of the attention-TP alignment. Example: DP attention with attn ...
blackwell
lora

... How it solves it: - The window and pools are keyed by provider bucket: the organization of the deployment that serves the call plus its model class - Admission moves to the router stage that ...