pullrequests Search Results · bucket language:JavaScript language:JavaScript language:JavaScript language:Java language:Python
Filter by
1M results
litiliuSummary
Under DP attention, extend steps pad each rank to the raw max token count first, then the shim pads again to a bucket.
The raw max changes almost every step, so the eager pads and the idle ...
run-ci
tpu
junyanxu
polsala
Why
The repair script from #2 scans disk folders only. The production bucket holds 933,508 objects (643 GB), of which
915,311 exist only in the bucket. Local disk has 18,197, all also in the bucket ...
mcfarhat
... : the request s bucket (to: storage) or one of its datasets (to: warehouse[:NAME], partitioned tables).
Validated: the destination must be in the request, a name is required with several warehouses ...
brianboti
An exception in delete_s3_files currently stops cleanup of all remaining batches and buckets.
Catch and log failures inside both loops so cleanup can continue. Batch failures include the bucket and object keys in
the error log; bucket setup failures include the bucket name.
backport-master
tanmoysrt
First demo PR. Its signed decision receipt was produced locally with the same pipeline the Action runs (see the README
section A receipt you can verify right now ). The PR stays a draft because this repository ...
scarmani
Changed allgather_bucket_size from 5e8 to 1e8 in zero_optimization settings.
Sourcery 摘要
增强功能：
- 将 DeepSpeed ZeRO 的 all-gather bucket 大小从 5e8 减小至 1e8。
details summary Original summary in ...
nishaecki
datagero
zwanski-start