You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fixed on v8 (21b851b), shipping in the next release.
Expecting value: line 1 column 6 (char 5) is a reply that failed a strict json.loads (typically truncated mid-object, or a model preamble before the JSON). Two changes:
_parse_label_response now salvages the complete "id": "name" pairs from a reply that fails json.loads, raising only when no pairs can be recovered. So a partial reply now yields the names that did arrive instead of failing the whole batch (the missing cids fall back to Community N).
The per-batch token budget was raised (256 + 48*n, was 64 + 24*n) to give models that prepend a short preamble enough headroom to finish the JSON.
Honest caveat: I could not reproduce the exact provider-side truncation without a live key, so this fixes the parsing/budget mechanism rather than a confirmed byte-for-byte repro. If it still recurs, the salvage path now logs the offending batch to stderr. Thanks for the report.
Activity
Fix: salvage truncated labeling replies and account for labeling toke…
safishamsi commentedon Jul 6, 2026
Fixed on
v8(21b851b), shipping in the next release.Expecting value: line 1 column 6 (char 5)is a reply that failed a strictjson.loads(typically truncated mid-object, or a model preamble before the JSON). Two changes:_parse_label_responsenow salvages the complete"id": "name"pairs from a reply that failsjson.loads, raising only when no pairs can be recovered. So a partial reply now yields the names that did arrive instead of failing the whole batch (the missing cids fall back toCommunity N).256 + 48*n, was64 + 24*n) to give models that prepend a short preamble enough headroom to finish the JSON.Honest caveat: I could not reproduce the exact provider-side truncation without a live key, so this fixes the parsing/budget mechanism rather than a confirmed byte-for-byte repro. If it still recurs, the salvage path now logs the offending batch to stderr. Thanks for the report.
Release 0.9.8
Fix: salvage truncated labeling replies and account for labeling toke…
Release 0.9.8