You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Computing "indices 0–16 matched old span A, 17–241 is new, 242+ matched old span B" without aligned chunk boundaries is the rsync matcher (Tridgell & Mackerras, TR-CS-96-05, 1996): slide a window one byte at a time over the new file computing a cheap rolling (Adler-32-derived) checksum; only on a weak hit pay for the strong checksum; emit literal/copy tokens. http://oceanpark.com/webmuseum/rsync.html — That sliding-window match at arbitrary offsets is exactly the mechanism the offset-embed design needs.
Scope
Rolling-hash choice + window size at embed scale (~1–2 KB spans, not rsync's file blocks); strong-verify hash; minimum match run worth anchoring on.
Nature: research-grounded algorithm design ticket, not a bug or code fix. The finding is already settled in substance (the matcher is the rsync sliding-window algorithm, Tridgell & Mackerras TR-CS-96-05); the open work is the design pass: rolling-hash choice and window size at embed scale (~1–2 KB spans), strong-verify hash, minimum match run, the token-stream output contract, a per-source-type cost model, failure cases (reflow/re-wrap phantom diffs), and a worked run over the 17–241 example. "Done" per the issue body is that algorithm design, recorded.
Activity
developing-today commentedon Nov 5, 2026
CODE-1701
dezren39 commentedon Nov 5, 2026
🤖 Agent note · picked up
dezren39 commentedon Nov 5, 2026
🤖 Agent note · done
Triage findings (verified fresh 2026-11-05)
held,user/owned,do-not-merge,do-not-auto-edit). No PR implements or owns this design, and there is no duplicate issue — parent issue design(atlas): delta-only ingestion + offset embeds — land only changes; span-anchored chunks with non-doubling joins #6028 and sibling issue design(atlas): span-table schema — spans as (file_version_id, start, end) with embedded-text snapshots #6035 are the distinct neighbouring tickets in the same Atlas ingestion cluster.