design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter

Parent: #6026 (content versioning + retention). Research source: prior-art doc ~/workspace/scratch/atlas-ingestion-brief-2026-11-04/prior-art-research.md (2026-11-04). Follow-up 11 (Cluster 2).

Finding (research, in substance)

Versioned-data systems converge on: keep everything until a policy-driven vacuum. Delta Lake VACUUM (default deleted-file retention 7 days), Iceberg expire_snapshots (older_than + retain_last_n), restic's GFS thinning (--keep-daily/weekly/monthly) — the brief's three triggers (age / supersede-count / access) each have a production precedent. Atlas has a better access signal than any of them: its own query traces record exactly which versions ever surface. Dead end to avoid: vacuum without a dry-run reporter — every system above deletes silently once policy fires; for a personal corpus, retention must report first ("these 412 versions would cold-tier, these 38 would delete") until the policy has earned trust.

Scope

Rule engine over the lineage graph: per-class composite rules (age AND/OR supersede-count AND/OR last-surfaced-in-top-K), evaluated against query-trace stats (sibling design design(atlas): retrieval statistics, result feedback, and query traces — top-K survival, thumbs + essays, per-stage scores #6027).
Dry-run reporter as the only mode until Drew promotes a rule to live; cold-tier moves precede deletions by at least one full retention cycle.
Interaction with design(atlas): content versioning + retention — versions, rename lineage, newest-resolution, cold rollout, deletion triggers #6026's governing tension: atlas: provenance registry (chunk occurrences), content-addressed extracts, multi-DB vector resolution #3125's keep-ALL rule vs the 2026-11-04 deletion triggers — the engine encodes which rule governs which tier/class.

Done looks like

An engine design: rule schema, evaluation cadence, dry-run report format, promotion path from dry-run to live.

CODE-1706

🤖 Agent note · handed off

Agent: queue worker (repo-worker-code), lane code-u
Session / ID: task 10407
Found via: queue claim
Task: Work issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 per task 10407 — handed off to the opencode execution lane; the laptop claimant launches the bound opencode session for task 10407. Verified fresh: issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 is OPEN with no hard-stop labels (no held, user/owned, do-not-merge, do-not-auto-edit).
Expectation: triage/work at current main with evidence by the bound opencode session.
Links: task 10407 (repo-health-code-pilot), assigned_lane=opencode

🤖 Agent note · state: handed off

Agent: queue worker (repo-worker-code), lane code-m
Session / ID: task 10407
Found via: queue claim (task 10407 returned to the queue after a prior handoff)
Task: Triage of issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 (design(atlas): retention rule engine) is assigned to the opencode execution lane — handed off again to the opencode claimant, which launches a bound session to drive task 10407 to its terminal state.
Expectation: claimant launches the bound opencode session during the park window; if unbound at lease expiry, task 10407 returns to the queue.
Links: issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041

🤖 Agent note · handed off

Agent: fleet monitor (repo-fleet-monitor)
Session / ID: task 10569 · repo-fleet-monitor run 2026-11-05 20:12 CST
Found via: monitor reconciliation
Task: Claim evaporated — the previous holder's claim on task 10569 ended without a terminal verb and the task is queued unclaimed (attempts 4/8, last checkpoint stage: handed_off). Labels reset to the truth: queue/queued + status/needs-triage. The fleet monitor's dead-in-queue pass this run also raised the attempt cap where it had been reached.
Expectation: the next queue claimant picks up task 10569 from the handed_off checkpoint; no work was lost.

🤖 Agent note · handed off

Agent: queue worker (repo-worker-code), lane code-v
Session / ID: task 10569
Found via: queue claim
Task: task 10569 (small_fix) for issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 is assigned to the opencode execution lane; handing off to the opencode claimant, which launches a bound session to drive it to a terminal state. Verified fresh this shift: issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 is OPEN with no held / user/owned / do-not-merge / do-not-auto-edit labels.
Expectation: claimant launches the bound opencode session; task 10569 parked 1200s awaiting that launch (attempts 6/8).
Links: design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041

🤖 Agent note · handed off

Agent: queue worker (repo-worker-code), lane code-r
Session / ID: task 10569
Found via: queue claim
Task: Handing task 10569 for issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 to the opencode claimant (execution lane assigned opencode); the bound opencode session will work issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041 to its terminal state.
Expectation: claimant launches a bound session; task 10569 parked 1800s awaiting launch.
Links: issue design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041

Navigation Menu

Repository navigation

design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041

Finding (research, in substance)

Scope

Done looks like

69 remaining items

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

design(atlas): retention rule engine — composite age / supersede-count / last-surfaced policy with dry-run reporter #6041

Description

Finding (research, in substance)

Scope

Done looks like

Activity

developing-today commented on Nov 5, 2026

dezren39 commented on Nov 5, 2026

developing-today commented on Nov 5, 2026

69 remaining items

dezren39 commented on Nov 6, 2026

dezren39 commented on Nov 6, 2026

dezren39 commented on Nov 6, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions