Skip to content

atlas search: query-time parameter surface — every retrieval knob as a CLI flag / raw-query field, no hardcoded constants (extends #5741, #5668) #5774

Open

Description

@dezren39

Extends #5741 (SPLADE investigation + eval harness) and #5668 (query-embed cache + flags). Design commitments from Drew's direction 2026-11-04.

Principle

Anything not baked into how data is stored must be settable per query — from the fleet-binary CLI flags AND from the raw query format (the full-access path), with identical parameter names in both — so values can be benchmarked and better defaults found without editing code.

If a retrieval constant lives in code today, that's a bug against this principle.

Knob inventory (v1, extensible)

Escape hatches as first-class presets

Power users must not need to edit code or config to say "just run my query":

Defaults are data, not code

Provenance

Results carry which signals and which variants produced them (the companion issue's raw-only / rewritten-only / both tags, plus per-signal contribution), so a knob change's effect is diagnosable from the output, not guessed.

Boundary (explicit)

Open questions

  • Preset naming/versioning: how named presets (--raw, future ones) are versioned so a benchmark citing a preset stays reproducible.
  • Per-corpus default vectors: the code corpus and the docs corpus may legitimately ship different defaults — one global vector vs per-corpus vectors.
  • Guard rails: maximum fan-out caps so an absurd per-shard k can't melt the shards — where the caps live (client, daemon, per-shard) and what error a capped request returns.

Related: #5733 (Jaccard signals), #5667 (Scaler/shard design), #5669 (shard implementation).

Activity

  1. developing-today commented on Nov 5, 2026

    @developing-today
    Contributor
  2. dezren39 commented on Nov 5, 2026

    @dezren39
    MemberAuthor

    Companion issue: #5773 — the query-understanding front-end (spell correction + planner/rewriter) whose stage toggles and variant selection this parameter surface exposes.

  3. added
    queue/queuedHas a queued task in the Supabase agent queue
    task/triageQueue packet kind: verify, reproduce, and route this item
    on Nov 5, 2026
  4. dezren39 commented on Nov 5, 2026

    @dezren39
    MemberAuthor

    🤖 Agent note · done

  5. removed
    queue/queuedHas a queued task in the Supabase agent queue
    on Nov 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

task/triageQueue packet kind: verify, reproduce, and route this item

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions