Skip to content

MANUAL RUN: turn on search across repos (CODESPLITTERS_VECTORS=1) and backfill #704

Closed as not planned

Description

@QuinnsCode

The vector index across repos (#636) ships off. Turning it on takes the owner's deploy:

  1. Add CODESPLITTERS_VECTORS=1 to the release script, beside CODESPLITTERS_DEPLOYS=1 CODESPLITTERS_AGENTS=1.
  2. plan should show new: Vectorize index codesplitters-vectors (384 dims, cosine), its two metadata indexes (repo, pub), and the Worker's VECTORS and AI bindings. Migration 0052 adds repo_search.stale.
  3. Deploy. If wrangler's login lacks ai:write, log in again (rustybuns asks for it now).
  4. Backfill: POST /api/admin/scale/search-embed as an admin until left is 0, or let the hourly cron do 200 files an hour.
  5. Check: a search across repos with no repo= finds a repo past the 50 most recently committed; the scale sideboard's search card reads "Yes".

Cost: the backfill is the spend, about one embedding per 40 lines of every committed file. Workers AI's free 10k neurons a day cover ~5M tokens; Vectorize on Workers Paid includes 10M stored dimensions (~26k chunks).

Activity

  1. added
    manual runNeeds the owner to run it by hand (tokens, sign-ins); agents can't close it
    on Oct 11, 2026
  2. QuinnsCode commented on Oct 11, 2026

    @QuinnsCode
    OwnerAuthor

    Tracked in #609, the one hands-on checklist. The steps here still apply; tick them there.

    🤖 Generated with Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    manual runNeeds the owner to run it by hand (tokens, sign-ins); agents can't close it

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions