Skip to content

id(ci): F11.8 slice 3 — non-blocking CI benchmark regression reporting >20% (of #539) #1513

Closed

Description

@dezren39

Slice 3 of the F11.8 decomposition on #539 (triage queue task 1262). Slice 1 (benchmark harness + four benchmarks) landed in PR #1387 (merge debc655, queue task 1308).

Dependency: slice 2 (committed baselines) must be merged before this slice can be implemented — it is the comparison target. If claimed before slice 2 lands, park naming the dependency.

Scope

  • CI wiring that runs the four slice-1 benchmarks on PRs (or a scheduled workflow) and compares results against the committed slice-2 baselines.
  • A non-blocking report (PR comment, job summary, or artifact) naming any benchmark regressing >20%. The check must not fail the build on regression alone.

Out of scope

  • Blocking CI gates on benchmark regressions
  • The baselines themselves (slice 2)
  • New benchmarks beyond the four from slice 1

Acceptance criteria

  • Dependency gate verified at claim time: slice-2 committed baselines are merged; otherwise park naming the dependency.
  • A run with an artificially slowed benchmark produces a report naming it and its regression percentage.
  • A normal run produces a report with no regressions and all required PR checks stay green (non-blocking).

Filed by queue worker (repo-worker-code) as the slice-3 follow-up required at slice-1 (task 1308) completion; the queue's deterministic dedupe gives one fix task per issue, so slices track as their own issues under #539.

Activity

  1. added
    kind/performancePerformance problem or optimization
    task/small-fixQueue packet kind: bounded fix with reproduction and targeted tests
    priority/highImportant and time-sensitive
    area/ciCI/CD pipelines, workflows, and build automation (area)
    on Oct 27, 2026
  2. developing-today commented on Oct 27, 2026

    @developing-today
    Contributor
  3. added
    app/idPackage/app: id (pkgs/ or apps/ in this repo)
    effort/lLarge: multi-day or open-ended; expect staged check-ins
    queue/queuedHas a queued task in the Supabase agent queue
    on Oct 27, 2026
  4. added
    queue/claimedQueue worker lifecycle state
    work/assignedQueue worker lifecycle state
    and removed
    queue/queuedHas a queued task in the Supabase agent queue
    on Oct 28, 2026
  5. dezren39 commented on Oct 28, 2026

    @dezren39
    MemberAuthor

    🤖 Agent note · picked up

  6. dezren39 commented on Oct 28, 2026

    @dezren39
    MemberAuthor

    🤖 Agent note · parked

  7. 75 remaining items

  8. added
    queue/parkedQueue task is parked (waiting on CI, time, or an event)
    status/parkedDeliberately paused with a recorded resume condition
    on Oct 28, 2026
  9. dezren39 commented on Oct 28, 2026

    @dezren39
    MemberAuthor

    agent-note:v1 — parked

  10. added
    queue/claimedQueue worker lifecycle state
    and removed
    status/parkedDeliberately paused with a recorded resume condition
    queue/parkedQueue task is parked (waiting on CI, time, or an event)
    on Oct 28, 2026
  11. dezren39 commented on Oct 28, 2026

    @dezren39
    MemberAuthor

    🤖 Agent note · picked up

  12. dezren39 commented on Oct 28, 2026

    @dezren39
    MemberAuthor

    🤖 Agent note · done

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

app/idPackage/app: id (pkgs/ or apps/ in this repo)area/ciCI/CD pipelines, workflows, and build automation (area)effort/lLarge: multi-day or open-ended; expect staged check-inskind/performancePerformance problem or optimizationpriority/highImportant and time-sensitivestatus:donetask/small-fixQueue packet kind: bounded fix with reproduction and targeted tests

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions