Skip to content

Automated Benchmarking #176

Closed
Closed

Description

@maxsmythe

In anticipation of regular benchmarking runs we should design a system for automated Benchmarking.

This includes:

  • A process to orchestrate the benchmark (provision necessary cluster resources, generate load, manage results gathering, persist results)
  • A format in which results will be persisted (should be flexible enough to accommodate adding/removing metrics as product understanding grows)

This system should run as a simple shell command and output the metrics results to files in order to streamline integration with most CI/CD systems.

ClusterLoader2 is a good example of the general idea of the I/O and execution model, though CL2 has a much broader scope than this proposal intends.

Activity

  1. maxsmythe commented on Oct 7, 2026

    @maxsmythe
    CollaboratorAuthor

    This has been implemented with orchestrator and runner

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

area/dev-infrakind/featureAn enhancement / feature request or implementationprio/P0Highest priority / required for next milestone

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions