Skip to content

Observability: cost-per-span tracking #31

Open

Description

@prometheusgr

Split from #4 (LLM Observability Service). Depends on the base Phoenix tracing slice landing first.

The issue's tracing bullet asks for "latency, token counts, and cost per span." Token counts and latency are captured by the base OpenInference/OTel instrumentation for free. Cost is not: this stack's default inference path is a self-hosted llama-server with no per-token price, so "cost" has no meaning until there's an explicit cost model to attach (e.g. an admin-configured $/1K-tokens figure per provider, relevant mainly if/when an openai-compatible paid provider is configured instead of local llama.cpp).

Needs a design decision on where that cost model lives (likely alongside the existing system_settings provider config) before implementation. Deferred out of the base tracing slice rather than adding a meaningless always-zero "cost" column.

Activity

  1. added
    enhancementNew feature or request
    type:featureBrand-new capability that doesn't exist today
    priority:P3Deferred/speculative — explicitly not scheduled yet
    effort:MMedium: one layer (backend or frontend), a few days
    area:observabilityTracing, evaluation, cost, Phoenix-related
    and removed
    enhancementNew feature or request
    on Aug 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:observabilityTracing, evaluation, cost, Phoenix-relatedeffort:MMedium: one layer (backend or frontend), a few dayspriority:P3Deferred/speculative — explicitly not scheduled yettype:featureBrand-new capability that doesn't exist today

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions