Skip to content

[FEATURE]: Independent TTFT toggle in TUI settings #53316

Open

Description

@luke9705

Feature hasn’t been suggested before.

  • I have verified this feature I’m about to request hasn’t been suggested before.

Describe the enhancement you want to request

Add a Time to first token (TTFT) toggle in the TUI’s /settings, independent of the existing tokens/second setting. Users should be able to enable either metric, both, or neither.

When enabled, show TTFT in the existing assistant response footer alongside the agent, model, duration, and optionally tokens/second:

Build · GPT-6.1-Sol · 7.6s · TTFT 0.8s · 13.0 tok/s

Measure TTFT from model-request dispatch to the first generated token, including reasoning output—not the start of the visible answer. Display it only when a measurement is available; do not infer it from total response duration.

This would distinguish the wait before generation from generation speed without opening a separate panel.

Related: #49381 requests a web-app Performance tab. This request is specifically for an independently configurable metric in the existing TUI response footer.

Requesting design approval before implementation, per the contribution guidelines.

Activity

  1. github-actions commented on Oct 5, 2026

    @github-actions
    Contributor

    This issue might overlap with existing issues. Please check:

  2. opencodejr commented on Oct 27, 2026

    @opencodejr

    Thanks for the detailed proposal! You're asking for a separate TTFT option in the TUI /settings, independent of the tokens/second option. When it's on, TTFT would appear in the assistant response footer (e.g. Build · GPT-6.1-Sol · 7.6s · TTFT 0.8s · 13.0 tok/s). It would be measured from sending the model request to the first generated token, reasoning included, and shown only when a real measurement exists.

    The maintainers will look at it and decide on the design. Some notes from reading the current code:

    Related issues:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions