Skip to content

Display underlying LLM model used by custom agents in UI #2646

@akoken

Description

@akoken

Describe the feature or problem you'd like to solve

Currently, when utilizing a multi-agent architecture with custom agents (e.g., orchestrator, planner, coder, security-reviewer), there is a lack of transparency regarding which specific LLM model each agent is using during execution. When observing the terminal/UI output, I can see the agent's name and the actions it is taking (e.g., One-piece:coder Verify call CTA), but there is no indication of the underlying model powering that specific agent.

Furthermore, I have checked the following areas to verify my configuration, but the model information is completely missing:

  1. Session Logs: The logs do not contain any metadata indicating which model was used for specific agent prompts/responses.
  2. The /tasks command: Running this command yields no relevant information regarding agent-to-model mapping.

Proposed solution

I would like to see the assigned model surfaced in a few key areas for debugging, cost-tracking, and transparency:

  1. In the Execution UI/Terminal: Append or display the model name next to the agent name.
    (Example: One-piece:coder [claude-3.5-sonnet] Verify call CTA)
  2. In the Session Logs: Include the model name in the payload/metadata of the logged interactions.
  3. In the /tasks command (or a new command like /agents): Provide a summary table showing active agents and their currently configured models.

Example prompts or workflows

No response

Additional context

Here is a screenshot of the current UI. As you can see, One-piece:coder, security-reviewer, and code-reviewer are working, but it is impossible to tell which models they are utilizing for these tasks.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:agentsSub-agents, fleet, autopilot, plan mode, background agents, and custom agentsarea:terminal-renderingDisplay and rendering: flickering, scrolling, line wrapping, output formatting
    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions