Skip to content

Test: Agentic browser tools in Agent Host sessions within Agents App #313802

Description

Refs: Feature #313798, PR #313605

Complexity: 5

Authors: Joaquín Ruales (@jruales), Kyle Cutler (@kycutler)

Create Issue


Setup:

  • Open Agents app
  • Configure the following settings:
    "workbench.browser.agentHostChatToolsEnabled": true,
    "workbench.browser.enableChatTools": true,
    "chat.agentHost.enabled": true,
    
  • In Agents app, click on the option to select a workspace or folder, then click on Select Folders... Local Agent Host
    • Image
  • Select any folder or workspace. Ideally a front-end or full-stack project that would benefit from validating changes in a web browser.
  • Verify that it says "[Local]" next to the name of the folder. This will validate that you're in a Local Agent Host session.
    • Image
  • Select the type of session. It doesn't matter if you use a Folder or Worktree type of session
    • image
  • Send prompts that use the browser.
  • Ensure that the integrated browser appears and is being used by the agent.

Scenarios to try

Some examples of things you can try:

  • Try a few of the variety of the available tools. These have already been verified in the past in VS Code, but this verification is for how they might work specifically in Agent Host sessions within Agents App.
    • Image
  • Try broad instructions that would require using multiple tools. For example, ask it to open a website and do some action that would require the agent to click, type, take screenshots, navigate, etc.
  • Try scenarios that would require the agent to make changes and then validate them using the browser, find any issues, and fix them. For example, this scenario: https://code.visualstudio.com/docs/copilot/guides/browser-agent-testing-guide#_step-2-ask-the-agent-to-build-a-calculator
  • See what's the behavior when multiple of these sessions run at the same time with independent browsers

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    browser-integrationWeb browsing features integrated into VS Code (e.g. integrated browser)testplan-item

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions