Skip to content

fix: add modify/feature routing to azure-hosted-copilot-sdk - #1679

Merged
Jon Gallant (jongio) merged 1 commit into
microsoft:mainfrom
jongio:fix/azure-hosted-copilot-sdk-modify-routing-1385
Apr 2, 2026
Merged

fix: add modify/feature routing to azure-hosted-copilot-sdk#1679
Jon Gallant (jongio) merged 1 commit into
microsoft:mainfrom
jongio:fix/azure-hosted-copilot-sdk-modify-routing-1385

Conversation

@jongio

Copy link
Copy Markdown
Collaborator

Summary

Fixes #1385azure-hosted-copilot-sdk was not being invoked for modify/add-feature prompts in existing Copilot SDK codebases (0% invocation rate on existing-sdk-modify test).

Root Cause

The skill's description triggers and routing guidance were scoped exclusively to deploy scenarios. A prompt like "Add a new feature to this app that summarizes pull requests" has zero keyword overlap with the existing triggers (copilot SDK, deploy copilot app, etc.), and the codebase detection warning only mentioned "generic deploy prompts."

The LLM router had no signal — from triggers or skill body — to route modify-intent prompts to this skill, even when the codebase contained @github/copilot-sdk markers.

Changes

File Change
azure-hosted-copilot-sdk/SKILL.md Add modify, add feature to description triggers
azure-hosted-copilot-sdk/SKILL.md Broaden codebase detection from "deploy/host prompts" to "ANY prompts involving an existing codebase"
azure-hosted-copilot-sdk/SKILL.md Expand warning to explicitly list deploy, modify, add feature, update, enhance
azure-hosted-copilot-sdk/SKILL.md Add "Modify/add features to existing SDK app" row to Step 1 routing table
azure-hosted-copilot-sdk/SKILL.md Version bump 1.0.3 → 1.0.4
triggers.test.ts.snap Updated snapshot for new extracted keywords (feature, modify)

Testing

  • All unit tests pass (19/19)
  • All trigger tests pass (13/13)
  • Description stays within 60-word limit

Relationship to PR #1644

PR #1644 (merged) fixed the deploy-prompt routing regression (#1599) by restoring the DO NOT USE FOR clause and adding codebase detection. This PR extends that work to also cover modify/feature prompts, which is a separate failure mode identified in #1385.

Add trigger keywords and routing guidance for modify/add-feature
prompts in existing Copilot SDK codebases. Previously, prompts like
'Add a new feature to this app' would not route to this skill even
when the codebase contained @github/copilot-sdk markers.

Changes:
- Description: add 'modify', 'add feature' trigger keywords (v1.0.4)
- Codebase Detection: broaden from deploy-only to ANY prompts
- Warning: explicitly list deploy, modify, add feature, update, enhance
- Step 1 routing table: add 'Modify/add features' row
- Snapshot: updated for new extracted keywords

Fixes microsoft#1385

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings April 2, 2026 20:41

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the azure-hosted-copilot-sdk skill routing signals so it can be selected for “modify/add-feature” intents in existing GitHub Copilot SDK codebases, addressing invocation failures like #1385.

Changes:

  • Expanded the skill frontmatter description triggers to include modify/add-feature intent language.
  • Broadened the skill’s codebase-detection guidance/warnings to cover non-deploy prompts for existing repos.
  • Bumped skill version and updated trigger keyword snapshots.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
plugin/skills/azure-hosted-copilot-sdk/SKILL.md Adds modify/add-feature routing language and broadens codebase-detection guidance; bumps version.
tests/azure-hosted-copilot-sdk/__snapshots__/triggers.test.ts.snap Updates snapshots to reflect newly extracted keywords from the skill description.

Comment thread plugin/skills/azure-hosted-copilot-sdk/SKILL.md
Comment thread plugin/skills/azure-hosted-copilot-sdk/SKILL.md
@jongio
Jon Gallant (jongio) merged commit e667a68 into microsoft:main Apr 2, 2026
16 checks passed
@jongio
Jon Gallant (jongio) deleted the fix/azure-hosted-copilot-sdk-modify-routing-1385 branch April 2, 2026 23:34
Barbara 4bes (Ba4bes) pushed a commit to Ba4bes/GitHub-Copilot-for-Azure that referenced this pull request Apr 24, 2026
…t#1679)

Add trigger keywords and routing guidance for modify/add-feature
prompts in existing Copilot SDK codebases. Previously, prompts like
'Add a new feature to this app' would not route to this skill even
when the codebase contained @github/copilot-sdk markers.

Changes:
- Description: add 'modify', 'add feature' trigger keywords (v1.0.4)
- Codebase Detection: broaden from deploy-only to ANY prompts
- Warning: explicitly list deploy, modify, add feature, update, enhance
- Step 1 routing table: add 'Modify/add features' row
- Snapshot: updated for new extracted keywords

Fixes microsoft#1385

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integration test failure: azure-hosted-copilot-sdk – existing SDK app modify prompt [Skill not invoked]

3 participants