Skip to content

Stabilize azure-validate deployment-validation tests by terminating on validate invocation - #2171

Draft
Sai Koumudi Kaluvakolanu (saikoumudi) with Copilot wants to merge 2 commits into
mainfrom
copilot/fix-static-whiteboard-test-validation
Draft

Stabilize azure-validate deployment-validation tests by terminating on validate invocation#2171
Sai Koumudi Kaluvakolanu (saikoumudi) with Copilot wants to merge 2 commits into
mainfrom
copilot/fix-static-whiteboard-test-validation

Conversation

Copilot AI commented May 6, 2026

Copy link
Copy Markdown
Contributor

Integration tests for azure-validate were intermittently failing because deployment-validation scenarios could continue past the validation handoff and reach deployment commands. The expected behavior is to stop once validation begins (or azure-validate is invoked), before any deploy path executes.

  • What changed

    • Updated tests/azure-validate/integration.test.ts in the deployment-validation suite to early-terminate not only on validation/deployment commands, but also when the azure-validate skill itself is invoked.
    • Applied this consistently across:
      • static whiteboard web app
      • static portfolio website
      • containerized web app on Container Apps
  • Why this addresses the issue

    • The tests now stop at the intended orchestration boundary (azure-prepareazure-validate) instead of relying solely on command-level detection, which reduces non-deterministic drift into deployment behavior.
  • Representative change

    shouldEarlyTerminate: (metadata) =>
      hasValidationCommand(metadata) ||
      isSkillInvoked(metadata, SKILL_NAME) ||
      hasDeploymentCommand(metadata) ||
      isSkillInvoked(metadata, "azure-deploy")

Copilot AI changed the title [WIP] Fix integration test failure for static whiteboard web app Stabilize azure-validate deployment-validation tests by terminating on validate invocation May 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integration test failure: azure-validate – static whiteboard web app [Skill not invoked]

2 participants