feat(microsoft-foundry): add Tracing Insights API skill for automated anomaly detection - #2276
Conversation
There was a problem hiding this comment.
Pull request overview
Adds a new Microsoft Foundry trace reference for using the Tracing Insights API to detect agent quality anomalies, and wires it into the trace sub-skill entry points.
Changes:
- Added
tracing-insights-api.mdwith endpoint, auth, request/response schema, KQL follow-up query, and changepoint guidance. - Added a trace entry point for automated insight/anomaly detection.
- Accidentally changed an existing heading anchor in
trace.md.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
plugin/skills/microsoft-foundry/foundry-agent/trace/trace.md |
Adds the Tracing Insights API entry point and modifies the App Insights setup heading. |
plugin/skills/microsoft-foundry/foundry-agent/trace/references/tracing-insights-api.md |
New reference documenting the Tracing Insights API workflow. |
… anomaly detection Add skill files and reference documentation for the Tracing Insights API, enabling Copilot to retrieve automated anomaly-detection insights from Azure AI Foundry agent traces. - trace.md: skill descriptor with triggers, instructions, and examples - tracing-insights-api.md: API reference (endpoint, auth, parameters, response) - Region-agnostic API — any region endpoint works with any project Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
ae1022c to
148e980
Compare
|
Jon Gallant (@jongio) Luffy Chen (@XOEEst) gentle ping on this PR |
|
Luffy Chen (@XOEEst), Xiaofu Huang (@XiaofuHuang), anchenyi, Ankit Sinha (@ankitbko), Jon Gallant (@jongio), and/or Christopher T Earley (@tendau) might you be able to review this PR? I need an approval from one of the code owners to be able to merge. Thank you! |
Jon Gallant (jongio)
left a comment
Jon Gallant (jongio)
left a comment
There was a problem hiding this comment.
Well-scoped docs addition that follows the existing reference structure. One note on region guidance.
Address review feedback: lead with region-agnostic behavior, note same-region is preferred for latency, use eastus2 instead of eastus2euap as the default. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
gentle ping Luffy Chen (@XOEEst), Xiaofu Huang (@XiaofuHuang), anchenyi, Ankit Sinha (@ankitbko), Jon Gallant (@jongio), and/or Christopher T Earley (@tendau) . I need an approval from one of the code owners to be able to merge. I've addressed all comments in current PR. Thank you! |
Jon Gallant (jongio)
left a comment
Jon Gallant (jongio)
left a comment
There was a problem hiding this comment.
Addresses my previous feedback - region guidance now leads with the agnostic behavior and defaults to eastus2. Clean fix.
Summary
Add the Tracing Insights API skill file for automated anomaly detection on agent evaluation scores. This is a subset of PR #2155 -- extracted to unblock merge while FAOS optimization integration is completed separately.
What's included
plugin/skills/microsoft-foundry/foundry-agent/trace/references/tracing-insights-api.mdagents[]grouping andrelatedSpanscontainingoperationIdtrace/trace.md-- added entry point for "auto-detect agent issues" user intentWhat's NOT included (deferred to follow-up PR)
faos-optimization.md) -- FAOS API not yet GAinsights-to-optimize.md) -- depends on FAOSValidated