ado-test-plans
Skill5 starsChanged 5 months agoMITView on GitHub
Use when the user asks about Azure DevOps test plans, test suites, test cases, or test execution results. "show test results for the last build", "create a test plan for Sprint 12 regression", "add a test case for the login flow", "what is the pass rate for pipeline release-2.0", "create a test suite for authentication scenarios", "list all test plans in the Platform project", "write a test case for the MFA feature", "show failed test cases from build #512", "how many tests are in the smoke suite"
In this repository10 other files it gives its agents.
- ado-contextSkill
- ado-pipelinesSkill
- ado-pm-reportingSkill
- ado-project-discoverySkill
- ado-pull-requestsSkill
- ado-repositoriesSkill
- ado-searchSkill
- ado-sprints-capacitySkill
- ado-wikiSkill
- ado-work-itemsSkill
The file
We split this skill into the rules it gives an agent
8 rules. About 0 are common, 1 is distinctive, and 7 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈1
Distinctive · estimate
This author's own choices. Worth a look.
7
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 43
If only pipeline name is known, use ado-pipelines skill to get the build ID first.
- Very specific: line 44
Call testplan_show_test_results_from_build_id(buildId) — returns pass/fail/skipped counts per test suite, and the list of failed test cases …
- Very specific: line 51
Call testplan(project) — returns all test plans with ID, name, state, iteration, and suite count.
- Very specific: line 107
Test results are associated with a build via the build definition ID and build number.
- Very specific: line 108
If the user gives a pipeline name instead of a build ID, resolve it via ado-pipelines skill first.
- Distinctive: line 110
When creating test steps, each step has an Action (what the tester does) and an
- Very specific: line 118
If activeProject is set, use it automatically as the project parameter — do not ask the user to re-specify it.
- Very specific: line 120
If no context is set and a project is required, invoke Workflow E of ado-context to resolve it (list projects, ask user to pick, then …
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
ADO Test Plans
Manage Azure DevOps test plans, test suites, and test cases. Read test execution results from pipeline builds and create structured test artefacts.
When to use
- User wants to see test results for a build or pipeline run
- User wants to create a new test plan or test suite
- User wants to create or update test cases
- User wants to know the pass/fail rate for a release or sprint
- User is preparing a release sign-off and needs test coverage evidence
MCP tools used
| Tool | Purpose |
testplan | List test plans and test suites in a project |
testplan_show_test_results_from_build_id | Get test execution results for a build |
testplan_test_plan_write | Create or update a test plan |
testplan_test_suite_write | Create or update a test suite within a plan |
testplan_test_case_write | Create or update a test case |
Workflow
Getting test results for a build
- Identify: build ID (if known) or pipeline name + branch.
- If only pipeline name is known, use
ado-pipelinesskill to get the build ID first. - Call
testplan_show_test_results_from_build_id(buildId)— returns pass/fail/skipped counts per test suite, and the list of failed test cases with error messages. - Present the Test Results Summary table.
- List failing tests in the Failing Tests table.
Listing test plans
- Call
testplan(project)— returns all test plans with ID, name, state, iteration, and suite count. - Present the Test Plan List table.
Creating a test plan
- Extract: project, plan name, and iteration path.
- Call
testplan_test_plan_write(project, name, iteration). - Confirm with the new plan ID.
Creating a test suite
- Identify the parent test plan ID.
- Extract: suite name, suite type (static, requirement-based, query-based).
- Call
testplan_test_suite_write(planId, suiteName, suiteType). - Confirm with the new suite ID.
Creating a test case
- Identify the test suite or plan to add the test case to.
- Extract: test case title, steps (action + expected result pairs), and any associated work item ID.
- Call
testplan_test_case_write(suiteId, title, steps). - Confirm with the new test case ID.
Output Format
Test Results Summary
Build #512 — release-2.0 pipeline
| Suite | Total | Passed | Failed | Skipped | Pass rate |
| API Integration | 145 | 142 | 3 | 0 | 97.9% |
| Unit Tests | 312 | 312 | 0 | 0 | 100% |
| E2E Smoke | 18 | 16 | 0 | 2 | 88.9% |
| Total | 475 | 470 | 3 | 2 | 98.9% |
Failing Tests
| Test Case | Suite | Error |
| TokenExpiry_ShouldReturn401 | API Integration | UnauthorizedAccessException: Token expired |
| Login_WithExpiredMFA | API Integration | Assert.Equal failed: expected 401 got 200 |
| OrderService_NullRef | API Integration | NullReferenceException at OrderService.cs:87 |
Test Plan List
| ID | Plan | Iteration | State | Suites |
| 5 | Sprint 12 Regression | Sprint 12 | Active | 4 |
| 3 | Release 2.0 Sign-off | Release 2.0 | Active | 7 |
| 1 | Sprint 11 Regression | Sprint 11 | Inactive | 3 |
Notes
- Test results are associated with a build via the build definition ID and build number.
If the user gives a pipeline name instead of a build ID, resolve it via
ado-pipelinesskill first. - When creating test steps, each step has an Action (what the tester does) and an Expected Result (what should happen). Prompt the user for both if not provided.
testplan_test_case_writecreates a work item of type Test Case in addition to adding it to the suite — both happen in one call.
Active context
This skill respects the session context set by the ado-context skill.
- If
activeProjectis set, use it automatically as theprojectparameter — do not ask the user to re-specify it. - If no context is set and a project is required, invoke Workflow E of
ado-contextto resolve it (list projects, ask user to pick, then proceed).
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

