platform-setup
Skill10 starsChanged 5 months agoMITView on GitHub
Set up, verify, and troubleshoot Katalon True Platform/TestOps MCP connectivity for any AI coding agent. Use when you need to install or configure the Katalon MCP server, connect to a Katalon platform account, verify available Katalon MCP tools, diagnose missing authentication or repository access, confirm project/repository discovery, or explain what platform operations are and are not exposed through the MCP. One-time cross-cutting setup, run once by whoever wires the agent to the platform, before any lifecycle skill can work.
1 other project uses a version of this.
Adopted by
Most recently taken up by
- strikersam/autonomous-ai-agencytheir own version, first seen Oct 19, 2026
Other versions1 project uses a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 1
- strikersam/autonomous-ai-agency★ 11same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository59 other files it gives its agents.
- AGENTS.mdAGENTS.md
- .github/copilot-instructions.mdCopilot instructions
- .cursor/rules/analyze-failures.mdcCursor rule
- .cursor/rules/create-test-cases.mdcCursor rule
- .cursor/rules/execute-test.mdcCursor rule
- .cursor/rules/exploratory-charter.mdcCursor rule
- .cursor/rules/get-started.mdcCursor rule
- .cursor/rules/platform-setup.mdcCursor rule
- .cursor/rules/playwright-execute.mdcCursor rule
- .cursor/rules/release-analyze.mdcCursor rule
- .cursor/rules/test-case-to-katalon-studio.mdcCursor rule
- .cursor/rules/test-case-to-playwright.mdcCursor rule
- .cursor/rules/test-data.mdcCursor rule
- .cursor/rules/test-estimation.mdcCursor rule
- .cursor/rules/test-maintenance.mdcCursor rule
- .cursor/rules/test-management.mdcCursor rule
- .cursor/rules/test-plan.mdcCursor rule
- .cursor/rules/test-reporting.mdcCursor rule
- .cursor/rules/test-review.mdcCursor rule
- .cursor/rules/true-platform-testing.mdcCursor rule
- .cursor/rules/upload-report.mdcCursor rule
- llms.txtllms.txt
- analyze-failuresSkill
- create-test-casesSkill
- execute-testSkill
- exploratory-charterSkill
- get-startedSkill
- playwright-executeSkill
- release-analyzeSkill
- test-case-to-katalon-studioSkill
- test-case-to-playwrightSkill
- test-dataSkill
- test-estimationSkill
- test-maintenanceSkill
- test-managementSkill
- test-planSkill
- test-reportingSkill
- test-reviewSkill
- true-platform-testingSkill
- upload-reportSkill
- analyze-failuresSkill
- create-test-casesSkill
- execute-testSkill
- exploratory-charterSkill
- get-startedSkill
- platform-setupSkill
- playwright-executeSkill
- release-analyzeSkill
- test-case-to-katalon-studioSkill
- test-case-to-playwrightSkill
- test-dataSkill
- test-estimationSkill
- test-maintenanceSkill
- test-managementSkill
- test-planSkill
- test-reportingSkill
- test-reviewSkill
- true-platform-testingSkill
- upload-reportSkill
The file
Show its rules and text
We split this skill into the rules it gives an agent
42 rules. About 0 are common, 26 are distinctive, and 16 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈26
Distinctive · estimate
This author's own choices. Worth a look.
16
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 8
Use this skill for Katalon MCP installation, connection, and readiness checks.
- Distinctive: line 17
Not directly available through Katalon MCP: create requirements, create a formal Test Plan entity, inspect live AUT pages, or guarantee AI …
- Distinctive: line 18
If no Katalon MCP tools are exposed in the current session, do not claim the platform is connected.
- Very specific: line 20
Read references/capability-boundaries.md when explaining available operations.
- Very specific: line 27
Default to the canonical endpoint https://platform.katalon.io/mcp.
- Very specific: line 28
If the installed config still contains the <your.sub.domain> placeholder, replace it with the canonical endpoint rather than asking the …
- Distinctive: line 29
Only ask for a domain when the user names a dedicated Katalon domain, or when the local config mentions more than one Katalon domain - then …
- Distinctive: line 31
Ask how the user wants to authenticate when auth is required:
- Distinctive: line 35
Never ask for passwords, API tokens, cookies, JWTs, MFA codes, or OAuth callback URLs in chat.
- Very specific: line 36
After authentication succeeds and Katalon tools are available, call list_projects.
- Very specific: line 37
After project selection, call list_repositories with the selected project_id.
- Distinctive: line 41
Start every setup/debugging request with a non-destructive check:
- Distinctive: line 43
Follow "Required Setup Inputs" first when the endpoint, domain, or auth route is not already resolved.
- Distinctive: line 44
Search for Katalon/TestOps MCP tools using the agent's tool discovery mechanism.
- Very specific: line 45
If tools exist, call list_projects.
- Distinctive: line 46
If multiple projects are returned, list them and ask which project to use.
- Very specific: line 47
Call list_repositories with the selected or only project_id after projects are available.
- Distinctive: line 48
If multiple repositories/Test Projects are returned and no repository is clearly implied, list them and ask which repository/Test Project …
- Distinctive: line 50
If a requirement key or repo name is provided, verify access by searching or reading that target.
- Distinctive: line 64
When MCP tools are missing:
- Very specific: line 67
If the config still contains a <your.sub.domain> placeholder, replace it with https://platform.katalon.io/mcp.
- Distinctive: line 68
Prefer a native remote MCP entry.
- Distinctive: line 85
If the install command, package name, or server URL is not present in local context, use official Katalon-provided setup instructions or …
- Distinctive: line 90
If the user explicitly asks to install but the environment does not permit plugin/MCP installation from the current session, give the exact …
- Very specific: line 94
Use this when Katalon MCP tools are missing from the active session or direct remote MCP config returns 401 Invalid JWT token format.
- Distinctive: line 96
Ask only for non-secret information needed to target the right server or verify access, such as:
- Distinctive: line 101
Do not ask the user to paste passwords, API tokens, cookies, JWTs, or OAuth callback URLs into chat.
- Distinctive: line 102
Run the proxy with the Katalon endpoint:
- Very specific: line 108
If this prints an authorization URL or opens the browser, wait for the user/browser callback to complete.
- Distinctive: line 110
Verify through a local MCP client, if Katalon tools are still not exposed through the agent's tool discovery:
- Very specific: line 113
Call list_repositories with the exact schema field project_id.
- Very specific: line 114
If local proxy verification succeeds but the agent's tool discovery still does not expose Katalon tools, report that MCP is authenticated …
- Distinctive: line 145
When tools exist but calls fail:
- Distinctive: line 147
Treat 401/403-style failures as auth or account-scope problems.
- Distinctive: line 148
Ask the user to authenticate through the platform's secure browser flow.
- Distinctive: line 150
If multiple authenticated Katalon domains are available, ask which domain to use before selecting projects.
- Distinctive: line 151
If multiple projects are available, list the project names/IDs and ask which project to use before listing repositories.
- Distinctive: line 152
If multiple repositories/Test Projects are available, list them and ask which repository/Test Project to use unless the user's request …
- Distinctive: line 158
After setup is verified:
- Very specific: line 160
Use create-test-cases for requirement or free-text test design/import.
- Very specific: line 161
Use execute-test for running an existing case or suite.
- Very specific: line 162
Use true-platform-testing for end-to-end flows that include requirement analysis, case creation, suite management, execution, AI polling, …
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Katalon Platform Setup
Use this skill for Katalon MCP installation, connection, and readiness checks. Do not use it for designing or running tests unless the setup check leads directly into create-test-cases, execute-test, or the larger true-platform-testing skill.
This skill is agent-neutral. The Katalon MCP server is the same for every agent (terminal coding agents, Codex, Copilot, Cursor, Kiro, Windsurf, and others); only the config file location and format differ per agent. For the exact per-agent config path and snippet, read the repository README.md install section.
Setup Boundary
Be explicit about what can be verified from the current environment:
- Available through Katalon MCP once connected: project/repository discovery, requirement reads, test case/suite operations, manual runs, AI sessions, automated scheduling, results, metrics, and ALM-linked defects.
- Not directly available through Katalon MCP: create requirements, create a formal Test Plan entity, inspect live AUT pages, or guarantee AI execution completion.
- If no Katalon MCP tools are exposed in the current session, do not claim the platform is connected.
Read references/capability-boundaries.md when explaining available operations.
Required Setup Inputs
For setup requests, collect the minimum routing and authentication choices before writing or testing MCP config:
- Resolve the Katalon MCP endpoint:
- Default to the canonical endpoint
https://platform.katalon.io/mcp. It serves every workspace and presents a picker after sign-in, so do not ask for a subdomain unless something below applies. - If the installed config still contains the
<your.sub.domain>placeholder, replace it with the canonical endpoint rather than asking the user to fill it in. - Only ask for a domain when the user names a dedicated Katalon domain, or when the local config mentions more than one Katalon domain - then list the candidates and ask which one they want.
- Normalize a bare subdomain to
https://<sub>.katalon.io/mcp.
- Default to the canonical endpoint
- Ask how the user wants to authenticate when auth is required:
- Browser OAuth flow with an agent restart/reload after login.
- CLI/local
mcp-remotelogin bootstrap. - Login email/account label only for account selection.
- Never ask for passwords, API tokens, cookies, JWTs, MFA codes, or OAuth callback URLs in chat. If the user offers "login information", accept only non-secret routing details such as login email, organization, domain, project name, or repository/Test Project name.
- After authentication succeeds and Katalon tools are available, call
list_projects. If more than one project is returned, list the projects and ask which project to use before calling repository-specific tools. - After project selection, call
list_repositorieswith the selectedproject_id. If more than one repository/Test Project is returned and none is clearly implied by the user's request, list the repositories and ask which one to use.
Connection Check
Start every setup/debugging request with a non-destructive check:
- Follow "Required Setup Inputs" first when the endpoint, domain, or auth route is not already resolved.
- Search for Katalon/TestOps MCP tools using the agent's tool discovery mechanism.
- If tools exist, call
list_projects. - If multiple projects are returned, list them and ask which project to use.
- Call
list_repositorieswith the selected or onlyproject_idafter projects are available. - If multiple repositories/Test Projects are returned and no repository is clearly implied, list them and ask which repository/Test Project to use.
- Confirm at least one project and repository/Test Project can be discovered.
- If a requirement key or repo name is provided, verify access by searching or reading that target.
If Katalon tools are not exposed in the active agent session, do not stop at "reload required" yet. First try the local proxy bootstrap in "MCP Remote OAuth Bootstrap" below. A successful bootstrap proves the account and endpoint are usable even if the current agent's MCP host has not reloaded the server list.
Report the exact boundary:
- Connected and usable.
- MCP tools exposed but auth/access failed.
- MCP works through local
mcp-remoteproxy, but tools are not exposed in the current agent session. - MCP tools missing from the session and local proxy bootstrap failed or could not be attempted.
- Project exists but repository/Test Project cannot be resolved.
Install Or Configure MCP
When MCP tools are missing:
- Inspect local agent/plugin context for an existing Katalon MCP install path or configuration.
- If the config still contains a
<your.sub.domain>placeholder, replace it withhttps://platform.katalon.io/mcp. Never leave a placeholder in an active user config. Prefer a native remote MCP entry. Agents that speak remote MCP directly (most terminal coding agents, Copilot/VS Code, Copilot CLI, Cursor) need only the endpoint and run the browser OAuth flow themselves:
{ "mcpServers": { "katalon-prod-mcp": { "type": "http", "url": "https://platform.katalon.io/mcp" } } }See the bundled
.mcp.jsonfor the canonical shape.Fall back to the
mcp-remotewrapper only for agents without native remote-MCP support (Kiro, Continue, Codex):npx mcp-remote https://platform.katalon.io/mcp --transport http-firstOn first run
npxasks before installingmcp-remote; answer it yourself rather than pre-approving. The JSON/TOML config form below passes-ybecause a spawned MCP server has no terminal to answer on.- Codex declares the same command/args in TOML under
[mcp_servers.katalon-prod-mcp]. - For the exact file path per agent, read the repository
README.mdinstall section.
- Codex declares the same command/args in TOML under
- If the install command, package name, or server URL is not present in local context, use official Katalon-provided setup instructions or ask the user for the MCP package/source. Do not invent install commands.
- Configure only the minimum required MCP server entry for the user's agent environment.
- Store secrets using the environment's secret mechanism or environment variables. Never write access tokens, passwords, cookies, or raw auth callback URLs into repo files, skill files, logs, or final answers.
- Re-run the connection check. Restart or reload the MCP host only if Katalon works through the local proxy but the current agent session still does not expose the tools.
If the user explicitly asks to install but the environment does not permit plugin/MCP installation from the current session, give the exact missing prerequisite and the safest next step.
MCP Remote OAuth Bootstrap
Use this when Katalon MCP tools are missing from the active session or direct remote MCP config returns 401 Invalid JWT token format.
- Ask only for non-secret information needed to target the right server or verify access, such as:
- Katalon MCP URL, only if the user is on a dedicated domain rather than the canonical
https://platform.katalon.io/mcp. - Project name or project ID.
- Repository/Test Project name, if the user wants a specific target verified.
- Login email, only if it helps the user choose the right account in the browser.
- Katalon MCP URL, only if the user is on a dedicated domain rather than the canonical
- Do not ask the user to paste passwords, API tokens, cookies, JWTs, or OAuth callback URLs into chat. If authentication is needed, trigger the browser-based OAuth flow and have the user complete login in the browser.
Run the proxy with the Katalon endpoint:
npx mcp-remote "https://platform.katalon.io/mcp" --transport http-firstIf this prints an authorization URL or opens the browser, wait for the user/browser callback to complete.
mcp-remotestores OAuth state under its own auth cache, such as~/.mcp-auth, not in the workspace.- Verify through a local MCP client, if Katalon tools are still not exposed through the agent's tool discovery:
listToolsshould includelist_projectsandlist_repositories.- Call
list_projects. - Call
list_repositorieswith the exact schema fieldproject_id.
- If local proxy verification succeeds but the agent's tool discovery still does not expose Katalon tools, report that MCP is authenticated and usable through
mcp-remote, but the active agent host needs a reload/new session/new thread to expose the tools natively.
Known working MCP server entries. Prefer the native form; use the mcp-remote form only where the agent cannot reach a remote server directly (Codex uses the same command/args in TOML):
{
"mcpServers": {
"katalon-prod-mcp": { "type": "http", "url": "https://platform.katalon.io/mcp" }
}
}{
"mcpServers": {
"katalon-prod-mcp": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://platform.katalon.io/mcp", "--transport", "http-first"]
}
}
}Known verification observations:
mcp-remotemay sayInvalid JWT token formatbefore OAuth completes; treat this as an auth challenge, not proof the server is unavailable.- The valid transport strategy is
http-firstorhttp-only;httpcan be rejected bymcp-remote. list_repositoriesexpectsproject_id, notprojectId.
Authentication And Access
When tools exist but calls fail:
- Treat 401/403-style failures as auth or account-scope problems.
- Ask the user to authenticate through the platform's secure browser flow. Never ask them to paste secrets into normal chat when a secure mechanism exists.
- You may ask for non-secret account routing details, such as subdomain, project ID/name, repository name, and login email. The user should enter passwords/SSO/MFA only in the browser or secure credential flow.
- If multiple authenticated Katalon domains are available, ask which domain to use before selecting projects.
- If multiple projects are available, list the project names/IDs and ask which project to use before listing repositories.
- If multiple repositories/Test Projects are available, list them and ask which repository/Test Project to use unless the user's request clearly names one.
- For empty project/repository results, verify account membership, organization, project role, and repository/Test Project access.
- For requirement lookup failures, verify that Jira/Azure sync exists and the requirement key belongs to the connected project.
Handoff
After setup is verified:
- Use
create-test-casesfor requirement or free-text test design/import. - Use
execute-testfor running an existing case or suite. - Use
true-platform-testingfor end-to-end flows that include requirement analysis, case creation, suite management, execution, AI polling, and result reporting.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

