agentleFS
terminalx-aiterminalx-ai/terminalx-skills/skills/computer-use/SKILL.md

computer-use

Skill0 starsChanged 3 months agoMITView on GitHub

Use TerminalX's computer-use CLI to inspect and operate local desktop app windows through accessibility trees, screenshots, and safe UI actions. Use for desktop app interaction: list apps/windows, get app state, read visible UI, click controls, type, press keys, scroll, drag, set values, or perform accessibility actions. Also use for browser windows, webviews, TerminalX app UI, or other desktop UI. Triggers include "computer use", "terminalx computer", "read Spotify", "read Slack", "control/click/read in a desktop app", and "get app state".

68 other projects use a version of this, 11 of them edited.

Adopted by

Most recently taken up by

Used with

Projects with it also use competitor-news-monitor, claude-buddy and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • aivrarSkill

    competitor-news-monitor

    Watch named companies for material news; cited digests.

    Also in 6 projects that use this

  • autonomous-aiSkill

    claude-buddy

    Coordinate with the Claude Buddy companion (Claude Desktop + Claude Code on the user's Mac) — voice-approve tool permission prompts and stay aware of Claude activity.

    Also in 3 projects that use this

  • autonomous-aiSkill

    face-enroll

    Manage the device's face recognition roster — enroll new faces (3 paths: user-supplied photo, agent-captured snapshot on user request, or HAL's familiar-stranger prompt) and maintain the enrolled set (status / remove / reset). All enrolled persons are friends; strangers stay unnamed until promoted via one of the enroll flows.

    Also in 3 projects that use this

  • +9 more from autonomous-ai

The file

We split this skill into the rules it gives an agent

4 rules. 0 are common, 2 are distinctive, and 2 are very specific to this project.

  • 0

    Common

    Most of the 63 edited versions we read keep these.

  • 2

    Distinctive

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    If the TERMINALX_CLI_COMMAND environment variable is set, use its value.

    line 30
  2. Distinctive:

    If the selected executable cannot run, report its exact error and stop.

    line 41
  3. Distinctive:

    Don't guess subcommands or flags from memory or from a cached copy of this stub.

    line 54
  4. Very specific:

    Use this fallback only when the selected binary explicitly reports that skills get is an unknown command.

    line 61

“Common” is measured: kept by at least 6 in 10 of the 63 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Computer Use

This file is a discovery stub, not the usage guide. The full, version-matched computer-use reference is served by the terminalx binary itself — kept out of this file on purpose so it can never drift from the binary that will actually run your commands.

Engage TerminalX's computer-use surface whenever you must inspect or operate a local desktop app window — reading its accessibility tree, taking screenshots, or performing safe UI actions (click controls, type, press keys, scroll, drag, set values). It also covers browser windows, webviews, and TerminalX's own UI. Triggers include "computer use", "terminalx computer", "read Spotify", "read Slack", "control/click/read in a desktop app", and "get app state".

Resolve the CLI for this session

Choose the executable once and reuse it for every later command:

  • If the TERMINALX_CLI_COMMAND environment variable is set, use its value. TerminalX exports this for managed WSL sessions.
  • Otherwise, in a dev checkout whose session exposes TERMINALX_DEV_REPO_ROOT, use terminalx-dev.
  • Otherwise, on Linux outside a TerminalX-managed terminal, use terminalx-ide. That is the executable name the Linux package installs; bare terminalx is not on PATH outside TerminalX's terminals.
  • Otherwise, use terminalx.

Below, TERMINALX is a placeholder for the executable you resolved. Substitute it before running anything; do not create a shell variable or run TERMINALX literally. This works the same way in POSIX shells, PowerShell, and cmd.exe.

If the selected executable cannot run, report its exact error and stop. Do not fall through to another executable, which could silently target a different TerminalX build.

Load the full guide before running TerminalX commands

TERMINALX skills get computer-use

That prints the complete, version-matched guide for the exact binary that will handle your next commands — listing apps/windows, reading UI, and driving clicks, typing, and other accessibility actions. Read it first, then run the specific command you need.

Don't guess subcommands or flags from memory or from a cached copy of this stub. They change between TerminalX releases, and this file deliberately no longer lists them. Confirm the app is up with TERMINALX status --json (start it with TERMINALX open --json if needed), and prefer --json for agent-driven calls.

If an older TerminalX does not recognize skills get

Use this fallback only when the selected binary explicitly reports that skills get is an unknown command. Another failure is not proof of an older binary; report it rather than guessing or changing executables. For a confirmed pre-guide binary, use only this bounded, read-only bootstrap to orient. Do not dead-end and do not invent commands:

TERMINALX status --json
TERMINALX computer capabilities --json
TERMINALX computer list-apps --json

Then tell the user that updating TerminalX restores the full, version-matched guide via TERMINALX skills get computer-use. Beyond these commands, ask the user rather than guessing a command surface this older binary may not support.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.