agentleFS
patkuschpatkusch/remit/skills/ai-system-intake/SKILL.md

ai-system-intake

Skill0 starsChanged 2 months agoMITView on GitHub

Create or update the governance record for an AI system or agent — the shared artefact every other Remit assessment reads from. Use this whenever someone describes an AI system, model, agent, copilot, chatbot, or automation and there is any governance, risk, compliance, audit, or regulatory dimension to the conversation; whenever a new AI use case is proposed, onboarded, inventoried, or registered; whenever someone asks "do we need to assess this?", "is this in scope for the AI Act?", or "what AI do we have?"; and always as the first step before any EU AI Act, NIST AI RMF, ISO 42001, DORA, or autonomy assessment, because those skills need a system record to work from. Use it even when the user has not asked for an inventory — if they are describing an AI system that will touch real users or real decisions, the record is what makes everything downstream possible.

1 other project uses a version of this.

Adopted by

Most recently taken up by

  • Other versions1 project uses a version of this.

    Word for word · 1

    1. PKusch/remit★ 0100% same

    Edited · 0

    None found.

    Wrote their own version · 0

    None found.

    How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.

  • In this repository8 other files it gives its agents.

The file

We split this skill into the rules it gives an agent

5 rules. About 0 are common, 4 are distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈4

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Default to YAML for human editing unless the user is wiring this into tooling.

    line 19
  2. Distinctive:

    Ask directly: what would be a wrong use of this?

    line 55
  3. Distinctive:

    Not a team, not a function.

    line 79
  4. Very specific:

    If decision_consequence is determines-outcome, or the system touches employment, credit, education, essential services, biometrics, or law …

    line 117
  5. Distinctive:

    Do not editorialise about compliance posture at this stage.

    line 122

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

AI system intake

The record you produce here is the spine of every other assessment. Framework skills read it; incident triage annotates it; the evidence pack assembles from it. When each assessment keeps its own private notion of what the system is, they drift, contradict each other, and an auditor finds the contradiction before you do.

Your job is to produce a record that is accurate about what is actually deployed, not one that describes the design intention. That distinction is most of the value.

What to produce

A YAML or JSON file conforming to framework/system-record.schema.json. Default to YAML for human editing unless the user is wiring this into tooling.

Name it <system-id>.record.yaml. Ask where it should live if there is an existing inventory; otherwise propose records/.

How to run the intake

Work conversationally. This is an interview, not a form — the useful answers usually arrive as follow-ups to something the person said in passing.

1. Establish what it actually does

Get the intended use in language a non-specialist could check. If the answer is abstract ("improves customer experience"), keep asking until you have something falsifiable ("ranks incoming support tickets by predicted urgency, and auto-closes ones scored below 0.2").

Then ask the question that drives most downstream classification: what happens to a person as a result of this system? Map to purpose.decision_consequence:

  • none — no person is affected
  • informational — a person sees output but nothing follows from it automatically
  • influences-human-decision — a human decides, with this as an input
  • determines-outcome — the system's output effectively is the decision

People consistently understate this. "It just makes a recommendation" often turns out to mean the recommendation is followed 98% of the time with no independent review, which is determines-outcome in substance. Probe with: how often is the output overridden, and by whom, and what would that person have to do to override it? A human who cannot realistically dissent is not an oversight control — record what happens, not what the process document says.

2. Fill out_of_scope_uses properly

This field earns its place. Most misuse findings are cases where nobody wrote down what the system was not for, so a reasonable person extended it somewhere unreasonable. Ask directly: what would be a wrong use of this? What would make you uncomfortable if you found out someone was doing it?

3. Determine whether it is agentic

The test is not whether it is fashionable to call it an agent. Ask: does it take actions with effects outside its own output? If it calls tools, writes to systems, sends messages, or triggers workflows, populate the agentic block and hand off to agent-autonomy-review for tiering.

Enumerate tools exhaustively, including ones "rarely used" — blast radius follows from what is held, not from what is typical. For each tool, ask for a justification. A tool nobody can justify is the finding.

4. Establish the supply chain role

Under the EU AI Act, obligations attach to roles, and most organisations are deployers rather than providers. But note Art. 25: putting your name on a system, or substantially modifying it, can convert you into a provider with the far heavier obligation set. If the organisation is fine-tuning, rebranding, or materially changing intended purpose, flag this explicitly — it is one of the most common and most expensive misclassifications.

5. Name a single accountable person

Not a team, not a function. If nobody can be named, that is the first finding, and it is usually the one that predicts every other gap.

Handling uncertainty

Record unknown rather than guessing. A record with honest gaps is auditable; a record with confident fiction is worse than nothing because it stops anyone looking.

The schema accepts the literal string unknown in place of a date or boolean wherever intake realistically cannot establish the answer — review dates, whether a halt mechanism exists and when it was last tested, memory persistence and provenance, whether personal data is involved, tool reversibility and approval, and the DORA critical-function determination. For halt_mechanism.last_tested it also accepts never, and the distinction is worth preserving: never is a finding, unknown is a question.

Validate before you hand the record over:

python scripts/validate_record.py records/your-system.record.yaml

That checks conformance and also reports governance warnings the schema cannot express — an observed tier exceeding the declared one, a blast radius lower than the tools held, an untested halt at an oversight level that requires one, persistent memory without provenance, and expired exceptions.

Where an answer materially changes downstream classification and is unavailable, note it in notes and flag it in your summary as a blocking question. Do not stall the whole intake on one open point — complete everything else and surface what is missing.

What to tell the user afterwards

Give them, briefly:

  1. The record location.
  2. The two or three fields most likely to change a downstream conclusion if wrong — usually decision_consequence, supply_chain.role, and the tool inventory.
  3. Which assessments this record now unlocks, and which are advisable given what it says. If decision_consequence is determines-outcome, or the system touches employment, credit, education, essential services, biometrics, or law enforcement, say plainly that EU AI Act triage should happen next.
  4. Anything recorded as unknown that someone needs to go and find out.

Do not editorialise about compliance posture at this stage. Intake establishes facts; the framework skills reach conclusions.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.