agentleFS
maxwellsdm1867maxwellsdm1867/wheeler/.claude/skills/wheeler-service-creator/SKILL.md

wheeler-service-creator

Skill12 starsChanged 3 months agoMITView on GitHub

Scaffold a NEW Wheeler service adapter that integrates an external tool into Wheeler end to end. Reach for this whenever the user wants to "create a wheeler service", "add a new tool adapter", "scaffold an integration", "wrap a service for wheeler", "onboard <some CLI/API/agent> into the graph", "ingest a new tool's output", or otherwise connect an external research tool (a search API, a generator, an analyzer, an agent card) to Wheeler so its results land in the knowledge graph with provenance, even if they do not say the word "adapter". Given the tool (interview the scientist, or read its `--help` / agent card), it produces four pieces: (a) the declarative registry contract the router reads (`.wheeler/services.yaml` or the bundled default), (b) a marshal-out ingest module wired to the shared `_marshal.py` helpers with BOTH provenance sides (`Execution -[USED]-> inputs`, produced nodes `-[WAS_GENERATED_BY]-> Execution`), (c) the marshal-in act `/wh:<provider>-<tool>` that reads graph context, passes `--used` source ids, and shells out, and (d) a parse-unit + live-Neo4j e2e test stub. A bundled scaffolder emits the skeleton files; the human then captures one real output, fills the parser against it, and runs the adversarial review to land it. Do NOT trigger for RUNNING an existing adapter (that is the `/wh:asta-*` acts), for graph lookups or queries, or for generic coding unrelated to wiring up a new external service.

The file

Show its rules and text

We split this skill into the rules it gives an agent

24 rules. About 0 are common, 6 are distinctive, and 18 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈6

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 18

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Structural output (WAS_GENERATED_BY): every node the parser PRODUCED this run (Findings, Hypotheses, the raw artifact node) is generated …

    line 118
  2. Very specific:

    Do NOT fire for running an existing adapter (that is the /wh:<provider>-<tool> act itself), for graph queries, or for generic coding.

    line 151
  3. Very specific:

    Add --dry-run first to preview the paths it will touch.

    line 244
  4. Distinctive:

    Manual path: If the scaffolder is absent or the tool is unusual enough that the skeleton would not fit, write the four files by hand from …

    line 251
  5. Distinctive:

    Do NOT scaffold blind. First UNDERSTAND, then ASK, then generate.

    line 258
  6. Very specific:

    Understand the codebase: Read the template adapters and the load-bearing invariants (the files under "The template you are copying", plus …

    line 260
  7. Distinctive:

    Never call everything a Dataset.

    line 281
  8. Very specific:

    Write the resolved contract back to the scientist in one block and confirm it before generating.

    line 295
  9. Distinctive:

    Write the contract back to the scientist in one block and confirm it before generating.

    line 330
  10. Distinctive:

    Write the contract once; WHERE it goes follows the catalog-vs-folder split from "The registry reads the contract" above.

    line 335
  11. Very specific:

    Create wheeler/integrations/<provider>/<tool>.py (and an empty wheeler/integrations/<provider>/__init__.py if the provider package is new).

    line 386
  12. Very specific:

    Import the SHARED helpers from _marshal.py (ImportReport, _find_execution, _link_once, _load_index, _paper_exists, _record_used, …

    line 405
  13. Very specific:

    NEVER raises (leave the body a clearly-marked # TODO: fill against a real captured output stub returning ([], RunMeta()), with the small …

    line 409
  14. Very specific:

    write-receipt + trace-id + embedding wiring fires, and graph_tools/ stays adapter-free, mirroring wheeler/validation/ledger.py).

    line 418
  15. Very specific:

    Every graph write routes through execute_tool.

    line 444
  16. Very specific:

    Add the tool name (and any alias) to the _INGESTERS set.

    line 456
  17. Very specific:

    Add a dispatch branch that lazily imports ingest_<tool> and calls it inside asyncio.run(...), forwarding link_to, config, …

    line 457
  18. Very specific:

    If you create a new provider sub-app, register it on the top-level Typer app the same way integrate_app is registered, and keep one ingest …

    line 462
  19. Very specific:

    Create .claude/commands/wh/<provider>-<tool>.md, copying asta-theorize.md (or asta-lit.md for a flat search).

    line 468
  20. Very specific:

    After writing acts you MUST sync the _data mirror so the shipped package matches (the same command exists in .claude/commands/wh/ and …

    line 509
  21. Distinctive:

    Before the human review, run the bundled AUDITOR.

    line 558
  22. Very specific:

    Capture one real output: run the tool once for real (<cli_invocation>), save the -o JSON (or the markdown report, for a md deliverable), …

    line 584
  23. Very specific:

    Fill the parser: write parse_<tool> against that captured shape, and fill the fixture path + expected-count constants in the test.

    line 588
  24. Very specific:

    Adversarial review: run the repo's adversarial-review workflow on the adapter (a fresh reviewer agent re-checks every claim: provenance …

    line 598

≈ “Common” is an estimate: at least 1 in 5 of the 372,429 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Wheeler service creator

You scaffold a new Wheeler service adapter from a tool. A tool becomes a declarative contract (one manifest entry the registry reads); a command opts in via a flag; a run is one Execution whose wiring has THREE parts: structural inputs (USED), structural outputs (WAS_GENERATED_BY), and SEMANTIC wiring of the new outputs to the EXISTING graph (the Wheeler relationships, a judgment call that lives in the act, not the parser). The Asta adapters are instance #1 and your concrete template. You produce the four pieces, then hand the scientist a short to-do list: capture one real output, fill the parser against it, run the adversarial review, land it.

You write SKELETONS, not finished adapters. The parser is tool-specific and can only be written against a real captured output, which you do not have at scaffold time. Your job is to lay down every piece of the structure correctly so the human fills one function (parse_<tool>) and reviews.

Two load-bearing ideas you must get right

Everything below is in service of these two. Read them first.

The registry reads the contract; the adapter does not hardcode the provider

The contract you write is DATA, read by wheeler/integrations/registry.py. There are THREE distinct sets, do not conflate them:

  1. CATALOG (wheeler/integrations/services.default.yaml): everything AVAILABLE to enable. Ships with the package. catalog_services() returns it. A service that should ship with Wheeler belongs here.
  2. ENABLED set: what is actually LOADED and visible to the router and plan acts. The source of truth is a FOLDER, <project_root>/.wheeler/services/, with one <id>.yaml file per enabled contract (same schema as a catalog entry: a bare mapping, or wrapped under services:). load_services() returns this. Precedence: if the folder exists it IS the enabled set (an empty folder means nothing is enabled); else the legacy single-file .wheeler/services.yaml (backward-compat); else the full catalog (every default stays on until the user starts curating).
  3. AVAILABLE: the enabled contracts whose available shell probe passes. available_services() filters the enabled set by the probe. This is what the router actually offers.

Curate the enabled set with the CLI (it writes ONLY under .wheeler/services/, never the graph or network):

wheeler services list          # enabled set + catalog services not yet enabled
wheeler services enable <id>   # copy catalog entry -> .wheeler/services/<id>.yaml
wheeler services disable <id>  # remove .wheeler/services/<id>.yaml

The first enable/disable SEEDS the folder with the whole catalog (so existing defaults stay on) and then applies the change. So a shipped catalog service is enabled-by-default until someone curates; a project-local service is one the user enables (or drops a <id>.yaml into the folder by hand: the folder also accepts contracts the catalog never shipped).

The router act /wh:asta already consumes this: it lists only AVAILABLE services and routes by when / description, warning on cost. Your new service becomes routable the moment (a) its contract is in the enabled set (in the catalog and not disabled, or wheeler services enabled) and (b) its probe passes. You do NOT touch any hardcoded provider table; you add a contract and the registry surfaces it. The per-id folder layout is also the EXTRACTION hook: because each enabled service is its own <id>.yaml, a single contract can be pulled out, diffed, templated, or moved between projects in isolation.

Wiring has THREE parts, and a complete adapter does all three

A service call is ONE Execution. Its wiring has three parts. The first two are STRUCTURAL provenance (mechanical, in the parser); the third is SEMANTIC (a judgment call, in the act). An adapter that does only the first two is incomplete.

                  (3) SEMANTIC: new outputs vs the EXISTING graph
                       SUPPORTS / CONTRADICTS / RELEVANT_TO / CITES
                                       |
input  -[USED]<-  Execution  ->[WAS_GENERATED_BY]  output  - - - - ->  existing graph node
        (1) structural input            (2) structural output
  1. Structural input (USED): the marshal-in built the tool payload FROM graph nodes (the question, seeded Findings, a Dataset path). The act passes those ids as --used; the ingest records Execution -[USED]-> each input via _record_used (existence-guarded, link_once, never fabricates a missing id).
  2. Structural output (WAS_GENERATED_BY): every node the parser PRODUCED this run (Findings, Hypotheses, the raw artifact node) is generated by the Execution. The raw node is wired by register_output_artifact; the produced graph nodes by _record_generated (or inline _link_once(produced_id, "WAS_GENERATED_BY", exec_id)), which the scaffolded skeleton calls for you. The ONE exception: Papers are reference entities (per /wh:close, /wh:graph-link), so they carry NO WAS_GENERATED_BY; a paper the knowledge was derived FROM is an INPUT, so it gets Execution -[USED]-> paper instead.
  3. Semantic wiring (SUPPORTS / CONTRADICTS / RELEVANT_TO / CITES / ...): the new outputs connected to what was ALREADY in the graph, a result SUPPORTS/CONTRADICTS an existing Hypothesis, a new Hypothesis CONTRADICTS one already in the graph, a Finding RELEVANT_TO an open Question, a Paper CITES. This is JUDGMENT: it means comparing the new outputs against the current graph, so it lives in the marshal-in ACT (post-ingest, via link_nodes), NOT in the mechanical parser. Draw the line carefully: the deterministic ingest DOES wire the edges KNOWN FROM THE SERVICE OUTPUT (the Theorizer states which papers support vs contradict ITS own laws, a citations run knows its --target); those are part 2's structural bucketing, asserted from the artifact. Part 3 wires NEW outputs to PRIOR graph nodes the service never saw, which no parser can know.

Parts 1 and 2 are why the chain is transitive off ONE Execution: output -[WAS_GENERATED_BY]-> Execution -[USED]-> input, with no per-input/per-output edges. The adversarial review checks all three: both structural sides, AND that the act carries a post-ingest semantic-wiring step.

When this fires

The scientist wants to wrap an external tool so its output lands in the graph with provenance. Examples: a new Asta sub-tool, a different literature API, a domain analyzer that emits JSON, an agent with an A2A card. Read the spec docs/asta-engine-spec.md section 3 for the design intent.

Do NOT fire for running an existing adapter (that is the /wh:<provider>-<tool> act itself), for graph queries, or for generic coding.

The template you are copying

The four shipped adapters all wrap Asta, the open research toolkit from the Allen Institute for AI (Ai2): Paper Finder, Semantic Scholar, Theorizer, and the literature-report (Scholar QA) services, driven by the asta CLI. Wheeler does not vendor or reimplement Asta; it shells out to the upstream asta tool and marshals the result into the graph. Credit and docs upstream: Asta (https://asta.allen.ai) and Ai2 (https://allenai.org); the asta CLI and agent toolkit are Ai2's work. When you scaffold a NEW provider, keep the same posture: shell out to the upstream tool, attribute it in the adapter docstring and the service description, and never claim its output as Wheeler's own.

Study these before you scaffold. They are the canonical example; mirror their structure, their docstrings, and their invariants. All paths are relative to the repo root.

  • wheeler/integrations/asta/_marshal.py -- the SHARED marshal-out helpers (ImportReport, the persisted corpus_id index, _link_once / _edge_exists, _node_exists / _record_used for input-side provenance). Your adapter imports these; it does NOT reimplement them.
  • wheeler/integrations/asta/ingest.py -- Paper Finder, the simplest adapter (output is a Dataset of reference records).
  • wheeler/integrations/asta/theorizer.py -- the richest adapter (parses an A2A Task into a Finding/Hypothesis/Paper subgraph, output is a Document).
  • wheeler/integrations/asta/semantic_scholar.py -- a multi-shape adapter (auto-detects sub-kind, output is a Dataset).
  • wheeler/integrations/asta/artifacts.py -- register_output_artifact: durably saves the raw -o dump and registers it as a Document (W-) or Dataset (D-) node WAS_GENERATED_BY the run Execution.
  • wheeler/integrations/asta/cli.py -- the single wheeler integrate ingest verb that the act shells out to (--link-to, --used, --target).
  • wheeler/integrations/registry.py + services.default.yaml -- the registry that reads service contracts (load_services / available_services) and the bundled default manifest your new entry mirrors.
  • .claude/commands/wh/asta.md -- the ROUTER act. It reads the registry (not a hardcoded table) and dispatches the matching service act. Study how it lists only available services and routes by when / cost; your new service plugs into it for free once its contract exists.
  • .claude/commands/wh/asta-lit.md, asta-theorize.md, asta-scholar.md -- the marshal-in acts. Each reads graph context, picks a link target, shells out to the tool CLI, then calls wheeler integrate ingest ... --used <ids> (part 1, the structural INPUT side; the ingest wires part 2, the structural OUTPUT side, WAS_GENERATED_BY). Each then carries a post-ingest "Wire semantics to the existing graph" step (part 3): it reads the new ids plus the existing graph and applies the SUPPORTS / CONTRADICTS / RELEVANT_TO / CITES edges to PRIOR nodes via link_nodes, confirming each judgment with the scientist.
  • tests/integrations/asta/test_theorizer.py -- the test template: parse-unit tests (no live call) PLUS a live-Neo4j e2e class with the per-run e2e_tag hermetic-teardown convention. Its e2e assertions check BOTH provenance sides (USED edges from the run, WAS_GENERATED_BY edges into it).

Two ways to lay down the skeleton

There is a bundled scaffolder, assets/scaffold_service.py, that writes all four skeleton files deterministically from a contract. Prefer it: hand-copying the boilerplate from the templates is slow and easy to get subtly wrong (a dropped provenance edge, a missing invariant), and the scaffolder bakes in the load-bearing structure so you only have to fill the one thing it cannot know: the parser. What it bakes in: the lazy execute_tool import, BOTH provenance sides, the external-call FAILSAFE (the job_outcome gate, honest Execution status, mark_execution_failed on a bad run, mark_execution_completed on a reused retry, the partial-ingest try/except), the record-failure act step, and the per-run-uuid hermetic-teardown test.

Fast path (recommended). Gather the contract (Step 1), then run the scaffolder once. It is stdlib-only, writes nothing it cannot, and will not overwrite an existing file unless you pass --overwrite. By default it writes the contract as its own enabled-folder file .wheeler/services/<id>.yaml (which ENABLES the service); --shipped appends it to the bundled catalog services.default.yaml instead (ships with Wheeler, enabled-by-default):

# from the repo root; use plain `python` if ./.venv is absent
./.venv/bin/python .claude/skills/wheeler-service-creator/assets/scaffold_service.py \
  --provider <provider> --tool <tool> --name "<Name>" \
  --description "<one line>" --raw-node <document|dataset> \
  --raw-format <json|md> \
  --nodes "<Comma,Separated,NodeTypes>" \
  --cli '<the exact CLI the act runs, with -o /tmp/<tool>.json>' \
  --available "<probe command>" --cost "<cost string>" --when "<router phrase>" \
  [--id <registry-id>] [--act <act-slug>] [--shipped]

Flags worth knowing: --raw-format md emits a MARKDOWN-deliverable skeleton (the ingest reads the report text and registers a Document, modeled on scholar_qa.py) instead of the JSON skeleton; --id / --act override the mechanical <provider>-<tool> derivation (use them to avoid a collision, e.g. --act asta-report so it does not clash with asta-scholar); --shipped registers in the bundled catalog.

Add --dry-run first to preview the paths it will touch. It prints one line per file (wrote / appended / skipped). Then read each emitted file, confirm it matches the contract, and move to the per-file steps below to UNDERSTAND what was generated and to fill the gaps (the parser body, the CLI verb wiring in Step 4, the _data sync in Step 5). The scaffolder does not touch cli.py or run sync_data, so Steps 4 and 5 are still yours.

Manual path. If the scaffolder is absent or the tool is unusual enough that the skeleton would not fit, write the four files by hand from the templates. The per-step sections below are the spec either way: they describe exactly what each file must contain, which is also what the scaffolder emits.

Step 1: understand the codebase, then gather the contract

Do NOT scaffold blind. First UNDERSTAND, then ASK, then generate.

Understand the codebase. Read the template adapters and the load-bearing invariants (the files under "The template you are copying", plus wheeler/integrations/asta/CLAUDE.md and docs/asta-engine-spec.md) so you know the conventions a new adapter must follow: the three-part provenance model, the Paper reference-entity rule, the external-call failsafe (honest Execution status, no fabricated outputs on a failed job), the per-run-uuid hermetic teardown. The scaffolder bakes these in, but you must understand them to fill the parser and to answer the scientist's questions correctly.

Ask the scientist the critical design / integration decisions. A contract has genuine forks that only the scientist can settle, and a wrong choice means wrong skeletons. Where you do not KNOW or the choice is load-bearing, ASK (use AskUserQuestion for a clean multiple-choice; do not guess silently). The decisions worth asking about:

  • What is the deliverable? One JSON -o artifact (an A2A Task or a REST response) or a synthesized MARKDOWN document (a written report, like the Asta literature report)? This sets --raw-format json|md and changes the whole ingest shape. If unsure, ask, or read one real run.
  • raw_node: document or dataset? Synthesized WRITING (a report, theories) is a document; structured reference RECORDS (papers, rows) is a dataset. Never call everything a Dataset. (md deliverables default to document.)
  • What node types does the output bucket into, and what are the SEMANTIC edges to the existing graph (SUPPORTS / CONTRADICTS / CITES / RELEVANT_TO)? This is the part-3 wiring the act will do; the scientist owns the judgment.
  • What graph nodes are the USED inputs (the marshal-in synthesizes the request FROM them: the question, seeded Findings, dataset paths)?
  • Cost / auth: is it paid or slow (so the router must warn and confirm)? does it need a login before any test run?
  • Ships with Wheeler or project-local? (--shipped -> the bundled catalog; else a .wheeler/services/<id>.yaml enabled file.)
  • id / act name: does the mechanical <provider>-<tool> collide with an existing act or read awkwardly? (e.g. asta-scholar-qa collides with asta-scholar; use --act asta-report.) Offer a cleaner name.

Write the resolved contract back to the scientist in one block and confirm it before generating. Then gather the rest (interview, or read the tool's --help / agent card); ask only for what you cannot infer, default the rest.

  • provider: the family (e.g. asta, s2, myorg). Lower-case, slug-safe.
  • tool: the specific tool (e.g. paper-finder, theorizer, datavoyager). Lower-case, slug-safe. Together they give the service id <provider>-<tool>, the service tag <provider>:<tool>, the act /wh:<provider>-<tool>, and the module wheeler/integrations/<provider>/<tool>.py.
  • name + description: human label and one line of what it does.
  • kind: shell-out (a CLI you invoke, the common case) or local.
  • cli_invocation: the exact command the act runs, with -o <tempfile> so it dumps JSON (e.g. asta literature find "$QUERY" -o /tmp/<tool>.json). Capture the auth requirement and rough cost/time.
  • availability: the probe command whose zero exit means the tool is usable (e.g. asta auth status). The registry filters out services whose probe fails.
  • cost: a short human string (e.g. "expensive (~$7, ~20min)" or "free").
  • when: a one-line trigger phrase for the router (e.g. "hypothesis or theory generation").
  • inputs (ports): the graph nodes the marshal-in synthesizes the request FROM. Each is {name, source, required} where source is query (the sharpened question), findings (seeded Finding ids), datasets (Dataset paths), etc. These are exactly the ids that become --used arguments.
  • output shape:
    • raw_node: document (synthesized WRITING, like Theorizer) or dataset (structured reference RECORDS, like Paper Finder / Semantic Scholar). Pick document for prose/theories, dataset for records/data. NEVER call everything a Dataset.
    • nodes: the Wheeler node types the parser produces (e.g. [Finding, Hypothesis, Paper], or [Paper]).
    • dedupe: the natural key per produced node type (corpus_id for Papers, a content hash for nodes with no external id).
    • edges: the semantic relationships (SUPPORTS, CONTRADICTS, CITES, APPEARS_IN, RELEVANT_TO, AROSE_FROM, CONTAINS) and which node pairs they join.

Write the contract back to the scientist in one block and confirm it before generating. A wrong contract means wrong skeletons.

Step 2: the service contract (registry entry)

Write the contract once; WHERE it goes follows the catalog-vs-folder split from "The registry reads the contract" above. The entry shape is the same either way. Mirror the existing entries exactly (registry._REQUIRED_FIELDS are all of id, provider, name, description, kind, act, cost, available, when; a missing one is skipped and logged, so the service silently will not appear):

  - id: <provider>-<tool>
    provider: <provider>
    name: <Name>
    description: <one line>
    kind: shell-out                 # shell-out | local
    act: /wh:<provider>-<tool>
    cost: "<cost string>"
    available: "<probe command>"    # filtered out on non-zero exit
    when: "<router trigger phrase>"
    inputs:                          # the USED set + the marshalling map
      - { name: <port>, source: <query|findings|datasets>, required: true }
    output:
      raw_node: <document|dataset>
      nodes: [<NodeType>, ...]

Then place it:

  • Ships with Wheeler -> append the entry under services: in the bundled CATALOG wheeler/integrations/services.default.yaml (package data; no sync_data). It is then enabled-by-default (until someone curates) and a user can wheeler services enable <id> it explicitly after curating.
  • Project-local only -> drop it as its own file in the ENABLED folder <project_root>/.wheeler/services/<id>.yaml (a bare mapping is fine, no services: wrapper needed), or add it to the catalog and run wheeler services enable <id>. Either way the per-id file is what the folder loads.

This is the contract. Identity + ports + output shape, NOT a field-map language: the parser stays tool-specific Python. inputs and output are opaque to the registry (it does not interpret them; the adapter does), so they are optional for routing but valuable as documentation of the marshalling map. Confirm the service is now ENABLED and AVAILABLE:

wheeler services list   # your <id> appears under "Loaded services (enabled)"
# and, probe permitting, in available_services():
./.venv/bin/python -c "from wheeler.config import load_config; from wheeler.integrations.registry import available_services; print([c.id for c in available_services(load_config())])"

You have NOT touched any hardcoded provider table; /wh:asta routes to it as soon as it is enabled and its probe passes.

Step 3: the marshal-out ingest skeleton

Create wheeler/integrations/<provider>/<tool>.py (and an empty wheeler/integrations/<provider>/__init__.py if the provider package is new). Copy the structure of theorizer.py (for a node-subgraph output) or ingest.py (for a flat record output). The scaffolder emits all of the following; if you are writing by hand, this is the checklist (each item exists for a reason given inline, so you can adapt it intelligently rather than copy it blindly):

  1. Open with a docstring stating the REAL output shape (fill the placeholder once a real output is captured), the bucketing/mapping, and the standing invariants verbatim from the template:
    • Defensive: every step tolerates missing pieces, counts and skips, never raises.
    • Sequential writes only. Never asyncio.gather: execute_tool reuses one cached backend singleton and Neo4j forbids concurrent queries.
    • link_once: every edge is existence-guarded because the backend's create_relationship is a bare CREATE that duplicates on re-run.
    • One Execution per RUN, tagged service <provider>:<tool>.
  2. Define _SERVICE_TAG = "<provider>:<tool>" and _RAW_NODE_TYPE = "<document|dataset>".
  3. Import the SHARED helpers from _marshal.py (ImportReport, _find_execution, _link_once, _load_index, _paper_exists, _record_used, _save_index, ...). Do NOT reimplement them.
  4. Provide a pure parse_<tool>(doc) -> (records, run_meta) that is defensive and NEVER raises (leave the body a clearly-marked # TODO: fill against a real captured output stub returning ([], RunMeta()), with the small coercion helpers _as_str / _as_float / _first copied in so the human only writes the shape-walk).
  5. Provide async def ingest_<tool>(doc, *, link_to=None, config, artifact_path=None, used_inputs=None) -> ImportReport. The order below matters because each step depends on the Execution id minted at the top:
    • from wheeler.tools.graph_tools import _get_backend, execute_tool (lazy, function-local: this is the ONLY execute_tool caller, so the triple-write
      • write-receipt + trace-id + embedding wiring fires, and graph_tools/ stays adapter-free, mirroring wheeler/validation/ledger.py).
    • dedupe-or-create ONE Execution per run via _find_execution (idempotent), tagged service=_SERVICE_TAG with a stable session_id.
    • record INPUT-side provenance: report.used += await _record_used(backend, config, exec_id, used_inputs) (existence-guarded, link_once, never fabricates a missing id). This is half of the two-sided chain.
    • register the raw output via register_output_artifact(artifact_path, execution_id=exec_id, service=_SERVICE_TAG, config=config, node_type=_RAW_NODE_TYPE, ...) (best-effort, never raises). This wires the raw node's OUTPUT-side WAS_GENERATED_BY edge.
    • bucket each parsed record into its nodes, every WRITE through execute_tool, every edge through _link_once. COLLECT the produced node ids (excluding Papers).
    • record OUTPUT-side provenance for the produced graph nodes: await _record_generated(backend, config, exec_id, produced_ids, report) (or an inline _link_once(produced_id, "WAS_GENERATED_BY", exec_id) per node). The scaffolded skeleton already lays down _record_generated and the produced_ids loop; do not drop it. Wiring only the input side is a bug.
    • apply the Paper rule when the output references papers: papers dedupe on corpus_id, are REFERENCE ENTITIES (NO WAS_GENERATED_BY, so they are NOT in produced_ids), and if the produced knowledge was DERIVED from a paper, the run Execution -[USED]-> that paper (input side).
    • return the ImportReport with created / deduped / linked / skipped / used counts.

Every graph write routes through execute_tool. Never write the backend or the files directly. The acceptance bar for the ingest is BOTH provenance sides: Execution -[USED]-> each input AND each produced node -[WAS_GENERATED_BY]-> the Execution.

Step 4: register the CLI verb

The act does not call Python directly; it shells out to wheeler integrate ingest <tool> <artifact.json> --link-to <id> --used <ids>. Wire the new tool into wheeler/integrations/asta/cli.py (or a sibling <provider>/cli.py if the provider is new and gets its own sub-app):

  1. Add the tool name (and any alias) to the _INGESTERS set.
  2. Add a dispatch branch that lazily imports ingest_<tool> and calls it inside asyncio.run(...), forwarding link_to, config, artifact_path=str(artifact), and used_inputs. Keep the existing --used parsing (comma-split, blanks dropped, normalized to None).

If you create a new provider sub-app, register it on the top-level Typer app the same way integrate_app is registered, and keep one ingest verb only (no send/dispatch verb: Wheeler must not become a second router that invokes the tool).

Step 5: the marshal-in act

Create .claude/commands/wh/<provider>-<tool>.md, copying asta-theorize.md (or asta-lit.md for a flat search). The act IS the system prompt. It MUST:

  • Frontmatter: name: wh:<provider>-<tool>, a narrow description (the trigger vocabulary, demanding tool + knowledge-graph words so it does not auto-fire on generic coding), argument-hint, and allowed-tools limited to Read, the tool's Bash(<tool>:*), Bash(wheeler integrate:*), the read-only MCP tools the preflight needs (mcp__wheeler_core__search_context, the relevant mcp__wheeler_query__query_* including query_open_questions and query_hypotheses for the semantic-wiring step), and mcp__wheeler_mutations__link_nodes (the only write the act needs, for part 3 below).
  • Preflight: confirm the tool is installed (its --version / availability probe); stop cleanly if not. Read graph context with search_context and the typed query_* to SHARPEN the request and pick a link target. "Do not invent results / theories. Do not do the scientist's thinking."
  • Choose the request + link target: the request is $ARGUMENTS or derived from the active question; pick at most one Q-/PL- link target.
  • Run: the exact cli_invocation writing to a temp file. A non-zero exit reports and stops (a failed run writes nothing to the graph by design).
  • Ingest: wheeler integrate ingest <tool> <tempfile> --link-to <id> --used <id>,<id>. Spell out that --used carries the graph node ids the request was built FROM (the link target plus any seeded source ids), recording Execution -[USED]-> each input so every result traces back to the graph context that shaped it. State that the verb is idempotent.
  • Wire semantics to the existing graph (part 3, the judgment step): a brief post-ingest section. State that the ingest is STRUCTURALLY complete but does not connect the new outputs to what was ALREADY in the graph, because that is a judgment call, so it lives here in the act. The step: read the new node ids from the ingest report and the existing graph (search_context, query_open_questions, query_hypotheses, query_findings); identify the SUPPORTS / CONTRADICTS / RELEVANT_TO / CITES edges between NEW outputs and EXISTING nodes; confirm the judgment calls with the scientist; apply via mcp__wheeler_mutations__link_nodes. Keep it brief. Tune the edges to the node types this tool produces (a theory-generator weights new Hypotheses vs existing Hypotheses SUPPORTS/CONTRADICTS; a literature tool weights new Papers RELEVANT_TO/CITES).
  • Report: relay the printed summary in one or two sentences; suggest the query_* filters to browse the new nodes. Never editorialize the science.
  • No em dashes anywhere.

After writing acts you MUST sync the _data mirror so the shipped package matches (the same command exists in .claude/commands/wh/ and wheeler/_data/commands/): run python -c "from wheeler.installer import sync_data; sync_data()".

Step 6: the test stub

Create tests/integrations/<provider>/test_<tool>.py (and an empty __init__.py), copying tests/integrations/asta/test_theorizer.py. Two layers, NEITHER making a live tool call:

  1. Parse-unit (class TestParse<Tool>): assert parse_<tool> against a trimmed REAL fixture in tests/integrations/<provider>/fixtures/, plus shape-drift / garbage tolerance (a non-dict, an empty artifacts list, missing keys -> ([], RunMeta()), never raises). Leave the fixture path and the expected-count constants as clearly-marked TODOs the human fills once a real output is captured.
  2. Live-Neo4j e2e (class TestIngest<Tool>E2E): skipped automatically when Neo4j is unreachable. Follow the per-run e2e_tag hermetic-teardown convention EXACTLY:
    • A module-scoped e2e_config fixture pointing at local Neo4j, a neo4j_available probe, and a _reset_driver_singleton autouse fixture (copy them verbatim from test_theorizer.py).
    • A _cleanup_<tool>(e2e_config, e2e_tag) helper whose teardown is EXACTLY MATCH (n) WHERE n.e2e_tag = $tag DETACH DELETE n and nothing else. NEVER delete by service or corpus_id: the e2e config runs on the SHARED default namespace where production nodes carry the same service tag and the same corpus_ids, so a service-scoped or corpus_id-scoped delete would wipe real user data.
    • An autouse _skip_and_cleanup fixture that monkeypatch.chdir(tmp_path) (so the on-disk indices and the durable raw store are isolated per test), mints a per-run unique tag f"integrations_e2e_{uuid.uuid4().hex}", and pre-cleans + post-cleans on it.
    • A _tag_all(e2e_config, report) helper that tags ONLY the nodes THIS run created, scoped off the returned report ids (Execution, artifact, every Paper) PLUS the run's WAS_GENERATED_BY fan-in. NEVER tag by service or corpus_id. Papers are reference entities (no WAS_GENERATED_BY), so they are tagged by report.paper_ids, not via the fan-in.
    • One test that ingests the fixture, tags, asserts the bucketing subgraph (node counts, edge counts, custom fields) scoped to THIS run's e2e_tag, and asserts BOTH provenance sides: at least one Execution -[USED]-> input edge (when used_inputs were passed) AND each produced node -[WAS_GENERATED_BY]-> Execution (and that Papers carry NO WAS_GENERATED_BY). Then RE-INGEST the same artifact and assert idempotency (identical counts, created==0, no duplicate USED / WAS_GENERATED_BY edges on the second pass).

Step 7: AUDIT the filled adapter (mechanical checks before review)

Before the human review, run the bundled AUDITOR. It is the mechanical half of the adversarial review, codified so every new adapter is held to the same bar: data safety (the teardown deletes ONLY by per-run e2e_tag, never by service / corpus_id; run-unique corpus_ids), provenance (both sides wired, the Paper reference-entity rule), the external-call failsafe (the job_outcome gate, honest status, mark_execution_failed, the partial-ingest guard), and the house conventions (no anthropic import, no em dashes, the lazy execute_tool import, the act's semantic-wiring + record-failure steps, a complete registry contract).

./.venv/bin/python .claude/skills/wheeler-service-creator/assets/audit_service.py \
  --provider <provider> --tool <tool> --verbose

It exits non-zero if any BLOCKER fired. Fix every BLOCKER and look at each WARN before landing. The audit is deterministic and conservative: a PASS is necessary, not sufficient (it does not replace the live e2e or the human review), but it catches the mistakes that recur (an unsafe teardown, a missing failsafe gate, a Paper wired WAS_GENERATED_BY, an em dash, an incomplete contract). Run it again after any fix.

Step 8: hand off to the human

You scaffolded the structure; the parser is the one thing only a real output can teach. Tell the scientist, in this order:

  1. Capture one real output: run the tool once for real (<cli_invocation>), save the -o JSON (or the markdown report, for a md deliverable), and drop a trimmed copy under tests/integrations/<provider>/fixtures/.
  2. Fill the parser: write parse_<tool> against that captured shape, and fill the fixture path + expected-count constants in the test. The skeleton's defensive helpers, the failsafe, and the invariants are already in place; only the shape-walk is missing. For a paper-producing e2e, derive RUN-UNIQUE synthetic corpus_ids from the per-run uuid (see test_scholar_qa.py) so the test can never dedupe into and then delete a production Paper.
  3. Run the audit (Step 7) and fix every BLOCKER.
  4. Run the tests: ./.venv/bin/python -m pytest tests/integrations/<provider>/test_<tool>.py -q (the e2e class needs a live Neo4j; it skips otherwise).
  5. Adversarial review: run the repo's adversarial-review workflow on the adapter (a fresh reviewer agent re-checks every claim: provenance edges, the Paper reference-entity rule, the --used input provenance, the failsafe, idempotency, the hermetic teardown) before landing. Adding a service is then: run the creator -> fill the parser -> audit -> review -> land.

Report back the four files you created (the .wheeler/services/<id>.yaml contract or catalog entry, the ingest skeleton, the act, the test stub) plus the CLI verb wiring, the audit result, and the exact to-do list above. Never use em dashes.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.