retrospective-audit
Skill0 starsChanged 26 days agoMITView on GitHub
Audit an Agent Skill against real past Codex Desktop task history. Use when the user asks to backtest, retrospectively audit, evaluate, calibrate, improve, or compare a SKILL.md against how work was actually done across previous Codex tasks; when repeated manual corrections, repair loops, skipped steps, stale procedures, or process drift suggest the skill may no longer match real workflow. Work read-only until the user explicitly approves edits.
1 other project uses a version of this.
Adopted by
Most recently taken up by
- The01Geek/prflowtheir own version, first seen Aug 29, 2026
Other versions1 project uses a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 1
- The01Geek/prflow★ 99same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
The file
Show its rules and text
We split this skill into the rules it gives an agent
14 rules. About 0 are common, 12 are distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈12
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 10
Run a read-only retrospective audit first.
- Very specific: line 20
Read the target SKILL.md completely.
- Distinctive: line 22
Prefer full task history over titles, previews, summaries, or memory.
- Distinctive: line 28
Stop for user agreement on the sample unless the user already gave a specific task list.
- Distinctive: line 30
After approval, read the selected tasks fully, including paginated or older turns when available.
- Distinctive: line 37
If task-history access is unavailable or incomplete, say so directly.
- Distinctive: line 43
Use memory only to find candidate tasks, not to prove conclusions.
- Distinctive: line 45
Treat manual actions outside Codex as invisible unless the history records them.
- Distinctive: line 47
Do not call a deviation a skill defect by default.
- Distinctive: line 53
Call a pattern durable only when it appears in at least three independent relevant tasks.
- Distinctive: line 72
Keep this contract compact.
- Very specific: line 92
Use the five-section report structure from references/report-template.md.
- Distinctive: line 109
Stop and ask the user before:
- Distinctive: line 118
If the user asks to proceed directly to edits, still summarize the evidence and patch plan first, then apply only the approved changes.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Retrospective Audit
Core rule
Run a read-only retrospective audit first. Do not edit the skill, project files, Git state, Codex tasks, or external systems unless the user gives a separate explicit approval after seeing the audit and patch plan.
This skill audits the skill process, not the project outcome. The goal is to find where written instructions diverge from real Codex task behavior and whether the divergence matters.
Required workflow
- Read the target
SKILL.mdcompletely. - Discover relevant past Codex Desktop tasks using available task/thread tools. Prefer full task history over titles, previews, summaries, or memory.
- Present candidate tasks before deep reading:
- title;
- date, when available;
- short relevance reason;
- include/exclude recommendation.
- Stop for user agreement on the sample unless the user already gave a specific task list.
- After approval, read the selected tasks fully, including paginated or older turns when available.
- Decompose the target skill into a testable contract.
- Compare each selected task against that contract.
- Separate durable patterns from one-off exceptions.
- Produce recommendations and a patch plan only. Do not apply it.
If task-history access is unavailable or incomplete, say so directly. Do not infer missing evidence from project memory, summaries, titles, previews, or user expectations.
Evidence rules
- Use memory only to find candidate tasks, not to prove conclusions.
- Base conclusions on the actual task history whenever possible.
- Treat manual actions outside Codex as invisible unless the history records them.
- Do not call a deviation a skill defect by default. First evaluate whether it:
- improved the result;
- caused an error, rework, or repair loop;
- was an intentional exception;
- came from a task-specific constraint;
- protects against a rare but expensive risk.
- Call a pattern durable only when it appears in at least three independent relevant tasks.
- Mark weaker signals as hypotheses or exceptions.
Skill contract decomposition
Extract these checkable elements from the target skill:
- trigger conditions: when the skill should activate;
- expected inputs: files, paths, approvals, task history, repo state, or user decisions it expects;
- ordered workflow: required steps and sequencing;
- checks and stop-lines: validations, approvals, read-only boundaries, and escalation points;
- completion criteria: what counts as done;
- outputs: expected files, reports, diffs, proposals, commits, or releases;
- optional branches: conditions under which references, scripts, tools, or external systems are used.
Keep this contract compact. Quote only short fragments when needed.
Per-task comparison labels
For each selected task, mark contract items as:
- followed;
- skipped;
- reordered;
- repeated;
- added outside the skill;
- required manual correction;
- caused rework or repair cycle;
- impossible to determine from history.
Capture concise evidence for each non-trivial label: task title/date, relevant turn summary, and observed consequence.
Final report
Use the five-section report structure from
references/report-template.md.
For every recommendation include:
- concrete skill rule or fragment;
- tasks supporting the finding;
- observed evidence;
- expected effect;
- confidence: high, medium, or low;
- proposed wording for the change.
End with a compact patch plan. The plan may name files and sections to change, but must not be applied during the audit turn.
Stop-lines
Stop and ask the user before:
- reading a very large number of tasks when a smaller representative sample is available;
- using external systems beyond Codex task history and local files;
- changing any files;
- committing, pushing, publishing, installing, or uninstalling anything;
- treating fewer than three examples as a durable pattern.
If the user asks to proceed directly to edits, still summarize the evidence and patch plan first, then apply only the approved changes.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

