coherency-audit
Skill2 starsChanged 9 months agoMITView on GitHub
Detect and surface contradictions between Claude's synthesized profile and actual conversation history. Prevents stale data from compounding across conversations. Trigger on "run coherency audit", "check coherency", "audit your memory", or before making claims about people, employers, case statuses, or project statuses where wrong facts have real consequences.
In this repository3 other files it gives its agents.
- session-continuitySkill
- temporal-spatial-proximitySkill
- transcript-chainSkill
The file
We split this skill into the rules it gives an agent
9 rules. About 0 are common, 9 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈9
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 19
When layers conflict, Claude defaults to the synthesized profile because it appears first in context.
- Distinctive: line 25
Start of conversations involving professional communications, legal strategy, or job applications where wrong facts have consequences
- Distinctive: line 28
Before making claims about people's employers, roles, or affiliations
- Distinctive: line 29
When conversation_search results contradict profile data
- Distinctive: line 30
When the user references something Claude doesn't see in the profile
- Distinctive: line 53
Read the synthesized profile for each category.
- Distinctive: line 72
If unsure whether data is stale, ASK rather than assuming the profile is correct
- Distinctive: line 80
Memory edits override the profile: If there's a conflict, edits win — they're more recent and user-directed.
- Distinctive: line 85
Update this skill whenever major life events occur — case resolutions, job changes, project completions.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Coherency Audit Skill
Purpose
Detect and surface contradictions between Claude's synthesized profile (userMemories) and actual conversation history. Prevents stale data from compounding silently across conversations.
The Problem
Claude's memory system has three layers:
- Synthesized profile (userMemories) — generated periodically, goes stale
- Memory edits (user_edits) — more current but incomplete
- Conversation history — the actual ground truth
When layers conflict, Claude defaults to the synthesized profile because it appears first in context. Stale or incorrect claims propagate silently and compound. The most dangerous errors sound plausible.
When to Trigger
Mandatory
- User says "run coherency audit" or "check coherency" or "audit your memory"
- Start of conversations involving professional communications, legal strategy, or job applications where wrong facts have consequences
Recommended
- Before making claims about people's employers, roles, or affiliations
- When conversation_search results contradict profile data
- When the user references something Claude doesn't see in the profile
- At least once per week during active daily use
Execution
Step 1: Identify Auditable Categories
Categories most likely to go stale:
- Employment — employers, roles, titles (yours and people you discuss)
- Case/project status — open, closed, won, lost, abandoned, active
- Current projects — what's actually active vs. what profile says
- Location — where relevant
- Relationship details — names, roles, affiliations
Step 2: Search for Evidence
For each category, run targeted searches:
conversation_search("[person] employer job work [company]")
conversation_search("[case] ruling outcome status")
conversation_search("current project building working on")
recent_chats(n=5)Step 3: Compare to Profile
Read the synthesized profile for each category. Compare to conversation evidence. Flag every discrepancy.
Step 4: Output the Audit
COHERENCY AUDIT — [date]
VERIFIED: [category] — profile matches evidence
STALE: [category]
Profile says: [X]
Evidence shows: [Y]
Source: [chat date or reference]
Recommend: [suggested memory edit]
MISSING: [category] — profile has no entry, evidence shows [Z]
Recommend: [suggested memory edit]Step 5: Fix
- Apply memory edits to correct stale entries immediately
- If unsure whether data is stale, ASK rather than assuming the profile is correct
- Memory edits override the synthesized profile
Critical Rules
- Never trust the synthesized profile over conversation evidence. The profile is a periodic summary. Conversations are ground truth.
- When in doubt, search. A 30-second search is cheaper than a wrong claim that compounds across threads.
- The most dangerous errors sound plausible. That's why they persist.
- Memory edits override the profile. If there's a conflict, edits win — they're more recent and user-directed.
- Stale status is as dangerous as stale facts. Describing a won case as "ongoing litigation" changes how Claude frames every response.
Maintenance
Update this skill whenever major life events occur — case resolutions, job changes, project completions. The user may direct updates. Claude should also proactively suggest updates when evidence accumulates.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

