flowai-memex-audit

Memex Audit

Health check for the memex (long-term knowledge bank for AI agents). Runs a deterministic script first, then layers LLM-judgement checks on top.

When to invoke

Invoked when the user wants a memex health check (e.g., "audit my memex", "check the memex for dead links", /flowai-memex:memex-audit for audit-only or /flowai-memex:memex-audit --fix to apply trivial auto-fixes).

Memex Resolution

Same protocol as the other memex skills:

1. --memex <path> flag → use that path.
2. Walk up from cwd looking for an ancestor with both AGENTS.md and pages/.
3. Otherwise stop with: No memex found. Pass --memex <path> or cd into a memex directory.

Read <memex-root>/AGENTS.md for the schema.

Audit Steps

1. Run the deterministic check

Run the audit script bundled with this skill:

deno run --allow-read scripts/flowai-memex-audit.ts <memex-root>/pages/

(The path is relative to the installed skill directory. The exact location depends on the IDE — pass an absolute path if your IDE does not preserve relative working directory.)

The script reports four issue kinds, one per line:

• DEAD_LINK: [[target]] in <file> — wikilink points to a non-existent page.
• ORPHAN: <file> has no inbound [[links]] — page is not linked from anywhere except itself.
• MISSING_SECTION: <file> (concept) lacks 'Counter-Arguments and Gaps' — concept page missing the gaps section.
• INDEX_MISSING: <file> not listed in index.md / INDEX_DEAD: index.md references [[slug]] which has no file — drift between filesystem and pages/index.md.

2. Layer LLM-judgement checks

The script handles structure. The following require reading content:

• Contradictions: grep -rln "\[!WARNING\]" <memex-root>/pages/ to find every callout marker. List them — these need human resolution.
• Stale claims: read each page with date older than 6 months. Flag any whose claims are likely outdated (rapidly-changing fields).
• Unlinked concept mentions: scan page bodies for proper nouns and technical terms that appear in prose without a [[wikilink]] even though a corresponding page exists. Add the wikilink at the first natural mention if --fix, else just suggest.
• Coverage gaps: read index.md and identify domains with only 1–2 pages. Suggest 3–5 questions the memex cannot yet answer well — candidates for flowai-memex-ask or further flowai-memex-save.

3. Apply auto-fixes (only if --fix)

For each issue with a trivial deterministic fix, apply it:

Issue	Auto-Fix
DEAD_LINK	Create stub page at the link target with the closest matching template (default: concept). Stub body: # <Slug as Title>\n\n_Stub created by audit. Needs content from a source._\n\n## See Also\n- [[<page that linked to it>]].
MISSING_SECTION	Append empty ## Counter-Arguments and Gaps\n\n_None recorded yet._ to the concept page.
INDEX_MISSING	Add the page to index.md under a domain derived from its tags frontmatter.
INDEX_DEAD	Remove the dead row from index.md.
ORPHAN	NOT auto-fixed — finding a sensible inbound page requires judgement. List it for the user.
[!WARNING] contradiction	NOT auto-fixed — surface for human review.
Stale-claim suspicion	NOT auto-fixed — surface for human review.
Unlinked concept mention	Add [[wikilink]] at the first natural mention only when --fix is set AND the target page exists. Otherwise just suggest.

4. Write an audit report

Write <memex-root>/outputs/reports/YYYY-MM-DD-audit.md (create outputs/reports/ if missing):

# Memex Audit Report — YYYY-MM-DD

**Memex:** <memex-root> | **Issues:** N | **Auto-fixed:** M

## Critical
- DEAD_LINK: ... (auto-fixed: stub created at <path>)
- ...

## Warnings
- ORPHAN: ... — suggest linking from <candidate>
- ...

## Suggestions
- 3–5 questions the memex cannot yet answer:
  1. ...
  2. ...

## Contradictions
- <file>:<line>: <one-line summary> — needs human resolution

5. Append log.md

## [YYYY-MM-DD] audit | <total> issues, <fixed> auto-fixed
<one-line summary of the worst class of issue>

6. Report to user

Print a compact summary:

• Total issues by severity.
• Auto-fixed count and what kinds.
• Path to the full report under outputs/reports/.
• The 3–5 suggested research questions (so the user sees them without opening the report).

Constraints

• Never auto-delete pages — INDEX_DEAD removes index rows, but the underlying file (if it exists) stays.
• Never auto-resolve contradictions — they need human judgement.
• Never auto-rewrite the body of an existing page — only append (e.g., the missing-section fix appends a new section). Other body changes must be human-reviewed.
• Use Read, Glob, Grep, Bash (for the deterministic script and for grep), Edit (for index.md, log.md, and append-only fixes), Write (for stub pages and the audit report).
• Without --fix, the audit skill is read-only on the memex except for the report file and log.md.