rules-learning-pipeline

Rules Learning Pipeline Plugin

Automated learning pipeline that evaluates model sessions, extracts lessons, detects wasteful patterns, and optimizes CLAUDE.md rules following Anthropic best practices.

Features

• Session Evaluation: Parse action sequences, calculate metrics (F1, Precision, Recall)
• Wasteful Pattern Detection: Identify BDN, CIP, Verification Theater, Redundant Tool Chains
• Dismissive Language Flagging: Catch "pre-existing", "not related", etc.
• Scope Classification: Route lessons to correct rule files
• Rule Optimization: Apply peripheral bias, emphasis keywords, line limits
• Multi-Agent Pipeline: Coordinated agents with checkpointing and retry logic

Installation

# In your project directory
claude

# Install the plugin
/plugin install rules-learning-pipeline

Or add to .claude/settings.json:

{
  "plugins": ["rules-learning-pipeline"]
}

Commands

Full Pipeline

/rules-learning-pipeline:learn-from-session <session-file> [--dry-run] [--verbose]

Runs the complete 4-phase pipeline:

1. Evaluate (model-evaluator): Parse, metrics, errors, lessons
2. Review (critics-reviewer): Validate, audit, catch missed patterns
3. Optimize (prompt-optimizer): Route, optimize, write rules
4. Report: Generate summary, update changelog

Individual Phases

# Phase 1 only
/rules-learning-pipeline:evaluate-model <session-file>

# Phase 2 only
/rules-learning-pipeline:critics-review <lessons-file>

# Phase 3 only
/rules-learning-pipeline:optimize-prompts <lessons-file> [--dry-run]

Agents

Agent	Purpose
model-evaluator	Parse sessions, calculate metrics, extract lessons
critics-reviewer	Validate scopes, check specificity, catch missed patterns
prompt-optimizer	Route lessons, optimize rules, write files

Skills

Skill	Purpose
wasteful-pattern-detection	Detect BDN, CIP, Verification Theater
scope-classification	Classify lessons into correct scopes
rule-optimization	Transform lessons into optimized rules

Wasteful Patterns Detected

Pattern	Description
BDN	Broad check → dismiss → narrow check
CIP	Check → ignore errors → proceed
Verification Theater	"verify" → errors → "looks good"
Redundant Tool Chains	Multiple tools when one suffices
Scope Overkill	Full suite for single file change

Dismissive Language Flagged

• "pre-existing errors" (Critical)
• "not related to my changes" (Critical)
• "already there" (Warning)
• "unrelated issues" (Warning)
• "I only changed X" (Warning)

Scope Routing

Scope	Target	Applies To
user-general	~/.claude/CLAUDE.md	Any project
cross-project-domain	~/.claude/rules/*.md	Framework-specific
project	project/CLAUDE.md	This project
domain	context/rules/*.md	Project domain

Pipeline Architecture