agent-smith

Agent Smith

"Never send a human to do a machine's job." Agent Smith, The Matrix (1999)

Clip on YouTube

Agent configuration is hard, fragile, and always changing. Agent Smith outsources that tuning work to your agent: it gathers empirical data from watching real sessions and recommends concrete changes to prompts, settings, and workflow.

Get a feedback loop based on how Claude Code, Codex, Gemini CLI, OpenCode, Pi, or Grok actually behave on your real work instead of guessing what might help.

Agent Smith:

• Collects hook and plugin telemetry from supported hosts
• Pulls the latest configuration schemas
• Emits events to a user-level SQLite database
• Generates agent-backed analysis reports by agent or project
• Helps apply safe config improvements and surfaces larger changes for review

Installation

Prerequisites

• Bun >=1.3.0
• jq
• sqlite3
• python3

Claude Code

claude plugins marketplace add chetmancini/agent-smith
claude plugins install agent-smith@agent-smith

Codex

Install from a local clone:

bun run ./agent-smith-app/src/cli.ts install-codex

Or:

make codex-install

Then:

1. Restart Codex.
2. Open the Plugin Directory.
3. Choose your personal marketplace.
4. Install Agent Smith.
5. Run make app-doctor.

The installer enables features.codex_hooks = true, links the plugin into ~/.codex/plugins/agent-smith, and configures the personal marketplace entry. The checkout still needs to stay trusted so Codex can load the repo-local .codex/hooks.json.

Gemini CLI

Gemini currently ships as a local-checkout hook extension:

gemini extensions link ./gemini-extension

This reuses the shared repo-root shell hooks and scripts.

OpenCode

Add Agent Smith to opencode.json:

{
  "$schema": "https://opencode.ai/config.json",
  "plugin": ["agent-smith-opencode"]
}

For a local checkout instead of the published package:

{
  "plugin": ["./path/to/agent-smith/opencode-plugin"]
}

Pi

Install from a local clone:

bun run ./agent-smith-app/src/cli.ts install-pi

Or:

make pi-install

Then:

1. Start a new Pi session.
2. Run make app-doctor.

The installer adds this checkout to ~/.pi/agent/settings.json so Pi can discover Agent Smith from any working directory. The installed package exposes:

• .pi/extensions/agent-smith/index.ts for telemetry and slash-command aliases
• commands/ as prompt templates
• skills/ as Agent Skills

Grok

Grok uses a plugin + project .grok/ files for hooks (telemetry) and skills (analysis commands).

Install from a local clone:

bun run ./agent-smith-app/src/cli.ts install-grok

Or:

make grok-install

Then:

1. Start (or restart) Grok sessions.
2. If hooks from this checkout are encountered for the first time, approve the trust prompt (or run /hooks-trust / use the hooks modal).
3. Run make app-doctor.

The installer runs grok plugin install ./grok-plugin --trust (or prints the equivalent if the grok binary is not on PATH). This registers:

• Hooks under the plugin for grok-scoped session/tool events (reusing the shared shell emitters).
• Bundled skills for /analyze-config, /upgrade-settings, etc. (also available via project .grok/skills/ when your working directory is inside this checkout).

The repo also provides .grok/hooks/hooks.json and .grok/skills/ directly for pure project-scoped use (no plugin registration required when cwd is the agent-smith tree).

Comparison Matrix

Workflow Surface

Surface	Claude Code	Gemini CLI	Codex	OpenCode	Pi	Grok
Install path in this repo	✓	✓	✓	✓	✓	✓
agent-smith doctor coverage	✓	✓	✓	✓	✓	✓
Slash commands	✓		✓	✓	✓	(skills)
Shared shell commands	✓	✓	✓	✓	✓	✓

Telemetry Surface

Feature	Claude Code	Gemini CLI	Codex	OpenCode	Pi	Grok
Session lifecycle	✓	✓	✓	✓	✓	✓
Bash failure tracking	✓	✓	✓	✓	✓	✓
Vague prompt guidance	✓	✓	✓	✓	✓	✓
Rollup and analysis	✓	✓	✓	✓	✓	✓
Schema validation	✓	✓	✓	✓	✓	(stub)
Tool failures	✓	✓		✓	✓	✓
Permission denials	✓	✓		✓		(via PreToolUse)
Permission grants				✓
Session errors				✓		✓ (Stop)
File-edited telemetry				✓		✓ (PostToolUse)
Context compression	✓	✓		✓	✓	✓ (PreCompact)
Edit-triggered test-loop detection	✓	✓		✓	✓	✓
Subagent lifecycle	✓	✓		✓		✓