truesight

Truesight MCP Skills

Agent skills and Cursor plugin for the Truesight MCP. Step-by-step workflow playbooks for scoring inputs, building live evaluations, error analysis, and the review loop.

Works with Claude Code, Cursor, and any client that supports the agent skills standard.

Install as a Claude plugin

In Claude Code, run:

# Step 1: Register this repository as a marketplace
/plugin marketplace add Goodeye-Labs/truesight-mcp-skills

# Step 2: Install the plugin
/plugin install truesight@goodeye-labs-truesight

This installs the Truesight plugin and its MCP skills in Claude, including truesight-workflows, create-evaluation, and companion workflow skills.

To upgrade:

/plugin update truesight@goodeye-labs-truesight

Install skills manually

If you installed via Claude Marketplace above, you can skip this. Use the manual commands below to install skill files directly (works with Claude Code, Cursor, and other clients).

Project-level (recommended for team workflows)

BASE=https://raw.githubusercontent.com/Goodeye-Labs/truesight-mcp-skills/main/skills
for skill in truesight-workflows evaluate-trace error-analysis generate-synthetic-data review-and-promote-traces bootstrap-template-evaluation create-evaluation eval-audit build-review-interface; do
  curl -fsSL "$BASE/$skill/SKILL.md" -o ".claude/skills/$skill/SKILL.md" --create-dirs
done

Global (available in all projects)

BASE=https://raw.githubusercontent.com/Goodeye-Labs/truesight-mcp-skills/main/skills
for skill in truesight-workflows evaluate-trace error-analysis generate-synthetic-data review-and-promote-traces bootstrap-template-evaluation create-evaluation eval-audit build-review-interface; do
  curl -fsSL "$BASE/$skill/SKILL.md" -o "$HOME/.claude/skills/$skill/SKILL.md" --create-dirs
done

Skills

Skill	What it does
truesight-workflows	Strict orchestrator that routes to the correct Truesight MCP skill based on user intent
generate-synthetic-data	Create diverse synthetic test inputs using dimension-based variation for evaluation bootstrapping
error-analysis	Analyze traces in datasets, label failure modes, consolidate categories, and prioritize fixes
bootstrap-template-evaluation	Provision a template dataset and deploy a live evaluation quickly
create-evaluation	Scope, build, and deploy new custom live evaluations from scratch
evaluate-trace	Evaluate one or more inputs against an existing live evaluation, with optional handoff to review flows
review-and-promote-traces	Review flagged traces, submit judgments, and promote judged items back to datasets
eval-audit	Audit evaluation workflow maturity and return severity-ranked findings with next-skill actions
build-review-interface	Build a custom web annotation interface when Truesight web UI is not the preferred review surface

Usage

Once the MCP is connected and skills are installed, your AI assistant will automatically pick up the right skill based on what you ask:

• "I need help choosing the right Truesight workflow": triggers truesight-workflows
• "Generate synthetic test data for my RAG pipeline": triggers generate-synthetic-data
• "Analyze the errors in my dataset": triggers error-analysis
• "Bootstrap a live eval from a template": triggers bootstrap-template-evaluation
• "Create an evaluation for response quality": triggers create-evaluation
• "Evaluate these traces against my live eval": triggers evaluate-trace
• "Review and promote these flagged results": triggers review-and-promote-traces
• "Audit my eval setup and tell me what is missing": triggers eval-audit
• "Help me build a custom annotation interface for trace review": triggers build-review-interface

Prerequisites

Some skills (like generate-synthetic-data and build-review-interface) work without any Truesight account. For skills that use the Truesight MCP, you need a free Truesight account. When prompted, sign in to authorize access. All tools are available based on your account permissions.

Want more control over permissions? You can also connect using a Platform API Key instead. See Connecting with an API key below.

Connect the MCP

Claude.ai and Claude Desktop