Diffie QA — Claude Code Skill
AI-powered E2E testing for Claude Code. Create tests, run them against real browsers, and get video recordings — all from natural language.
Install
/plugin marketplace add diffie-ai/diffie-skill
/plugin install diffie@diffie
What It Does
Diffie generates Playwright test code from plain English descriptions, runs tests in real browsers, and returns video recordings of every run.
Interactive mode — Create and manage tests from Claude Code:
> Create E2E tests for my app at https://myapp.com
The skill will:
- Ask about key user flows and credentials
- Scan your source code for selector hints (
data-testid, aria-label, etc.)
- Present a test plan for your approval
- Create, run, and manage tests via the Diffie API
PR testing mode — Comment /diffie test on any GitHub PR:
/diffie test
/diffie test https://pr-42-preview.vercel.app
The skill autonomously analyzes the PR diff, creates a test for the core user-facing change, runs it against the preview deployment, and posts the result with a recording link as a PR comment.
Setup
1. Authenticate
On first use, the skill opens a browser window for OAuth sign-in. Credentials are stored at ~/.diffie/credentials.json.
2. Set Up PR Testing (Optional)
> Set up Diffie PR testing for this repo
The skill will:
- Generate a
.github/workflows/diffie-qa.yml workflow file
- Ask for your preview deployment URL variable (e.g.,
${{ steps.vercel.outputs.url }})
- Guide you through adding
ANTHROPIC_API_KEY (or CLAUDE_CODE_OAUTH_TOKEN for Claude Max/Pro) and DIFFIE_API_TOKEN as GitHub repo secrets
After setup, /diffie test works on every PR.
Features
- Natural language tests — Describe what to test in plain English
- Selector hints — Automatically mines your source code for
data-testid, aria-label, and other selectors to improve test reliability
- Video recordings — Every test run produces a recording you can watch
- PR integration — Post test results and recordings directly on GitHub PRs
- Secrets management — Encrypted credential storage for login flows
- Test suites — Group tests and run them together
- Auto-fix — When tests fail, reprocess with fix instructions
Requirements
PR Testing Requirements
- Claude auth — set one of:
ANTHROPIC_API_KEY — Anthropic Console (pay-as-you-go API billing)CLAUDE_CODE_OAUTH_TOKEN — Claude Max/Pro subscribers can generate one by running claude setup-token locally
DIFFIE_API_TOKEN — Diffie Settings or from ~/.diffie/credentials.json- Preview deployments (Vercel, Netlify, etc.) or a staging URL
Commands
| Command | Description |
|---|
Create tests for my app | Interactive test creation with approval flow |
Run my tests | Run existing tests or suites |
Check test status | Get latest run results |
Set up PR testing | Generate GitHub Action workflow for /diffie test |
/diffie test | (On PR) Autonomous E2E test from PR diff |
/diffie test <url> | (On PR) Same, with explicit preview URL |
How PR Testing Works
- Someone comments
/diffie test on a GitHub PR
- A GitHub Action runs Claude Code with this skill
- The skill reads the PR diff and changed files to understand what feature was built
- It creates an E2E test and sends it to Diffie
- Diffie runs the test in a real browser against the preview deployment
- The skill posts the result on the PR — pass/fail, error details, and a link to watch the recording
- On re-trigger, it updates the same comment instead of posting a new one
- If the changes don't affect any user-facing flow, it posts a comment saying no test is applicable
Links
Anasss
WaterplanAI
rohitg00
jeremylongshore
ArogyaReddy
desplega-ai