Kafka plugins

Build production-ready data pipelines with Apache Airflow and dbt, manage scalable data warehouses, and implement vector search and RAG systems using embedding models and vector databases.

Delegate complex data engineering, ML, and AI workflows to specialized sub-agents that design scalable pipelines, build and optimize models, architect LLM systems, tune databases for performance, and deploy production infrastructure across clouds.

Implement Domain-Driven Design with tactical patterns (aggregates, entities, value objects), CQRS, event sourcing, and saga orchestration. Design bounded contexts, map integration contracts, and build event stores with read models for scalable, event-driven systems.

Create and repair Redpanda Connect pipeline configurations and Bloblang transformation scripts using natural language. Automates component search, config generation, and script debugging with optional sample data validation.

Develop and manage end-to-end Databricks workflows: data engineering with Spark, Delta, Iceberg, and streaming; build and deploy ML models and GenAI agents; create dashboards, apps, and CI/CD bundles; query Unity Catalog and manage infrastructure via SDK/CLI operations.

Provides 193+ expert skills for every major Azure service—compute, data, AI/ML, networking, security, and management—delivering troubleshooting, architecture guidance, deployment patterns, and best practices directly in your development workflow.

Full-stack security engineering with code and infrastructure auditing, threat modeling, multi-agent adversarial reviews, OWASP scanning, and Kubernetes/cloud hardening. Covers architecture design, DevOps pipelines, data processing, mobile, document automation, and frontend styling. Includes 6 output personae for mentor, scholarly, or conversational responses.

Interactively select architecture paradigms for software systems via scenario matching, compare trade-offs for team size and complexity, generate ADRs, and receive tailored implementation plans with steps, deliverables, risks, and mitigations for client-server, CQRS, event-driven, hexagonal, microservices, and more.

Connect to MongoDB databases, explore schemas, generate queries and aggregation pipelines from natural language, analyze query performance with index recommendations, implement Atlas Search and Vector Search, and manage stream processing workflows — all from within Claude.

Accelerate Spring Boot development with code generation for REST controllers, DTOs, MapStruct mappers, Spring Security configs, Kafka integration, and entity-to-DTO mapping. Includes structured implementation planning and Connekt-based API testing.

Delegate data engineering to AI agents that design ETL/ELT pipelines with orchestration via Airflow, Prefect, or Dagster; engineer data warehouses with star schemas, partitioning, and query optimization; and build streaming systems using Kafka, Flink, or Spark Streaming for real-time processing and monitoring.

Design scalable distributed systems architectures for APIs, data pipelines, ML/RAG, edge/CDN, chaos engineering, and observability; review for security, resilience, performance, and quality attributes; simulate mock system design interviews with feedback.

Audit, review, and manage Apache Kafka clusters using the Lenses MCP server. Diagnose consumer lag, review connector configurations, schema compatibility, security settings, and dead letter queues. Scaffold Python Kafka producers/consumers and generate synthetic data tests with ShadowTraffic and TestContainers.

Design contract-first APIs via OpenAPI 3.1, AsyncAPI 3.0, and Protocol Buffers from natural language requirements. Author formal specifications for systems, algorithms, and behaviors using TLA+, SysML, UML diagrams, state machines in Mermaid/PlantUML, and Use Case 2.0 templates for verification and modeling workflows.

Author, convert between, validate, refine, and audit specifications using EARS, Gherkin, Kiro, and user story formats. Generate ADRs, implementation plans, and run GitHub SpecKit's 5-phase workflow from constitution to implementation for spec-driven development.

Design and implement data foundations for financial systems: reference and market data management, integration architectures with REST APIs, WebSockets, gRPC, Kafka, FIX protocol, ISO 20022, batch feeds; plus data quality programs with validation, lineage, governance for regulatory compliance like BCBS 239 and MiFID II.

Delegate SDLC workflows to specialist AI agents that architect cloud-native systems, design databases, conduct deep web research, optimize performance and observability, distill repo knowledge, and build production agents via orchestrated pipelines.

Review Spring Boot codebases using skill detection and parallel agents for DDD patterns, security, testing, observability, and Modulith modules. Verify upgrades to Spring Boot 4 with multi-phase analysis producing severity-categorized migration checklists and remediation steps. Implement data layers, REST APIs, and configurations via guided skills.

Guides building Go event-driven microservices with the xgodev/boost framework: boot sequence, config, logging, caching, and factories for Kafka, NATS, Pub/Sub, MongoDB, Redis, Elasticsearch, AWS, gRPC, and more.

Design optimized message queue systems for Kafka, RabbitMQ, SQS using queue theory for throughput and latency. Implement async processing with workers, retries, backoff; manage backpressure via circuit breakers, rate limiting; architect distributed systems with consensus like Raft, CAP theorem, fault tolerance.

Process and transform data using jq, SQL, or pandas; design ETL/ELT pipelines for batch or streaming; perform time series forecasting, anomaly detection, and analytics; architect streaming systems with Kafka; generate insights and visualizations via natural language commands and specialist agents.

Develop and operate Camunda 8 automations end-to-end: author BPMN processes, DMN decisions, FEEL expressions, and Camunda Forms; build custom connectors and job workers; deploy resources to clusters, manage live process instances, and validate with Process Test coverage reports — all with CLI support for installation, configuration, and vector-search documentation lookup.

Run comprehensive multi-dimensional code reviews across architecture, security, performance, and best practices, generating structured reports and enhanced PR descriptions from git changes

Reverse engineer unfamiliar codebases by running unwind:start to orchestrate layer-by-layer analysis from database schemas and domain models to services, APIs, frontend routes, messaging, and tests, generating structured Markdown docs in docs/unwind/layers/, detecting gaps in coverage, and producing architecture summaries plus rebuild plans.

Multi-source research and technical learning from PDFs, URLs, GitHub repos, and YouTube videos with structured note generation, first-principles Socratic study sessions, Docker Compose lab environments, daily spaced-repetition quizzes via Slack, and technical blog writing with Notion integration.