Dataproc Agent Skills
[!NOTE]
Currently in beta (pre-v1.0), and may see breaking changes until the first stable release (v1.0).
This repository provides a set of agent skills to interact with Dataproc clusters and jobs. These skills can be used with various AI agents, including Antigravity, Claude Code and Codex, to manage your clusters, monitor jobs, and troubleshoot issues using natural language prompts.
[!IMPORTANT]
We Want Your Feedback!
Please share your thoughts with us by filling out our feedback form.
Your input is invaluable and helps us improve the project for everyone.
Table of Contents
Why Use Dataproc Agent Skills?
- Seamless Workflow: Integrates seamlessly into your AI agent's environment. No need to constantly switch contexts for common Dataproc tasks.
- Natural Language Queries: Stop wrestling with complex gcloud commands. Manage your clusters and jobs by describing what you want in plain English.
- Full Lifecycle Control: Manage the entire lifecycle of your Dataproc resources, from listing clusters to checking job statuses.
Prerequisites
Before you begin, ensure you have the following:
- One of these AI agents installed
- A Google Cloud project with the Dataproc API enabled.
- Ensure Application Default Credentials are available in your environment.
- IAM Permissions:
- Dataproc Viewer (
roles/dataproc.viewer) or Dataproc Editor (roles/dataproc.editor)
Getting Started
Configuration
Please keep these env vars handy during the installation process:
DATAPROC_PROJECT: The GCP project ID.DATAPROC_REGION: The region of your Dataproc resources.
[!NOTE]
- Ensure Application Default Credentials are available in your environment.
- If your Cloud SQL for PostgreSQL instance uses private IPs, you must run your agent in the same Virtual Private Cloud (VPC) network.
Installation & Usage
To start interacting with Dataproc, install the skills for your preferred AI agent, then launch the agent and use natural language to ask questions or perform tasks.
For the latest version, check the releases page.
Antigravity
You can use either of these two agents for Antigravity:
💡 Tip — Migrating from Gemini CLI?
If you previously installed this extension with gemini extensions install, you can convert it to an Antigravity plugin instead of reinstalling from scratch:
- On first launch of Antigravity CLI, accept the Migration Options prompt to automatically convert your installed Gemini CLI extensions to Antigravity plugins.
- Or, from your terminal, run:
agy plugin import gemini
See Migrating from Gemini CLI for details on plugins, context files (GEMINI.md / AGENTS.md), and MCP server config differences.
Antigravity 2.0 (IDE)
1. Clone the Repo:
git clone --branch 0.1.0 https://github.com/gemini-cli-extensions/dataproc.git
2. Install the skills:
Choose a location for the skills:
- Global (all workspaces):
~/.gemini/antigravity/skills/
- Workspace-specific:
<workspace-root>/.agents/skills/
