Test API Keys Against AI Universe Repository

Test API Keys Against AI Universe Repository

This skill provides a script to test API keys from your .bashrc against the actual services used by the jleechanorg/ai_universe repository.

Overview

The script:

• Clones the ai_universe repository to /tmp
• Tests API keys against the actual API endpoints used by the repo
• Validates GitHub access to the repository
• Tests LLM API keys (Gemini, OpenAI, Anthropic, Perplexity, OpenRouter)
• Provides a summary of test results

Prerequisites

• curl installed (usually pre-installed on macOS/Linux)
• git installed
• API keys configured in ~/.bashrc
• Internet connection

Usage

Basic Usage

# Run the test script
bash /tmp/test_ai_universe_api_keys.sh

The script will:

1. Load API keys from ~/.bashrc
2. Clone the ai_universe repository to /tmp/ai_universe_api_test_*/
3. Test each API key against its respective service
4. Display results and cleanup temporary files

What Gets Tested

The script tests the following API keys (loaded from ~/.bashrc):

API Key	Service	Purpose in AI Universe
GITHUB_TOKEN	GitHub API	Repository access and authentication
GEMINI_API_KEY	Google Gemini	Primary AI model for game master
OPENAI_API_KEY	OpenAI	Multi-model synthesis
ANTHROPIC_API_KEY	Anthropic Claude	Multi-model synthesis
PERPLEXITY_API_KEY	Perplexity	Multi-model synthesis
OPENROUTER_API_KEY	OpenRouter	Multi-model synthesis

Expected Output

========================================
AI Universe API Key Testing
========================================

Loading API keys from ~/.bashrc...
Cloning ai_universe repository...
✅ Repository cloned successfully

Checking API key usage in repository...
✅ Found API key references in:
  - backend/server.py
  - frontend/src/services/ai.ts

Testing API keys...

Testing GitHub repo access...
✅ GitHub token valid - Can access repo: jleechanorg/ai_universe

Testing Gemini API...
✅ Gemini API key valid - Can list models

Testing OpenAI API...
✅ OpenAI API key valid

Testing Anthropic API...
✅ Anthropic API key valid

Testing Perplexity API...
✅ Perplexity API key valid

Testing OpenRouter API...
✅ OpenRouter API key valid

========================================
Test Summary
========================================
Passed: 6
Failed: 0
Total: 6

✅ All API keys are valid!

Troubleshooting

Script Not Found

If the script doesn't exist at /tmp/test_ai_universe_api_keys.sh, you can recreate it:

# The script is created automatically, but if needed, you can ask Claude to recreate it
# or copy it from the project documentation

API Keys Not Found

If you see "❌ API_KEY not set" errors:

1. Verify keys are in .bashrc:

   grep -E "export (GITHUB_TOKEN|GEMINI_API_KEY|OPENAI_API_KEY|ANTHROPIC_API_KEY|PERPLEXITY_API_KEY|OPENROUTER_API_KEY)=" ~/.bashrc
   

2. Reload your shell:

   source ~/.bashrc
   

3. Check key format:

   • Keys should be exported with export KEY_NAME="value"
   • No spaces around the = sign
   • Quotes are optional but recommended

GitHub Access Denied

If GitHub token test fails:

1. Check token permissions:

   • Token needs repo scope for private repositories
   • Token needs read:org for organization repositories

2. Verify token is valid:

   curl -H "Authorization: Bearer $GITHUB_TOKEN" \
        https://api.github.com/user
   

3. Regenerate token if needed:

   • Go to https://github.com/settings/tokens
   • Create new token with appropriate scopes

API Key Invalid Errors

If an API key test fails:

1. Check the key value:

   echo $GEMINI_API_KEY  # Replace with the failing key name
   

2. Verify key hasn't expired:

   • Some API keys have expiration dates
   • Check your account dashboard for the service

3. Check quota/credits:

   • Some services may show "valid" but have no credits
   • Check your account balance

Repository Clone Fails

If the repository clone fails:

1. Check network connectivity:

   ping github.com
   

2. Verify repository exists:

   curl -I https://github.com/jleechanorg/ai_universe
   

3. Check GitHub access:

   • Repository might be private
   • Your GitHub token needs appropriate permissions

Integration with Other Tools

Use with CI/CD

You can integrate this script into CI/CD pipelines:

# Example GitHub Actions workflow
- name: Test API Keys
  run: |
    bash /tmp/test_ai_universe_api_keys.sh
  env:
    GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
    GEMINI_API_KEY: ${{ secrets.GEMINI_API_KEY }}
    # ... other keys

Use with Monitoring

Set up a cron job to test keys periodically:

# Add to crontab (crontab -e)
# Test API keys daily at 2 AM
0 2 * * * bash /tmp/test_ai_universe_api_keys.sh >> /tmp/api_key_test.log 2>&1

Security Notes

• Temporary Files: The script creates temporary directories in /tmp/ that are automatically cleaned up
• API Keys: Keys are loaded from ~/.bashrc but not logged or stored
• Repository: Only clones the repository temporarily for analysis
• Network: Makes API calls to validate keys - ensure you're on a secure network

Related Skills

• ai-universe-auth.md - Authentication setup for AI Universe MCP server
• ai-universe-httpie.md - Using HTTPie with AI Universe APIs
• gcp-deployment.md - GCP deployment and service management

Script Location

The script is located at:

• Path: /tmp/test_ai_universe_api_keys.sh
• Working Directory: /tmp/ai_universe_api_test_*/ (temporary, auto-cleaned)
• Repository Clone: /tmp/ai_universe_api_test_*/ai_universe/ (temporary)

Maintenance

The script is automatically maintained and can be recreated if needed. To update:

1. Ask Claude to recreate the script
2. Or modify the script directly at /tmp/test_ai_universe_api_keys.sh

Example Workflow

# 1. Test all API keys
bash /tmp/test_ai_universe_api_keys.sh

# 2. If GitHub fails, check token
curl -H "Authorization: Bearer $GITHUB_TOKEN" https://api.github.com/user

# 3. If Gemini fails, test directly
curl "https://generativelanguage.googleapis.com/v1beta/models?key=$GEMINI_API_KEY"

# 4. Fix any issues and re-run
bash /tmp/test_ai_universe_api_keys.sh