MCP DeepInfra AI Tools Server

This is a Model Context Protocol (MCP) server that provides various AI capabilities using the DeepInfra OpenAI-compatible API, including image generation, text processing, embeddings, speech recognition, and more.

Project Structure

mcp-deepinfra/
 src/
    mcp_deepinfra/
        __init__.py      # Package initialization
        server.py        # Main MCP server implementation
 tests/
    conftest.py          # Pytest fixtures and configuration
    test_server.py      # Server initialization tests
    test_tools.py        # Individual tool tests
 pyproject.toml           # Project configuration and dependencies
 uv.lock                  # Lock file for uv package manager
 run_tests.sh             # Convenience script for running tests
 README.md               # This file

Setup

1. Install uv if not already installed:

   curl -LsSf https://astral.sh/uv/install.sh | sh
   

2. Clone or download this repository.

3. Install dependencies:

   uv sync
   

4. Set up your DeepInfra API key:
   Create a .env file in the project root:

   DEEPINFRA_API_KEY=your_api_key_here
   

Configuration

You can configure which tools are enabled and set default models for each tool using environment variables in your .env file:

• ENABLED_TOOLS: Comma-separated list of tools to enable. Use "all" to enable all tools (default: "all"). Example: ENABLED_TOOLS=generate_image,text_generation,embeddings

• MODEL_GENERATE_IMAGE: Default model for image generation (default: "Bria/Bria-3.2")

• MODEL_TEXT_GENERATION: Default model for text generation (default: "meta-llama/Llama-2-7b-chat-hf")

• MODEL_EMBEDDINGS: Default model for embeddings (default: "sentence-transformers/all-MiniLM-L6-v2")

• MODEL_SPEECH_RECOGNITION: Default model for speech recognition (default: "openai/whisper-large-v3")

• MODEL_ZERO_SHOT_IMAGE_CLASSIFICATION: Default model for zero-shot image classification (default: "openai/gpt-4o-mini")

• MODEL_OBJECT_DETECTION: Default model for object detection (default: "openai/gpt-4o-mini")

• MODEL_IMAGE_CLASSIFICATION: Default model for image classification (default: "openai/gpt-4o-mini")

• MODEL_TEXT_CLASSIFICATION: Default model for text classification (default: "microsoft/DialoGPT-medium")

• MODEL_TOKEN_CLASSIFICATION: Default model for token classification (default: "microsoft/DialoGPT-medium")

• MODEL_FILL_MASK: Default model for fill mask (default: "microsoft/DialoGPT-medium")

The tools always use the models specified via environment variables. Model selection is configured at startup time through the environment variables listed above.

Running the Server

To run the server locally:

uv run mcp_deepinfra

Or directly with Python:

python -m mcp_deepinfra.server

Using with MCP Clients

Configure your MCP client (e.g., Claude Desktop) to use this server.

For Claude Desktop, add to your claude_desktop_config.json:

{
  "mcpServers": {
    "deepinfra": {
      "command": "uv",
      "args": ["run", "mcp_deepinfra"],
      "env": {
        "DEEPINFRA_API_KEY": "your_api_key_here"
      }
    }
  }
}

Tools Provided

This server provides the following MCP tools:

• generate_image: Generate an image from a text prompt. Returns the URL of the generated image.
• text_generation: Generate text completion from a prompt.
• embeddings: Generate embeddings for a list of input texts.
• speech_recognition: Transcribe audio from a URL to text using Whisper model.
• zero_shot_image_classification: Classify an image into provided candidate labels using vision model.
• object_detection: Detect and describe objects in an image using multimodal model.
• image_classification: Classify and describe contents of an image using multimodal model.
• text_classification: Analyze text for sentiment and category.
• token_classification: Perform named entity recognition (NER) on text.
• fill_mask: Fill masked tokens in text with appropriate words.

Testing

To test the server locally, run the pytest test suite:

# Install test dependencies
uv sync --extra test

# Run all tests
pytest

# Run with verbose output
pytest -v

# Run specific test file
pytest tests/test_tools.py

# Use the convenience script
./run_tests.sh

The tests include:

• Server initialization and tool listing
• Individual tool functionality tests via JSON-RPC protocol
• All tests run synchronously without async/await complexity

Running with uvx

uvx is designed for running published Python packages from PyPI or GitHub. For local development, use the uv run command as described above.

If you publish this package to PyPI (e.g., as mcp-deepinfra), you can run it with:

uvx mcp-deepinfra

And configure your MCP client to use:

{
  "mcpServers": {
    "deepinfra": {
      "command": "uvx",
      "args": ["mcp-deepinfra"],
      "env": {
        "DEEPINFRA_API_KEY": "your_api_key_here"
      }
    }
  }
}

For local development, stick with the uv run approach.