Ollama MCP server

Integrates Ollama's local LLM models with MCP-compatible applications, enabling on-premise AI processing and custom model deployment while maintaining data control.
Back to servers
Setup instructions
Provider
tigreen
Release date
Feb 13, 2025
Language
TypeScript
Package
Stats
2.3K downloads
98 stars

The Ollama MCP Server enables seamless integration between Ollama's local LLM models and MCP-compatible applications like Claude Desktop. It serves as a bridge that allows you to use your locally installed Ollama models with any application that supports the Model Context Protocol.

Prerequisites

  • Node.js (v16 or higher)
  • npm
  • Ollama installed and running locally

Installation Options

Global Installation

Install globally via npm:

npm install -g @rawveg/ollama-mcp

Installing in MCP Applications

To use Ollama MCP Server with other MCP-compatible applications (like Cline or Claude Desktop), add this configuration to your application's MCP settings file:

{
  "mcpServers": {
    "@rawveg/ollama-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@rawveg/ollama-mcp"
      ]
    }
  }
}

The settings file location varies by application:

  • Claude Desktop: claude_desktop_config.json in the Claude app data directory
  • Cline: cline_mcp_settings.json in the VS Code global storage

Running the Server

Start the server with:

ollama-mcp

The server will start on port 3456 by default. You can specify a different port using the PORT environment variable:

PORT=3457 ollama-mcp

Configuration

Environment Variables

Configure the server using these environment variables:

Example:

PORT=3457 OLLAMA_API=http://192.168.1.100:11434 ollama-mcp

Available Features

The Ollama MCP Server provides these capabilities:

  • List all available Ollama models
  • Pull new models from Ollama
  • Chat with models using Ollama's chat API
  • Get detailed model information
  • Automatic port management

API Endpoints

The server exposes these endpoints:

  • GET /models - List available models
  • POST /models/pull - Pull a new model
  • POST /chat - Chat with a model
  • GET /models/:name - Get model details

These endpoints allow MCP-compatible applications to interact with your local Ollama installation seamlessly.

How to install this MCP server

For Claude Code

To add this MCP server to Claude Code, run this command in your terminal:

claude mcp add-json "rawveg-ollama-mcp" '{"command":"npx","args":["-y","@rawveg/ollama-mcp"]}'

See the official Claude Code MCP documentation for more details.

For Cursor

There are two ways to add an MCP server to Cursor. The most common way is to add the server globally in the ~/.cursor/mcp.json file so that it is available in all of your projects.

If you only need the server in a single project, you can add it to the project instead by creating or adding it to the .cursor/mcp.json file.

Adding an MCP server to Cursor globally

To add a global MCP server go to Cursor Settings > Tools & Integrations and click "New MCP Server".

When you click that button the ~/.cursor/mcp.json file will be opened and you can add your server like this:

{
    "mcpServers": {
        "@rawveg/ollama-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "@rawveg/ollama-mcp"
            ]
        }
    }
}

Adding an MCP server to a project

To add an MCP server to a project you can create a new .cursor/mcp.json file or add it to the existing one. This will look exactly the same as the global MCP server example above.

How to use the MCP server

Once the server is installed, you might need to head back to Settings > MCP and click the refresh button.

The Cursor agent will then be able to see the available tools the added MCP server has available and will call them when it needs to.

You can also explicitly ask the agent to use the tool by mentioning the tool name and describing what the function does.

For Claude Desktop

To add this MCP server to Claude Desktop:

1. Find your configuration file:

  • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
  • Windows: %APPDATA%\Claude\claude_desktop_config.json
  • Linux: ~/.config/Claude/claude_desktop_config.json

2. Add this to your configuration file:

{
    "mcpServers": {
        "@rawveg/ollama-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "@rawveg/ollama-mcp"
            ]
        }
    }
}

3. Restart Claude Desktop for the changes to take effect

Want to 10x your AI skills?

Get a free account and learn to code + market your apps using AI (with or without vibes!).

Nah, maybe later