DocsScraper MCP server

DocsScraper MCP Server provides semantic search capabilities for documentation through integration with the DocsScraper web API. It allows you to search through documentation chunks using AI-powered semantic search, making it easier to find relevant information across various services and documentation sources.

Features

• Semantic Search: Search documentation chunks using embeddings and AI validation
• API Integration: Connects to DocsScraper web application via REST API
• Fallback Sources: Automatically falls back to scraper sources when no local results are found
• Configurable Results: Control the number of search results (1-10, default: 5)
• Service Filtering: Filter search results by specific service names (case-insensitive)

Installation

To install the DocsScraper MCP Server:

npm install
npm run build

Configuration

The server requires the following environment variables:

• DOCS_SCRAPER_API_KEY: API key for authentication (required)
• DOCS_SCRAPER_BASE_URL: Base URL for the DocsScraper API (optional)

MCP Configuration

Add the following configuration to your mcp.json file:

{
  "mcpServers": {
    "docs-scraper": {
      "command": "node",
      "args": [
        "/path/to/docs-scraper-server/build/index.js"
      ],
      "env": {
        "DOCS_SCRAPER_API_KEY": "your-api-key-here",
        "DOCS_SCRAPER_BASE_URL": "https://api.mcpdocsscraper.click"
      },
      "disabled": false,
      "alwaysAllow": [
        "search_docs"
      ],
      "timeout": 900
    }
  }
}

Usage

Searching Documentation

The primary tool provided by this MCP server is search_docs, which allows you to search through documentation chunks semantically.

Parameters:

• query (string, required): The search query to find relevant documentation
• top (number, optional): Maximum number of results to return (1-10, default: 5)
• service (string, required): Service name to filter results by (case-insensitive)

Examples:

Example 1: Searching for authentication configuration in Binance documentation:

{
  "query": "how to configure authentication",
  "service": "Binance",
  "top": 3
}

Example 2: Finding React hooks documentation:

{
  "query": "React hooks documentation",
  "top": 5,
  "service": "React"
}

API Information

You can access information about the connected DocsScraper API through the docs-scraper://api/info resource. This provides details about:

• Base URL configuration
• API key status
• Endpoint details
• Authentication method

Error Handling

The server provides detailed error messages for common issues:

• Authentication failures (401): Check your API key
• Invalid requests (400): Verify the format of your query
• Connection issues (ECONNREFUSED): Ensure the DocsScraper API is accessible

How to install this MCP server

For Claude Code

To add this MCP server to Claude Code, run this command in your terminal:

claude mcp add-json "docs-scraper" '{"command":"node","args":["/Users/tanevanwifferen/Documents/Cline/MCP/docs-scraper-server/build/index.js"],"env":{"DOCS_SCRAPER_API_KEY":"###","DOCS_SCRAPER_BASE_URL":"https://api.mcpdocsscraper.click"},"disabled":false,"alwaysAllow":["search_docs"],"timeout":900}'

See the official Claude Code MCP documentation for more details.

For Cursor

There are two ways to add an MCP server to Cursor. The most common way is to add the server globally in the ~/.cursor/mcp.json file so that it is available in all of your projects.

If you only need the server in a single project, you can add it to the project instead by creating or adding it to the .cursor/mcp.json file.

Adding an MCP server to Cursor globally

To add a global MCP server go to Cursor Settings > Tools & Integrations and click "New MCP Server".

When you click that button the ~/.cursor/mcp.json file will be opened and you can add your server like this:

{
    "mcpServers": {
        "docs-scraper": {
            "command": "node",
            "args": [
                "/Users/tanevanwifferen/Documents/Cline/MCP/docs-scraper-server/build/index.js"
            ],
            "env": {
                "DOCS_SCRAPER_API_KEY": "###",
                "DOCS_SCRAPER_BASE_URL": "https://api.mcpdocsscraper.click"
            },
            "disabled": false,
            "alwaysAllow": [
                "search_docs"
            ],
            "timeout": 900
        }
    }
}

Adding an MCP server to a project

To add an MCP server to a project you can create a new .cursor/mcp.json file or add it to the existing one. This will look exactly the same as the global MCP server example above.

How to use the MCP server

Once the server is installed, you might need to head back to Settings > MCP and click the refresh button.

The Cursor agent will then be able to see the available tools the added MCP server has available and will call them when it needs to.

You can also explicitly ask the agent to use the tool by mentioning the tool name and describing what the function does.

For Claude Desktop

To add this MCP server to Claude Desktop:

1. Find your configuration file:

• macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
• Windows: %APPDATA%\Claude\claude_desktop_config.json
• Linux: ~/.config/Claude/claude_desktop_config.json

2. Add this to your configuration file:

{
    "mcpServers": {
        "docs-scraper": {
            "command": "node",
            "args": [
                "/Users/tanevanwifferen/Documents/Cline/MCP/docs-scraper-server/build/index.js"
            ],
            "env": {
                "DOCS_SCRAPER_API_KEY": "###",
                "DOCS_SCRAPER_BASE_URL": "https://api.mcpdocsscraper.click"
            },
            "disabled": false,
            "alwaysAllow": [
                "search_docs"
            ],
            "timeout": 900
        }
    }
}

3. Restart Claude Desktop for the changes to take effect