Website Downloader MCP server

This MCP server enables you to download entire websites, including resources like CSS and images, while preserving the site structure and ensuring local links work properly. The tool uses wget under the hood to handle the downloading process.

Prerequisites

Before using this server, you need to have wget installed on your system.

Installing wget

macOS

Using Homebrew:

brew install wget

Linux (Debian/Ubuntu)

sudo apt-get update
sudo apt-get install wget

Linux (Red Hat/Fedora)

sudo dnf install wget

Windows

Using Chocolatey:

choco install wget

Alternatively, download the binary:

1. Go to https://eternallybored.org/misc/wget/
2. Download the latest wget.exe
3. Place it in a directory that's in your PATH (e.g., C:\Windows\System32)

Installation

To install the Website Downloader MCP server:

npm install
npm run build

After building, you need to add the server to your MCP settings:

{
  "mcpServers": {
    "website-downloader": {
      "command": "node",
      "args": ["/path/to/website-downloader/build/index.js"]
    }
  }
}

Usage

The server provides a tool called download_website with the following parameters:

• url (required): The URL of the website to download
• outputPath (optional): The directory where the website should be downloaded (defaults to current directory)
• depth (optional): Maximum depth level for recursive downloading (defaults to infinite)

Example

Here's an example of how to use the server:

{
  "url": "https://example.com",
  "outputPath": "/path/to/output",
  "depth": 2
}

In this example:

• The entire example.com website will be downloaded
• Files will be saved to /path/to/output
• The download will go 2 levels deep (the main page plus links from it)

Features

The website downloader includes several helpful features:

• Recursive downloading: Gets not just the main page but also linked pages
• Complete resources: Downloads all page requirements like CSS, images, etc.
• Local navigation: Converts links to work properly when viewed locally
• Proper file extensions: Adds appropriate extensions to downloaded files
• Domain restriction: Only downloads content from the specified domain
• Structure preservation: Maintains the original website's folder structure

How to install this MCP server

For Claude Code

To add this MCP server to Claude Code, run this command in your terminal:

claude mcp add-json "website-downloader" '{"command":"node","args":["/path/to/website-downloader/build/index.js"]}'

See the official Claude Code MCP documentation for more details.

For Cursor

There are two ways to add an MCP server to Cursor. The most common way is to add the server globally in the ~/.cursor/mcp.json file so that it is available in all of your projects.

If you only need the server in a single project, you can add it to the project instead by creating or adding it to the .cursor/mcp.json file.

Adding an MCP server to Cursor globally

To add a global MCP server go to Cursor Settings > Tools & Integrations and click "New MCP Server".

When you click that button the ~/.cursor/mcp.json file will be opened and you can add your server like this:

{
    "mcpServers": {
        "website-downloader": {
            "command": "node",
            "args": [
                "/path/to/website-downloader/build/index.js"
            ]
        }
    }
}

Adding an MCP server to a project

To add an MCP server to a project you can create a new .cursor/mcp.json file or add it to the existing one. This will look exactly the same as the global MCP server example above.

How to use the MCP server

Once the server is installed, you might need to head back to Settings > MCP and click the refresh button.

The Cursor agent will then be able to see the available tools the added MCP server has available and will call them when it needs to.

You can also explicitly ask the agent to use the tool by mentioning the tool name and describing what the function does.

For Claude Desktop

To add this MCP server to Claude Desktop:

1. Find your configuration file:

• macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
• Windows: %APPDATA%\Claude\claude_desktop_config.json
• Linux: ~/.config/Claude/claude_desktop_config.json

2. Add this to your configuration file:

{
    "mcpServers": {
        "website-downloader": {
            "command": "node",
            "args": [
                "/path/to/website-downloader/build/index.js"
            ]
        }
    }
}

3. Restart Claude Desktop for the changes to take effect