Tavily Extract MCP server

Integrates with the Tavily API to extract web page content, enabling efficient web scraping capabilities for projects requiring content extraction.
Back to servers
Provider
Eric Julianto
Release date
Mar 06, 2025
Language
Python

This MCP server provides web page extraction capability using the Tavily API. It allows clients to extract and process content from web pages through a simple interface.

Installation Requirements

Before using this MCP server, ensure you have the following prerequisites in place:

  • Python installed on your system
  • The uv package runner
  • A Tavily API key

Setting Up Environment Variables

Create a .env file in the project directory and add your Tavily API key:

TAVILY_API_KEY=your_api_key_here

Configuration

To use this MCP server, you need to add its configuration to your MCP config file:

{
  "mcpServers": {
    "tavily_extract": {
      "command": "uv",
      "args": [
        "--directory",
        "%USERPROFILE%/Documents/GitHub/mcp-tavily-extract",
        "run",
        "python",
        "main.py"
      ]
    }
  }
}

Note: The path specified in the configuration may need to be adjusted based on where you've placed the mcp-tavily-extract directory on your system.

Using the Web Page Extraction

Once configured, you can use the MCP server to extract content from web pages by making appropriate requests through your MCP client. The server will connect to the Tavily API using your provided API key and return the extracted content.

Example Usage

Your MCP client code can call the server with a URL to extract its content. The specific client syntax will depend on your MCP client implementation.

Troubleshooting

If you encounter any issues:

  • Verify that your Tavily API key is correctly set in the .env file
  • Ensure the path in the configuration matches the actual location of the project
  • Check that you have the proper permissions to execute the Python script

How to add this MCP server to Cursor

There are two ways to add an MCP server to Cursor. The most common way is to add the server globally in the ~/.cursor/mcp.json file so that it is available in all of your projects.

If you only need the server in a single project, you can add it to the project instead by creating or adding it to the .cursor/mcp.json file.

Adding an MCP server to Cursor globally

To add a global MCP server go to Cursor Settings > MCP and click "Add new global MCP server".

When you click that button the ~/.cursor/mcp.json file will be opened and you can add your server like this:

{
    "mcpServers": {
        "cursor-rules-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "cursor-rules-mcp"
            ]
        }
    }
}

Adding an MCP server to a project

To add an MCP server to a project you can create a new .cursor/mcp.json file or add it to the existing one. This will look exactly the same as the global MCP server example above.

How to use the MCP server

Once the server is installed, you might need to head back to Settings > MCP and click the refresh button.

The Cursor agent will then be able to see the available tools the added MCP server has available and will call them when it needs to.

You can also explictly ask the agent to use the tool by mentioning the tool name and describing what the function does.

Want to 10x your AI skills?

Get a free account and learn to code + market your apps using AI (with or without vibes!).

Nah, maybe later