This MCP server provides web page extraction capability using the Tavily API. It allows clients to extract and process content from web pages through a simple interface.
Before using this MCP server, ensure you have the following prerequisites in place:
uv
package runnerCreate a .env
file in the project directory and add your Tavily API key:
TAVILY_API_KEY=your_api_key_here
To use this MCP server, you need to add its configuration to your MCP config file:
{
"mcpServers": {
"tavily_extract": {
"command": "uv",
"args": [
"--directory",
"%USERPROFILE%/Documents/GitHub/mcp-tavily-extract",
"run",
"python",
"main.py"
]
}
}
}
Note: The path specified in the configuration may need to be adjusted based on where you've placed the mcp-tavily-extract
directory on your system.
Once configured, you can use the MCP server to extract content from web pages by making appropriate requests through your MCP client. The server will connect to the Tavily API using your provided API key and return the extracted content.
Your MCP client code can call the server with a URL to extract its content. The specific client syntax will depend on your MCP client implementation.
If you encounter any issues:
.env
fileThere are two ways to add an MCP server to Cursor. The most common way is to add the server globally in the ~/.cursor/mcp.json
file so that it is available in all of your projects.
If you only need the server in a single project, you can add it to the project instead by creating or adding it to the .cursor/mcp.json
file.
To add a global MCP server go to Cursor Settings > MCP and click "Add new global MCP server".
When you click that button the ~/.cursor/mcp.json
file will be opened and you can add your server like this:
{
"mcpServers": {
"cursor-rules-mcp": {
"command": "npx",
"args": [
"-y",
"cursor-rules-mcp"
]
}
}
}
To add an MCP server to a project you can create a new .cursor/mcp.json
file or add it to the existing one. This will look exactly the same as the global MCP server example above.
Once the server is installed, you might need to head back to Settings > MCP and click the refresh button.
The Cursor agent will then be able to see the available tools the added MCP server has available and will call them when it needs to.
You can also explictly ask the agent to use the tool by mentioning the tool name and describing what the function does.