home / mcp / mcp llms.txt explorer mcp server

MCP LLMS.txt Explorer MCP Server

MCP to explore websites with llms.txt files

Installation

Add the following to your MCP client configuration file.

Configuration

{
  "mcpServers": {
    "thedaviddias-mcp-llms-txt-explorer": {
      "command": "node",
      "args": [
        "/path/to/llms-txt-explorer/build/index.js"
      ]
    }
  }
}

You can run a MCP server to explore and interact with websites that implement the llms.txt standard. This server lets you discover which sites have llms.txt or llms-full.txt, validate their contents, and access structured data about compliant websites, all through standard MCP client interactions.

How to use

You will connect a MCP client (such as Claude Desktop or another compatible tool) to one or more MCP servers configured to run locally or remotely. Use the available start commands to launch the server, then point your MCP client to the server by using its command and arguments. You can either run the server locally with a Node runtime or invoke it via a package runner like npx to start a lightweight instance.

How to install

Prerequisites you need before installation: a current Node.js runtime installed on your system and a package manager such as npm or pnpm available in your environment.

Option 1: Install via an inline MCP runner (Node-based start)

# Start or install as a local server via Node
# Example assumes you have the built project at the given path
node /path/to/llms-txt-explorer/build/index.js

Option 2: Install and run via npx (no local install required)

pnpm install -g pnpm
pnpm install
pnpm run build

# Or, to run directly via npx when you want a quick start
npx -y @thedaviddias/mcp-llms-txt-explorer

Configuration for MCP clients

Configure your MCP client to connect to one of the available server entry points. The following examples show two valid ways to start and expose the MCP server. Use the first for a local file-based start and the second if you prefer an on-demand NPX-based start.

{
  "mcpServers": {
    "llms_txt_explorer": {
      "command": "node",
      "args": ["/path/to/llms-txt-explorer/build/index.js"]
    },
    "llms_txt_explorer_npx": {
      "command": "npx",
      "args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
    }
  }
}

Additional sections

Configuration with Claude Desktop: to use with Claude Desktop, add the server config to your Claude Desktop configuration file. The file path varies by operating system. For MacOS, place the configuration under ~/Library/Application Support/Claude/claude_desktop_config.json. For Windows, place it under %APPDATA%/Claude/claude_desktop_config.json.

Debugging: MCP servers communicate over stdio, which can be challenging to debug. Use the MCP Inspector to access debugging tools. You can start the inspector via a package script that prints a URL for debugging tools.

License: This project is released under the MIT License. Ensure you comply with its terms when running, modifying, and redistributing the server.

Available tools

check_website

Check if a given website contains llms.txt or llms-full.txt files and return their locations and validation status.

list_websites

List known websites that implement llms.txt files and provide structured data about their compliance, with options to filter by file type.