Web Crawler MCP
MCP Serverby laurentvv · Added 5mo ago
Claude
36
Install
git clone https://github.com/laurentvv/crawl4ai-mcpAdd to Claude
claude mcp add web-crawler-mcpQuick Setup Config
Copy & paste ready~/Library/Application Support/Claude/claude_desktop_config.json (macOS) %APPDATA%\Claude\claude_desktop_config.json (Windows)
{
"mcpServers": {
"web-crawler-mcp": {
"command": "npx",
"args": [
"@modelcontextprotocol/web-crawler-mcp"
]
}
}
}Paste into your Claude Desktop config file, then restart Claude.
About
A powerful web crawling tool that integrates with AI assistants via the MCP (Model Context Protocol). It allows crawling websites, extracting dynamic content, navigating links, and saving structured Markdown files. Requires Playwright browsers installed via 'uv run playwright install chromium'.
Tags
browser-webmcp-serverweb-crawlerai-assistantplaywrightmarkdowndynamic-contentbrowserai