Web Scraping Servers

D

docs.rs

Remote

Integrates with crates.io and docs.rs to search Rust crates, retrieve README content, fetch documentation for specific API items, and search within crate APIs using web scraping converted to markdown format.

Automates reverse engineering of chat interfaces through browser automation and network traffic analysis, capturing streaming API endpoints and providing browser control for analyzing chat APIs without official documentation.

Integrates with official French tax websites (impots.gouv.fr, service-public.fr, legifrance.gouv.fr) to provide tax calculations, form guidance, scheme details, and legal article retrieval with automated report generation for French tax professionals and developers.

MCP Macaco Playwright

Official

Enables comprehensive browser automation and web interaction through Playwright with 50+ specialized functions for navigation, form filling, data extraction, and Chrome DevTools Protocol support. Designed specifically for AI agents to perform complex web workflows including scraping, testing, and automated browsing tasks.

Fetches and extracts data from HTTP endpoints using JSONPath patterns with support for batch processing, custom headers, proxy configuration, and concurrent operations for efficient web API data retrieval.

Converts URLs to Markdown, scrapes web content, extracts links, and generates summaries of web pages for efficient content analysis and data extraction.

Integrates with Olostep's web scraping API to extract webpage content in markdown format, discover website URLs through search queries, and retrieve structured Google search results with country-specific routing and JavaScript rendering support.

Enables fetching and processing web content with advanced features including batch processing of up to 20 URLs, streaming support, metadata extraction, and multiple output formats (HTML, Markdown, plain text) with enterprise-grade security and global edge performance.

D

Driflyte

Remote

Query and retrieve topic-specific knowledge from recursively crawled and indexed web pages

mcp-server-rag-web-browser

Official

Implementation of an MCP server for the RAG Web Browser Actor. This Actor serves as a web browser for large language models (LLMs) and RAG pipelines, similar to a web search in ChatGPT.

Crawleo

Official Remote

Provides real-time web search and website crawling capabilities with zero data retention.

Automates Cypress test generation by analyzing web pages with Puppeteer to extract DOM elements and generate structured page object models with appropriate selectors and test patterns for end-to-end test automation.

Octagon Deep Research MCP

Official

Provides specialized AI-powered comprehensive research and analysis capabilities by integrating with advanced deep research agents, offering unlimited queries with no rate limits and faster performance than comparable services.

Enables users to search Airbnb listings with advanced filtering options and retrieve detailed property information through an MCP server interface.