#scraping

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Official Firecrawl MCP Server - Adds powerful web scraping to Cursor, Claude and any other LLM clients.

Browser automation and web scraping

Queries Greenhouse, Lever, Ashby, Workday, and Rippling for any role category you define, from GTM to Engineering to custom keywords. Part of the Mamba Labs signal toolkit.

Detects GTM hiring activity from company career pages across Greenhouse, Lever, and Ashby, returning role counts and titles as a Clay-ready row. Part of the Mamba Labs signal toolkit.

Pay-per-call live company intelligence for AI agents via x402 (USDC on Base). No signup, no API key — name a company, get fresh data instantly.

Real-time SERP and web data for AI agents. 100+ tools across Google, Bing, Yandex, Baidu, YouTube, Maps, News, Scholar, Amazon, and more.

14 paid APIs for AI agents. gulf arabic NLP, email verification, legal analysis, web scraping + more. USDC on base. no auth. no accounts. just pay and get data.

Automatically scrape structured data and URLs from any website via your favorite AI application or agent.

Gulf Arabic sentiment analysis, Arabizi transliteration, web scraping, crypto data, weather, and domain enrichment. 7 pay-per-request. APIs optimized for GCC/Middle East. Powered by x402 protocol (USDC on Base).

Run headless Chrome in production without the maintenance

Your AI research assistant that cites real sources and stays honest. Search the entire web or narrow it down to just the sites you trust; medical journals, court databases, news outlets, academic papers. Analyze the full source, not just snippets. Links that work, citations you can trust, no made-up closed-garden pre-synthesized results.

x402-native clean reader. URL in → markdown out. $0.002/call, no signup.

Ad-free web scraping and search exposed as 3 MCP tools fetch_page, fetch_pages_batch, search_web. Works with Claude Desktop, Cursor, Cline.

Decodo MCP Server – connect AI tools like Claude, Cursor, and other LLM clients to Decodo's Web Scraping API to extract data from any site, with built-in proxy rotation, JavaScript rendering, and anti-bot handling.

B2B Data Enrichment (Leads & Companies)

MCP server for parallel browser automation across multiple providers. Run multiple concurrent browser sessions in memory with a shared, provider-agnostic tool surface across Playwright (local Chromium), Browserbase, Anchor Browser, and Cloudflare Browser Run. Each session gets a numeric ID, every browser_* tool accepts a sessionId. Tools include browser_navigate, browser_click, browser_fill, browser_screenshot, browser_snapshot, browser_evaluate, keyboard/mouse primitives, file upload, and waits. Configure providers at the MCP server level (not per call) via BROWSER_MCP_CONFIG env or a config file.

HTTP 402 + USDC pay-per-call API for AI agents. 16 endpoints (QR codes, screenshots, OG images, PDFs, web scraping, WHOIS, YouTube transcripts, AI summarization, plus a 4-endpoint crypto cluster — wallet balances, ENS resolution, gas, coin prices). Two payment rails: x402 (autonomous USDC on Base mainnet, no signup, no API key, server holds zero private keys) or pre-paid credits ($1 = 5 calls via NowPayments). Hosted MCP server included.

Outscraper MCP Server provides MCP-compatible clients with access to Outscraper’s data extraction tools. It enables web, business, maps, reviews, and search-related data collection through the Outscraper API using a simple MCP server configuration.

Direct access to 40+ scraping and search tools. Extract structured data from Google (Search, Maps, Trends), Amazon, Airbnb, Social Media, and any web page directly into your AI agent.

The Google for AI agents — ask Claude to research any company, analyze competitors, track market trends, monitor breaking news, and investigate key people. 6 intelligence tools returning structured JSON with per-source confidence breakdowns and A–F data quality grades. Aggregates DuckDuckGo, NewsAPI, Wikipedia, web scraping, and social profiles.

Suprsonic is a unified agent API that bundles dozens of capabilities behind one API key. Instead of signing up for Perplexity, SerperDev, Firecrawl, Icypeas, LeadMagic, Deepgram, ElevenLabs, and a dozen other providers, your agent gets one key and one response format. Capabilities include: search, scrape, profiles, emails, images, tts, stt, sms, documents, companies, email-verify, transcribe, invoice-parse, subtitle, file-convert, bg-remove, screenshot Every call is routed through a multi-provider waterfall with automatic failover. Credits are deducted only on success. SDKs for Python and TypeScript, MCP server for Claude Desktop/Cursor/VS Code, and a REST API for everything else.

Your AI agent scrapes X today, gets broken HTML tomorrow. Taprun compiles the site once into a deterministic program, then `tap doctor` monitors health contracts + structural diffs to catch silent breakage before your data goes stale. 140+ pre-built skills across 68+ sites. Works with Claude Code, Cursor, Windsurf, any MCP host.

This server is implemented in python to bridge the gap between the AI Assistant or (custom MCP clients) and Selenium Webdrivers. It exposes selenium webdriver functionalities as MCP tools allowing AI assistanct/MCP clients to user them to perform task for web automation, web testing or web scraping.

Web scraping, crawling, and data extraction for AI agents. 5 built-in tools: scrape (clean markdown from any URL), crawl (follow links across entire sites), map (discover all URLs on a domain), extract (structured JSON via schema), and search (web search with optional page scraping). 833ms average latency, single binary, 6 MB RAM. Self-host free or use managed cloud at fastcrw.com with 500 free credits. Firecrawl-compatible API. Works with Claude Desktop, Claude Code, Cursor, Windsurf, and any MCP-compatible client.

What it does 8 MCP tools that give your AI assistant the ability to research the web, read academic papers, extract YouTube videos, pull tweets, and ingest local files — all through the standard MCP protocol.

B4n1Web is an ultra-lightweight agentic browser engine (6MB) for AI agents. It provides three browsing modes: Light (HTTP fetch + HTML parsing), JS (JavaScript extraction), and Render (full headless browser with Chromium). Perfect for web scraping, data extraction, E2E testing, and autonomous AI agents that need to navigate and extract content from websites without the overhead of a full browser. Features: - Ultra-lightweight binary (6MB) - Python SDK available on PyPI - MCP server for integration with Claude, Cursor, OpenCode, Windsurf, Antigravity - SQLite-based SecurityShield for safe browsing - Multiple modes: Light, JS, Render MCP Server: Command: b4n1web mcp -p 8080 Port is configurable — change 8080 to any available port Tools: goto (navigate & extract content), get_links (extract all links from current page)

Hosted MCP server for LinkedIn. 25 tools: profiles, messages, search, post engagement, company data, enrichment. OAuth authentication, rate limited, account-safe.

Extracts clean markdown from noisy public web pages so agents can read content without nav clutter, scripts, or ad-heavy markup.

65+ AI tools as an MCP server. Research, write, code, scrape, translate, analyze, agent memory, workflows. Pay per call from $0.006.

Browser-grade web access for AI agents. Fetches any webpage using Chrome's actual network stack — identical TLS fingerprint to a real browser. Bypasses Cloudflare, Akamai, and other anti-bot systems that block standard HTTP clients. Returns clean markdown. Built by the creator of Lantern, used by 150M+ people to bypass internet censorship.

MCP server for web intelligence extraction. 52 tools for design system analysis, accessibility auditing, performance profiling, tech stack detection, security scanning, and competitive teardowns — all returned as structured JSON your AI agent can reason about. Works with Claude, Cursor, Windsurf, and any MCP-compatible agent. Login once to MFA-protected sites and extract forever — sessions persist across tool calls. **Tool categories:** - Design Tokens — colors, fonts, spacing, shadows, CSS variables, contrast - Content Extraction — tables, links, metadata, forms, readable body text - Visual Assets — images, SVGs, favicons - Layout Intelligence — flex/grid layout tree, components, breakpoints - Network Intelligence — API schema inference, tech stack detection, third-party script classification - Advanced Intelligence — security headers/CSP, PWA analysis, Web Components, storage audit, AI/ML detection, Canvas/WebGL, i18n, GraphQL, WebAssembly - Accessibility — WCAG contrast, ARIA audit - Performance — Core Web Vitals, resource sizing - Multi-page — site crawl, cross-site diff, temporal change tracking - Workflows — full teardown, pre-launch audit, asset harvest, design system export Credential safety built in — no auto-login, no credentials in chat. Manual login via headed browser, session persists via Playwright profile.

x402-paid utility tools for AI agents on Solana. Web scraping, screenshots, structured data extraction, code review, content generation, sentiment analysis, and web search. Every tool call settles in USDC via x402 micropayments. Built for autonomous agents that need web access and data processing without API key management. Part of the RelayZero agent economy network.

Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.

Web data API that just works. Pass any URL, get clean markdown — Cloudflare, JavaScript, CAPTCHAs handled automatically. No config needed. 97.6% success rate across 500+ domains. Free tier included.

chrome-debug-mcp is an asynchronous Rust-based Model Context Protocol (MCP) server that allows AI agents and Large Language Models to natively debug Chromium-based browsers via the Chrome DevTools Protocol (CDP).

MCP server for website change monitoring. Let your AI assistant track websites, detect changes, and compare snapshots with visual diffs.

Pay-per-use APIs for AI agents. 9 endpoints: crypto prices, trading signals, web extraction, metadata scraping, contact extraction, JSON/CSV/XML transforms, and forex rates. Powered by x402 protocol with USDC micropayments on Base.

AI-powered website crawling, analysis, and export via MCP. 38 tools for crawl control, browser enrichment capture, WARC/ZIP/single-HTML export, observation timeline, and evidence-backed findings. 4 resources, 4 prompts. Dual-mode: full (38 tools) or code (6 tools). Install: npx crawlio-mcp

100-tool browser automation for AI agents via MCP. Screenshots, DOM inspection, network capture, form filling, cookie management, tab orchestration, session recording, and structured data extraction via Chrome extension. One-command setup: npx crawlio-browser init auto-configures 14 MCP clients.recording + 1 compiler) with framework-aware intelligence, typed evidence infrastructure, and confidence-tracked findings — captures what static crawlers can't see.

Web fetching, search, and structured data extraction API built for AI agents. Fetch any page as clean markdown, raw HTML, or JSON-LD. Search the web and news across 20+ countries. One credit per request, no tiers, no subscriptions. 500 free requests on signup.

Scrape any webpage as clean Markdown and extract YouTube transcripts. Enterprise grade infrastructure at $0.001 per request.

Human-in-the-loop API for AI agents. When your agent hits a CAPTCHA, 2FA prompt, identity check, or any human-only gate — SiliconBridge routes it to a real human operator who solves it in under 60 seconds. Result returned via API or webhook. Python SDK available: pip install siliconbridge

PageCrawl is a cloud-hosted MCP server that lets AI assistants monitor web pages for changes in real time. It supports multiple tracking modes including full-page text monitoring, content-only extraction, reader mode, price tracking with availability detection, and CSS/XPath selector-based monitoring. Features include change history with diffs, workspace and tag management, configurable check frequencies, and file monitoring (PDF, Word, Excel). Connect any MCP-compatible AI client to automate web monitoring workflows — track competitor pages, policy changes, pricing updates, product availability, and more.

30+ pay-per-use API tools for AI agents via MCP: image generation (Flux 1.1 Pro), web scraping, browser automation (Playwright), TTS, PDF, QR code, weather, crypto price, WhatsApp, code execution and more. No subscription needed — pay per use via API credits or x402/USDC micropayments. Use with npx iteratools-mcp.

Give your AI the ability to read the web. Fetches URLs as clean markdown with 9 fallback strategies. Handles tweets, YouTube, arXiv, PDFs, and regular pages. No API keys required.

MCP server that converts any URL to clean, token-efficient Markdown for AI agents. Strips ads, navigation, and scripts. Supports CSS selectors, batch processing (10 URLs), and token counting.

33 utility APIs for AI agents — image generation, web scraping, crypto analysis, code review, OCR, TTS & more. Remote MCP server with Streamable HTTP. Pay-per-request via x402 micropayments. One wallet, zero API keys.

Free, Unlimited, Webpage to Markdown. No API Key required

AI-powered native browser with built-in MCP server. 7 tools for browser automation — navigate, click, fill forms, extract data, run pipelines. ~30 tokens per page description vs 25,000 for DOM snapshots. macOS Apple Silicon. MIT licensed.

Token-efficient web browser for LLM agents. Extract clean markdown from any public web page — saves 90-95% of tokens compared to raw HTML.

Convert any URL to clean, LLM-ready Markdown or plain text. Remote MCP server, no local install needed.

x402-native API gateway for AI agents. 20+ capabilities (web scraping, screenshots, search, email, translate) — pay-per-use in USDC, no API keys needed.

Give your AI agent unblockable browser access. Aluvia routes traffic through premium mobile carrier IPs to bypass 403s, CAPTCHAs, and WAFs automatically.

Web scraping MCP server for AI agents. Bypass anti-bot systems and get clean, LLM-ready Markdown content. Supports both stdio and Streamable HTTP transports. Built on 8+ years of production scraping infrastructure.

Browser automation MCP server using Chrome/Edge. Access authenticated sites, handle CAPTCHAs, SSO, and JavaScript-heavy pages with your real browser session.

Opengraph.io MCP Server — Instant Link Metadata Extraction An MCP server that connects clients to the Opengraph.io web API, fetching rich metadata (titles, descriptions, images, Open Graph tags, etc.) for any URL. It lets clients retrieve structured link preview data. Ideal for chat bots, UIs, and agents that need to unfurl links and display previews or analyze page metadata, using your Opengraph.io App ID. There is also a suite of image generation tools. There are both stdio & https transports available use the npx config for stdio or the url config for HTTPS

Access Japan-only websites (Mercari, Rakuten, SUUMO, etc.) through Japanese IP. Free tier: 1,000 requests/month.

Browser automation for web scraping when standard HTTP requests fail. Use ONLY when pages require: (1) Authentication - login forms, SSO, 401/403 errors, corporate intranets, (2) Anti-bot protection - CAPTCHA, Cloudflare challenges, rate limiting, (3) JavaScript rendering - SPAs, dynamic content loaded after page load. Can fetch pages, click elements, fill forms, and extract content. Opens real browser for user authentication, then automates interactions and extraction. DO NOT use for simple HTML pages that work with regular HTTP GET requests.

BrowserAct MCP Server is a standardized service that lets MCP Clients interact with the BrowserAct platform through the Model Context Protocol (MCP). With it, MCP Clients can: Discover and execute browser automation workflows as MCP Tools Read outputs (results, files) and access related data storage Trigger real-world actions via natural language (e.g., send messages, create tasks, update records) Key Features 1. Multi-Scenario Support: Enables MCP Clients to run targeted tasks or complex searches across different applications 2. Natural Language Interaction: Describe what you need—no complex code or commands 3. Unlimited Tool Exposure: One MCP Server can expose unlimited MCP Tools 4. Multi-Client Compatibility: Works with Claude, ChatGPT, OpenAI Agent Builder, and other MCP-compatible clients

MCP server for browser automation via Puppeteer. Executes arbitrary JavaScript with direct access to Puppeteer Browser instance. Single "execute" tool runs your code in a sandboxed Node.js VM with a browser global - full Puppeteer API access in one call.

SerpApi MCP Server for Google and other search engine results

Get real-time web data, automatically handle anti-bot systems, extract structured data, and capture screenshots with your favorite tools, such as Cursor or LangChain.

Remote-only social media MCP server for Twitter/X, Instagram, and TikTok data & insights.

**SlashMCP** is a production-grade AI workspace that connects LLMs to real-world data and tools through an intuitive chat interface. Built on the Model Context Protocol (MCP), it enables seamless interaction with multiple AI providers (OpenAI, Claude, Gemini) while providing powerful capabilities for document analysis, financial data queries, web scraping, and multi-agent workflow orchestration. ### Key Features: - **Multi-LLM Support**: Switch between GPT-4, Claude, and Gemini at runtime—no restart needed - **Smart Command Autocomplete**: Type `/` to discover and execute MCP server commands instantly - **Document Intelligence**: Drag-and-drop documents with automatic OCR extraction and vision analysis - **Financial Data Integration**: Real-time stock quotes, charts, and prediction market data via Alpha Vantage and Polymarket - **Browser Automation**: Web scraping and navigation using Playwright MCP - **Multi-Agent Orchestration**: Intelligent routing with specialized agents for command discovery, tool execution, and response synthesis - **Dynamic MCP Registry**: Add and use any MCP server on the fly without code changes - **Voice Interaction**: Browser-based transcription and text-to-speech support ### Use Cases: - Research and analysis workflows - Document processing and extraction - Financial market monitoring - Web data collection and comparison - Multi-step task automation **Live Demo:** [ slashmcp.vercel.app ]( https://slashmcp.vercel.app ) **GitHub:** [ github.com/mcpmessenger/slashmcp ]( https://github.com/mcpmessenger/slashmcp ) **Website:** [ slashmcp.com](https://slashmcp.com )

Access millions of posts, comments and user profiles at major social media platforms. No API keys. No rate limits. No restrictions. The MCP is optimized to handle large datasets considering LLMs context window size. • Fully Remote • No Local Installation • No Self-Hosting Required More details at: https://xpoz.ai

Arch MCP provides three main capabilities: - 🔍 Resources - URI-based access to Arch Wiki, AUR packages, official repos, and installed packages - 🛠️ Tools - Search, analyze, and securely install packages with built-in safety checks - 📋 Prompts - Guided workflows for troubleshooting, security audits, and dependency analysis

The Scrapling MCP Server is a new feature that brings Scrapling's powerful Web Scraping capabilities directly to your favorite AI chatbot or AI agent. This integration allows you to scrape websites, extract data, and bypass anti-bot protections conversationally through Claude's AI interface or any other chatbot that supports MCP.

Advanced MCP server for comprehensive web research, content discovery, and trends analysis. Features multi-engine search, intelligent content extraction, website traversal, and real-time data streaming.

Allow your agent to access multiple geolocation, API and catalogs by changing its IP.

A Model Context Protocol (MCP) server that fetches article data from URLs using newspaper3k.

Crawlbase Web MCP Server (Model Context Protocol) connects AI agents and large language models (LLMs) with real-time web data. Built on Crawlbase’s proven web scraping and crawling infrastructure, it handles JavaScript rendering, anti-bot protection, and web data extraction at scale — powering Claude, Cursor, and Windsurf. It delivers a reliable, production-ready pipeline of live, structured data for AI workflows and intelligent applications.

Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliability. Transform webpages into structured markdown, extract data using AI, and execute AI-powered web searches seamlessly. Enhance your applications with powerful web data extraction capabilities through this integration.

🚀 The ONLY browser automation that bypasses Cloudflare, antibots, and social media blocks. Supercharge any MCP-compatible AI agent with undetectable, real-browser automation. No CAPTCHAs. No blocks. Just results.⚡ 30-second setup • 🛡️ Undetectable by design • 🏆 98.7% success rate on protected sites • 🕵️ Full network debugging via AI chat Features: Works on protected sites that block traditional automation- Pixel-accurate element cloning via Chrome DevTools Protocol - Full network debugging through AI chat — see every request, response, header, and payload- Your AI agent becomes a network detective — no more guessing what APIs are being called- 🎛️ Modular architecture — disable unused sections, run minimal installs- ⚡ Lightweight deployments — from 21 core tools to full 88-tool arsenal- Clean MCP integration — no custom brokers or wrappers needed- 88 focused tools organized into 11 logical sections

Scrapeless MCP Server lets LLMs and AI tools like ChatGPT and Cursor access real-time web data via Google services, browser automation, and scraping—no blocks, just seamless context.

Turn YouTube, TikTok, X videos and websites into structured data. Skip the hassle of video transcription and data scraping. Our APIs help you build better software and AI products faster.

Manage your GoLogin browser profiles and automation directly through AI conversations. This MCP server connects to the GoLogin API, letting you create, configure, and control browser profiles using natural language. With GoLogin MCP Server, you can: - Manage browser profiles - Create, update, delete, and list your browser profiles - Configure proxies - Set up and modify proxy settings for your profiles - Handle fingerprints - Customize browser fingerprints and user agents - Manage folders - Organize your profiles into folders - Account information - Check your subscription status and usage Example Use Cases - "Create a new browser profile with a US proxy" - "Show me all my browser profiles." - "Update the proxy settings for my profile." - "Delete old profiles I no longer need." - "Check my GoLogin account status." - "Create a folder to organize my profiles."

An MCP server for privacy-focused web search and article scraping using SearXNG instances.

Scrape websites and let them talk to your LLM

Configured Puppeteer Vision MCP server for website scraping with specific settings for specify4it.com

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.

Mirror of

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

MCP integrated Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included.

The Oxylabs MCP server provides a bridge between AI models and the web. It enables them to scrape any URL, render JavaScript-heavy pages, extract and format content for AI use, bypass anti-scraping measures, and access geo-restricted web data from 195+ countries.

Mirror of

A Model Context Protocol (MCP) server that demonstrates how to scrape financial data using the israeli-bank-scrapers library

An MCP server that provides web content to your agent.

Roo MCP Server - Real-world automation for web scraping and browser control

Web Scraping Agent with N8N and MCP Server

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

Scrape the Amazon and Ebay query page, for a list of product links, titles, prices, and thumbnails.

Browser extension to enable MCP in claude.ai

Olostep MCP Server offers web access tooling to AI apps with minimal setup. It allows AI to: 1. Search the web using google 2. Get the markdown content of any web page 3. Discover and filter out relevant URLs within a website.

Discover, extract, and interact with the web - one interface powering automated access across the public internet.

An MCP server implementation that integrates with https://webscraping.ai for web data extraction capabilities.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

MCP server for using ScrAPI to scrape web pages.

Mirror of

MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content

Basic MCP Server for Web Scraping

An MCP server for (free!) search results via duckduckgo

Bridge the gap between your web crawler and AI language models using Model Context Protocol (MCP). With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously, extracting insights from your web content. Support for WARC, wget, InterroBot, Katana, and SiteOne crawlers is available out of the gate. The server includes a full-text search interface with boolean support, resource filtering by type, HTTP status, and more.

A Model Context Protocol (MCP) server implementation that integrates with web scraping capabilities.