Crawl4AI MCP Server

Created By
seungwonmea year ago
Overview

what is Crawl4AI MCP Server?

Crawl4AI MCP Server is a web scraping tool designed to facilitate the extraction of data from websites using the Crawl4AI framework.

how to use Crawl4AI MCP Server?

To use the Crawl4AI MCP Server, ensure you have Python 3.13.2 or higher installed along with the necessary dependencies. You can then run the server and utilize its API to perform web scraping tasks.

key features of Crawl4AI MCP Server?

  • Built on Python with easy integration of Playwright for browser automation.
  • Supports data extraction from various websites using the Crawl4AI framework.
  • Utilizes DuckDuckGo for search capabilities.

use cases of Crawl4AI MCP Server?

  1. Automating data collection from e-commerce websites.
  2. Gathering information for market research.
  3. Extracting data for machine learning model training.

FAQ from Crawl4AI MCP Server?

  • What dependencies are required to run the server?

You need Python 3.13.2+, Playwright, Crawl4AI, and DuckDuckGo-Search.

  • Is there a license for using Crawl4AI MCP Server?

Yes, it is licensed under the MIT license.

  • Can I contribute to the project?

Yes, contributions are welcome on the GitHub repository.

Project Info
Created At
a year ago
Updated At
a year ago
Author Name
seungwonme
Star
0
Language
Python
License
MIT license

Recommend Servers

View All
Bring your real authenticated browser session to AI coding agents. Local-first MCP server + Chrome MV3 extension. No cloud. No telemetry.
@Cubenest

peek records the user's actual logged-in browser (DOM via rrweb, console events, network metadata, optional response bodies via opt-in Deep capture) through a Chrome MV3 extension. The extension ships events through a native-messaging stdio bridge to a local MCP server (peek-mcp), which persists them to a SQLite database at ~/.peek/sessions.db. AI coding agents (Claude Code, Cursor, Cline, Windsurf) read sessions from the database via 10 MCP tools: Tool What it does list_recent_sessions List recently recorded sessions (id, origin, ts, event count). get_session_summary LLM-readable narrative summary of a session. get_session_console_errors Console errors recorded in a session. get_session_network_errors Failed/notable network requests in a session. get_user_action_before_error Last N user actions before a console error. generate_playwright_repro Generate a runnable Playwright test from a session. get_dom_snapshot Reconstruct the DOM at a given timestamp. query_dom_history Timeline of attribute/text changes for a selector. request_authorization Side-panel consent for write actions (Level 3). execute_action Dispatch a UI action (gated by permission level + destructive blocklist). Why local-first matters Every other "browser session for AI" tool ships to a vendor cloud. peek's SQLite + extension live on the user's machine — no remote endpoints, no telemetry. The privacy policy (docs/peek/PRIVACY_POLICY.md) is the source of truth. Install # 1. Add the MCP server to Claude Code claude mcp add peek -- npx -y @peekdev/mcp # 2. Install the Chrome extension from the Chrome Web Store # (link added once the CWS listing is approved)

a day ago