Crawl4ai Middleware

Created By

Frankieli123a year ago

Overview Content Tools Comments

Overview

what is Crawl4AI Middleware?

Crawl4AI Middleware is a Model Context Protocol (MCP) server designed to integrate web scraping functionalities of Crawl4AI into applications that support MCP, such as Cursor IDE.

how to use Crawl4AI Middleware?

To use Crawl4AI Middleware, install the required dependencies, configure the server settings, and integrate it with Cursor IDE by modifying its configuration file to include the MCP server details.

key features of Crawl4AI Middleware?

Create web scraping tasks and retrieve task IDs.
Fetch scraping results based on task IDs and save them locally.
List saved scraping result files.
Read the content of saved scraping result files.

use cases of Crawl4AI Middleware?

Automating the extraction of data from websites.
Integrating web scraping capabilities into applications for data analysis.
Facilitating research by gathering information from multiple web sources.

FAQ from Crawl4AI Middleware?

What is the default API address for the server?

The default API address is http://192.168.31.12:11235/.

How do I configure the server?

You can configure the server by creating a .env file or setting system environment variables.

Can I customize the output directory for saved results?

Yes, you can specify a custom output directory in the configuration.

Try in Playground

Server Config

{
  "mcpServers": {
    "crawl4ai": {
      "command": "python",
      "args": [
        "E:/APP/craw14ai-middleware/crawl4ai_server.py"
      ]
    }
  }
}

Project Info

Created At

a year ago

Updated At

a year ago

Author Name

Frankieli123

Star

-

Language

-

License

-

Category

developer-tools

Tags

Homepage

https://github.com/Frankieli123/crawl4ai-middleware

Recommend Servers

Pakistan Payments Mcp

@junter1989k-ai

5 days ago

Canada Payments Mcp

@junter1989k-ai

5 days ago

Georgia Payments Mcp

@junter1989k-ai

5 days ago

Greece Payments Mcp

@junter1989k-ai

5 days ago

mcp-server-flomo MCP Server

Write notes to Flomo

JavaScript

a year ago

Poland Payments Mcp

@junter1989k-ai

5 days ago

Rwanda Payments Mcp

@junter1989k-ai

5 days ago

Serper MCP Server

A Serper MCP Server

Python

a year ago

MCP Advisor & Installation - Use the right MCP server for your needs

TypeScript

a year ago

Songcheck Ai Music Detector

@afghanfansmedia-ai

Is this song AI or human? SongCheck detects AI-generated music (Suno, Udio, and more) and media from any AI agent. Point it at an audio file, an image/video, or a whole music folder and it returns a verdict (LIKELY AI-GENERATED / UNCERTAIN / LIKELY HUMAN), an AI-probability score, confidence, and provenance signals (Content Credentials / SynthID watermark, generator hints). Tools: detect_ai_music, detect_ai_media, scan_catalog (audit an entire catalog), and songcheck_health. Free tier is 5 checks/day; a paid key unlocks unlimited catalog scans. Powered by SongCheck (Khaled Media), a self-hosted v9 ensemble detector.

5 days ago

South Africa Payments Mcp

@junter1989k-ai

5 days ago

Guatemala Payments Mcp

@junter1989k-ai

5 days ago

JavaScript

a year ago

Croatia Payments Mcp

@junter1989k-ai

5 days ago

GBOX Android MCP

GBOX provides environments for AI Agents to operate computer and mobile devices. Mobile Scenario: Your agents can use GBOX to develop/test android apps, or run apps on the Android to complete various tasks(mobile automation). Desktop Scenario: Your agents can use GBOX to operate desktop apps such as browser, terminal, VSCode, etc(desktop automation). MCP: You can also plug GBOX MCP to any Agent you like, such as Cursor, Claude Code. These agents will instantly get the ability to operate computer and mobile devices.

a year ago

Czechia Payments Mcp

@junter1989k-ai

5 days ago

Jordan Payments Mcp

@junter1989k-ai

5 days ago

Mailtrap Email Sending MCP

An MCP server that provides a tool for sending transactional emails via Mailtrap

a year ago

Playwright MCP server

TypeScript

a year ago

Denmark Payments Mcp

@junter1989k-ai

5 days ago

Arcgis Portal Mcp

MCP server for ArcGIS Portal and ArcGIS Online. Lets AI assistants search content, query feature layers, manage features, handle content operations, and administer users and groups. Built on the Model Context Protocol for integration with Claude Desktop, Cursor, VS Code Copilot, and other MCP clients. Disclaimer: This is an independent open-source project. It is not affiliated with, endorsed by, or sponsored by Esri Inc. "ArcGIS" is a registered trademark of Esri.

5 days ago

@modelcontextprotocol

Browser automation and web scraping

a year ago

Sequential Thinking

@modelcontextprotocol

An MCP server implementation that provides a tool for dynamic and reflective problem-solving through a structured thinking process.

a year ago

Oman Payments Mcp

@junter1989k-ai

5 days ago

@modelcontextprotocol

Retrieving and analyzing issues from Sentry.io

a year ago

Luxembourg Payments Mcp

@junter1989k-ai

5 days ago

@modelcontextprotocol

AI image generation using various models

a year ago

5 days ago

Ukraine Payments Mcp

@junter1989k-ai

5 days ago

EdgeOne Pages MCP

@TencentEdgeOne

An MCP service designed for deploying HTML content to EdgeOne Pages and obtaining an accessible public URL.

TypeScript

a year ago