Unicrawler

Created By

7 months ago

Stop writing selectors. Start describing data. UniCrawler ships an MCP (Model Context Protocol) server that exposes UniCrawler’s crawling/parsing/storage capabilities to MCP-capable clients.

# data-extraction

Overview Content Tools Comments

Overview

what is UniCrawler?

UniCrawler is a web crawling and data extraction tool that allows users to describe the data they want to extract using natural language, eliminating the need for complex selectors.

how to use UniCrawler?

To use UniCrawler, install it via PyPI, set up a virtual environment, and start the MCP server. You can then use commands to crawl URLs and extract structured data.

key features of UniCrawler?

Natural language driven data extraction
AI-powered parsing of messy HTML/DOM
Browser automation for dynamic page handling
One-click storage to PostgreSQL

use cases of UniCrawler?

Extracting product information from e-commerce sites.
Gathering data from news articles or blogs.
Automating data collection for research purposes.

FAQ from UniCrawler?

Can UniCrawler handle dynamic web pages?

Yes! UniCrawler uses browser automation to work with dynamic content.

Is there a learning curve for using UniCrawler?

No, it is designed to be user-friendly with natural language descriptions.

What databases can I use with UniCrawler?

UniCrawler supports PostgreSQL for data storage.

Project Info

Created At

7 months ago

Updated At

7 months ago

Author Name

-

Star

-

Language

-

License

-

Category

Tags

data-extraction

Homepage

https://pypi.org/project/UniCrawler/

Recommend Servers

Uganda Payments Mcp

@junter1989k-ai

7 days ago

Kenya Payments Mcp

@junter1989k-ai

7 days ago

Switzerland Payments Mcp

@junter1989k-ai

7 days ago

Slovakia Payments Mcp

@junter1989k-ai

7 days ago

Australia Payments Mcp

@junter1989k-ai

7 days ago

Sweden Payments Mcp

@junter1989k-ai

7 days ago

Ukraine Payments Mcp

@junter1989k-ai

7 days ago

Mailtrap Email Sending MCP

An MCP server that provides a tool for sending transactional emails via Mailtrap

a year ago

Tanzania Payments Mcp

@junter1989k-ai

7 days ago

@modelcontextprotocol

GitLab API, enabling project management

a year ago

Mcp Server Chatsum

summarize chat message

typescript

a year ago

Greece Payments Mcp

@junter1989k-ai

7 days ago

Perplexity Ask MCP Server

A Model Context Protocol Server connector for Perplexity API, to enable web search without leaving the MCP ecosystem.

JavaScript

a year ago

Qatar Payments Mcp

@junter1989k-ai

7 days ago

Bangladesh Payments Mcp

@junter1989k-ai

7 days ago

基于Anduin2017 / HowToCook （程序员在家做饭指南）的mcp server，帮你推荐菜谱、规划膳食，解决“今天吃什么“的世纪难题； Based on Anduin2017/HowToCook (Programmer's Guide to Cooking at Home), MCP Server helps you recommend recipes, plan meals, and solve the century old problem of "what to eat today"

a year ago

@modelcontextprotocol

3 months ago

Ghana Payments Mcp

@junter1989k-ai

7 days ago

Persistent Adaptive Planning Intelligence - structured loop engineering for AI coding assistants, with memory that persists across sessions, tools, and teammates.

7 days ago

@modelcontextprotocol

Retrieving and analyzing issues from Sentry.io

a year ago

Bahrain Payments Mcp

@junter1989k-ai

7 days ago

Belgium Payments Mcp

@junter1989k-ai

7 days ago

Oman Payments Mcp

@junter1989k-ai

7 days ago

Rwanda Payments Mcp

@junter1989k-ai

7 days ago

@modelcontextprotocol

Repository management, file operations, and GitHub API integration

a year ago

Bucket Feature Flags MCP Server

Flag features directly from chat in your code editor, including VS Code, Cursor, Windsurf, Claude Code—any IDE with MCP support.

a year ago

Austria Payments Mcp

@junter1989k-ai

7 days ago

BlenderMCP connects Blender to Claude AI through the Model Context Protocol (MCP), allowing Claude to directly interact with and control Blender. This integration enables prompt assisted 3D modeling, scene creation, and manipulation.

a year ago

Costa Rica Payments Mcp

@junter1989k-ai

7 days ago

Secure file operations with configurable access controls

a year ago