- Unicrawler
Unicrawler
Stop writing selectors. Start describing data.
UniCrawler ships an MCP (Model Context Protocol) server that exposes UniCrawler’s crawling/parsing/storage capabilities to MCP-capable clients.
Overview
what is UniCrawler?
UniCrawler is a web crawling and data extraction tool that allows users to describe the data they want to extract using natural language, eliminating the need for complex selectors.
how to use UniCrawler?
To use UniCrawler, install it via PyPI, set up a virtual environment, and start the MCP server. You can then use commands to crawl URLs and extract structured data.
key features of UniCrawler?
- Natural language driven data extraction
- AI-powered parsing of messy HTML/DOM
- Browser automation for dynamic page handling
- One-click storage to PostgreSQL
use cases of UniCrawler?
- Extracting product information from e-commerce sites.
- Gathering data from news articles or blogs.
- Automating data collection for research purposes.
FAQ from UniCrawler?
- Can UniCrawler handle dynamic web pages?
Yes! UniCrawler uses browser automation to work with dynamic content.
- Is there a learning curve for using UniCrawler?
No, it is designed to be user-friendly with natural language descriptions.
- What databases can I use with UniCrawler?
UniCrawler supports PostgreSQL for data storage.
Project Info
Created At
6 months agoUpdated At
6 months agoAuthor Name
-Star
-Language
-License
-Recommend Servers
View AllSerper MCP Server
@garymengcom
A Serper MCP Server
Python
a year ago
Memory
@modelcontextprotocol
a year ago
虎嗅嗅 Ai行业参谋
an hour ago
Amap Maps
@amap
高德地图官方 MCP Server
a year ago
Playwright Mcp
@microsoft
Playwright MCP server
TypeScript
10 months ago
Mcp Server Chatsum
@chatmcp
summarize chat message
typescript
a year ago
Test
@modelcontextprotocol
test
6 months ago