Overview
MCP Web Scraper + AI Summarizer
๐ธ๏ธ ็ฝ้กตๆๅไธAIๆบ่ฝๆ่ฆๅทฅๅ ท โ ไธไธช MCP (Model Context Protocol) ๅทฅๅ ท๏ผๆๅไปปไฝ็ฝ้กตๅ ๅฎนๅนถ็จ AI ็ๆๆบ่ฝๆ่ฆ
๐ ๅ่ฝ
| ๅทฅๅ ท | ๆ่ฟฐ |
|---|---|
| ๐ง fetch_url | ๆๅๆๅฎ URL ็็ฝ้กตๅ ๅฎน๏ผ่ชๅจๆๅๅฏ่ฏปๆๆฌ๏ผ็งป้คๅฏผ่ชใ่ๆฌใๅนฟๅ็ญๅนฒๆฐๅ ็ด ๏ผ |
| ๐ค summarize_url | ๆๅ็ฝ้กตๅ ๅฎนๅนถ็จ AI ็ๆๆบ่ฝๆ่ฆ๏ผๆฏๆๅค่ฏญ่จ๏ผไธญๆใEnglishใๆฅๆฌ่ช็ญ๏ผ |
| ๐ search_web | ้่ฟๆ็ดขๅผๆๆ็ดข็ฝ็ปไฟกๆฏ๏ผๅบไบ Tavily Search API๏ผไธไธบ AI Agent ไผๅ๏ผ |
๐ ๅฟซ้ๅผๅง
ๆนๅผไธ๏ผ้่ฟ Smithery ไฝฟ็จ๏ผๆจ่๏ผ
็ดๆฅๅจๆฏๆ MCP ็ๅฎขๆท็ซฏ๏ผๅฆ CursorใClaude Desktop๏ผไธญๆ็ดข web-scraper-ai-summarizer ๅฎ่ฃ
ๅณๅฏใ
ๆนๅผไบ๏ผ่ชๆ็ฎก้จ็ฝฒ
# 1. ๅ
้ไปๅบ
git clone https://github.com/asdqwsadq/mcp-web-scraper.git
cd mcp-web-scraper
# 2. ้
็ฝฎ็ฏๅขๅ้
cp .env.example .env
# ็ผ่พ .env ๅกซๅ
ฅไฝ ็ API Key
# - NVIDIA_API_KEY: AIๆ่ฆ๏ผๅ
่ดน๏ผๆณจๅ https://build.nvidia.com๏ผ
# - TAVILY_API_KEY: ็ฝ็ปๆ็ดข๏ผๅ
่ดน๏ผๆณจๅ https://tavily.com๏ผ
# 3. ๅฎ่ฃ
ไพ่ต
pip install -r requirements.txt
# 4. ๅฏๅจๆๅก
python3 -m uvicorn server:app --host 0.0.0.0 --port 8080
ๆนๅผไธ๏ผDocker ้จ็ฝฒ
docker build -t mcp-web-scraper .
docker run -d --name mcp-web-scraper -p 8080:8080 --env-file .env mcp-web-scraper
๐ง MCP ๅ่ฎฎ่ฐ็จ็คบไพ
1. ๆๅ็ฝ้กต
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "fetch_url",
"arguments": {
"url": "https://example.com/article",
"max_size": 30000
}
}
}
2. AI ๆ่ฆ
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "summarize_url",
"arguments": {
"url": "https://example.com/article",
"language": "ไธญๆ"
}
}
}
3. ็ฝ็ปๆ็ดข
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "search_web",
"arguments": {
"query": "ๆๆฐไบบๅทฅๆบ่ฝๆๆฏ่ถๅฟ",
"count": 5
}
}
}
๐ API ๅฏ้ฅ้ ็ฝฎ
| ๆๅก | ็จ้ | ๅ ่ดน้ขๅบฆ | ็ณ่ฏทๅฐๅ |
|---|---|---|---|
| ๐ง NVIDIA NIM | AI ๆ่ฆ็ๆ | 1000 credits๏ผๆ ้ไฟก็จๅก๏ผ | https://build.nvidia.com |
| ๐ Tavily Search | ็ฝ็ปๆ็ดข | 1000 ๆฌก/ๆ | https://tavily.com |
| ๐ XPack๏ผๅฏ้๏ผ | ็จๆท่ฎค่ฏ & ่ฎก่ดน | ่ช้จ็ฝฒ | ่ง XPack ๆๆกฃ |
๐ฆ ๆๆฏๆถๆ
โโโโโโโโโโโโโโโ HTTP/MCP โโโโโโโโโโโโโโโโโโโโ
โ MCP ๅฎขๆท็ซฏ โ โโโโโโโโโโโโโโโบ โ MCP HTTP Server โ
โ (Cursor/Cline)โ โ (FastAPI + MCP) โ
โโโโโโโโโโโโโโโ โโโโโโโโโโฌโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโ
โ โ โ
โผ โผ โผ
โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ
โ NVIDIA NIM โ โ Tavily Searchโ โ XPack Auth โ
โ (AIๆ่ฆ) โ โ (็ฝ็ปๆ็ดข) โ โ (่ฎก่ดน) โ
โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโ
๐ ๏ธ ๅผๅ
# ๅฏๅจๅผๅๆๅกๅจ๏ผ็ญ้่ฝฝ๏ผ
uvicorn server:app --host 0.0.0.0 --port 8080 --reload
# MCP ๅ่ฎฎๆต่ฏ
curl -X POST http://localhost:8080/mcp \
-H "Content-Type: application/json" \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/list"}'
๐ ๅ่ฎฎ
MIT License
Project Info
Created At
a month agoUpdated At
a month agoAuthor Name
asdqwsadqStar
-Language
-License
-Tags
Recommend Servers
View AllTavily Mcp
@tavily-ai
JavaScript
a year ago
Filesystem
@modelcontextprotocol
2 months ago
Puter Mcp
13 hours ago
Regulatory Signals Mcp
a day ago
20 0 Game Mcp Server
@rocnubie
17 hours ago