Web Scraping API

Created By
zeeb0tta year ago
MCP integrated Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included.
Overview

What is Web Scraping API?

Web Scraping API is a tool designed for integrating web scraping capabilities into AI agents, allowing them to autonomously gather data from the web without manual coding.

How to use Web Scraping API?

To use the Web Scraping API, sign up for an API key at https://web.instantapi.ai/#pricing-03-254921, replace <YOUR_API_KEY> in the provided configuration, and connect your AI agent to automatically invoke scraping endpoints like /scrape, /links, /next, and /search.

Key features of Web Scraping API?

  • Seamless integration with AI workflows
  • No need for HTML selectors or manual logic
  • Multiple scraping endpoints for various tasks
  • Renders JavaScript pages
  • Bypasses anti-bot technology
  • Solves CAPTCHAs

Use cases of Web Scraping API?

  1. Automating data extraction for real estate listings.
  2. Gathering product information for e-commerce analysis.
  3. Collecting news articles for sentiment analysis.
  4. Extracting data from any website in the world.

FAQ from Web Scraping API?

  • Can I use the API for any website?

Yes, as long as you comply with the website's terms of service.

  • Is there a limit to the number of requests I can make?

There is no limit, however a fee of $2 per 1,000 web page scrapes applies.

  • How does the API handle pagination?

The API can automatically paginate through results based on your specified criteria.

Server Config

{
  "mcpServers": {
    "web-scraping-api-by-instantapi-ai": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://web-scraping-api-by-instantapi-ai.help-052.workers.dev/sse",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer <YOUR_API_KEY>"
      }
    }
  }
}
Project Info
Created At
a year ago
Updated At
a year ago
Author Name
zeeb0tt
Star
-
Language
-
License
-
Category

Recommend Servers

View All
Bring your real authenticated browser session to AI coding agents. Local-first MCP server + Chrome MV3 extension. No cloud. No telemetry.
@Cubenest

peek records the user's actual logged-in browser (DOM via rrweb, console events, network metadata, optional response bodies via opt-in Deep capture) through a Chrome MV3 extension. The extension ships events through a native-messaging stdio bridge to a local MCP server (peek-mcp), which persists them to a SQLite database at ~/.peek/sessions.db. AI coding agents (Claude Code, Cursor, Cline, Windsurf) read sessions from the database via 10 MCP tools: Tool What it does list_recent_sessions List recently recorded sessions (id, origin, ts, event count). get_session_summary LLM-readable narrative summary of a session. get_session_console_errors Console errors recorded in a session. get_session_network_errors Failed/notable network requests in a session. get_user_action_before_error Last N user actions before a console error. generate_playwright_repro Generate a runnable Playwright test from a session. get_dom_snapshot Reconstruct the DOM at a given timestamp. query_dom_history Timeline of attribute/text changes for a selector. request_authorization Side-panel consent for write actions (Level 3). execute_action Dispatch a UI action (gated by permission level + destructive blocklist). Why local-first matters Every other "browser session for AI" tool ships to a vendor cloud. peek's SQLite + extension live on the user's machine — no remote endpoints, no telemetry. The privacy policy (docs/peek/PRIVACY_POLICY.md) is the source of truth. Install # 1. Add the MCP server to Claude Code claude mcp add peek -- npx -y @peekdev/mcp # 2. Install the Chrome extension from the Chrome Web Store # (link added once the CWS listing is approved)

a day ago