SuperAPI AI Directory
Partner with us中文AI newsFavorites
All toolsAI agentsagent-scrape

agent-scrape

Pay-per-call web scraping via x402 on Base, with structured extraction, screenshots, metadata, browser sessions and workflows.

Open website

About this tool

Purpose

AgentScrape is pay-per-use web scraping infrastructure designed for AI agents. In response to the problems of traditional scraping APIs requiring manual registration, binding a payment method, managing API keys, and committing to monthly subscriptions, it instead targets agents that have a wallet and stablecoins: no registration, no API keys, no subscription, just pay-per-use with USDC.

Main Capabilities

The service supports two protocols at the same time:

  • HTTP API, with an x402 v2 payment gateway, suitable for agents using native HTTP.
  • MCP server (Streamable HTTP transport), suitable for Claude Desktop, Cursor, Continue.dev, and any MCP-compatible framework.

A total of 6 tools are provided: scrape, extract (Groq + Llama 4), screenshot, metadata, workflow, session. x402 payment metadata is broadcast along with the MCP tools/list response, and clients configured with an x402-compatible wallet can automatically complete the payment handshake.

Usage

  • HTTP API quick start: call the interface via HTTP. The payment flow is that the server returns 402 and the payment requirements, the agent signs a USDC transfer, the facilitator settles on-chain, and the data is returned, with the end-to-end time reportedly under 2 seconds.
  • MCP quick start: add the Streamable HTTP endpoint to any MCP-compatible client.
  • For machine discovery: four standard endpoints are exposed (free, no authentication), including the x402 manifest, A2A Agent Card, and others. The 402 response itself carries the canonical payment requirements in the base64-encoded Payment-Required header, and the body contains a human-readable error and discovery links.
  • ElizaOS integration: ElizaOS natively supports remote MCP servers through the @elizaos/plugin-mcp plugin, and AgentScrape works out of the box with no custom integration required. Just install the MCP plugin and add the plugin in the character JSON, and point the MCP server configuration to AgentScrape's Streamable HTTP endpoint, and the agent will automatically discover all six tools.

Tech Stack

  • Runtime: Cloudflare Workers (V8 isolates, global edge)
  • HTTP framework: Hono + @x402/hono v2 payment middleware
  • MCP framework: @modelcontextprotocol/sdk + agents/mcp, together with withX402 payment binding
  • Bazaar discovery: @x402/extensions, each paid route declares an input schema and output examples
  • Browser: Cloudflare Browser Rendering API + @cloudflare/puppeteer
  • AI extraction: Groq + Llama 4 Scout (17B, 16E)
  • Storage: Cloudflare KV (5-minute response cache, browser sessions, free tier counter)
  • Network: Base mainnet (eip155:8453)
  • Asset: native USDC (0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913)
  • Facilitator: Coinbase CDP (api.cdp.coinbase.com/platform/v2/x402), using Ed25519 JWT authentication

Pricing and Free Quota

  • Each wallet address has 10 free calls on the HTTP API every 30 days, and the Base wallet address must be passed in the X-402-Payer header; after more than 10, payment via x402 is required. The free tier is HTTP-only, and MCP calls go through the standard x402 payment flow.
  • Mainnet launch window (the first 48 hours): a flat 0.001 USDC per tool call.
  • After verification, prices will increase (the original text provides a table of adjusted prices for each tool; the specific values are subject to the official source).
  • Planned volume discounts: 20% discount for 1,000 calls per month, 40% discount for 10,000 calls.

Use Cases

Suitable for AI agents and MCP clients (Claude Desktop, Cursor, Continue.dev, ElizaOS, etc.) that need to automatically scrape web pages, perform structured data extraction, take screenshots, obtain metadata, execute workflows, or maintain browser sessions.

Limitations and Self-Hosting

Self-hosting requiresNode 22+ required, a Cloudflare account with Workers and Browser Rendering enabled, a Groq API key, and a Coinbase CDP API key. To use your own wallet as payTo, edit the PAY_TO constant in src/index.ts.

Roadmap

  • AgentParse: document/PDF/OCR to markdown service (also using the x402 + MCP pattern)
  • AgentSearch: multi-backend web search aggregation
  • LangChain integration package (langchain-agent-scrape)
  • Subscription plans ($2.50 for 1,000 scrapes)
  • Multi-asset support (USDT on Base, USDC on Arbitrum)
  • Webhook + async response options for long-running workflows

License and Entity

MIT license, see LICENSE. Built by HSH Intelligence, operated by Healing Sun Haven LLC (Wyoming, USA).

Related Links

  • Service:https://agent-scrape.healingsunhaven.workers.dev
  • Repository:https://github.com/hshintelligence/agent-scrape

Related tools

Browse category