Feature Description
This skill uses the Firecrawl API to provide professional web scraping capabilities:
- Single-page scraping (supports dynamic content)
- Structured data extraction
- Bulk website crawling
- Search and scrape
How to Use
1. Scrape a single web page
./scripts/firecrawl.sh scrape <url> [format]
- format: markdown (default), html, text, json
2. Extract structured data
./scripts/firecrawl.sh extract <url> <schema>
3. Crawl a website in bulk
./scripts/firecrawl.sh crawl <url> [max_pages]
4. Search and scrape
./scripts/firecrawl.sh search <query> [limit]
API Key
Stored at: pass show api/firecrawl
Examples
Scrape a Polymarket page
./scripts/firecrawl.sh scrape "https://polymarket.com/event/fed-decision-in-march-885"
Extract product information
./scripts/firecrawl.sh extract "https://example.com/product" '{"name": "string", "price": "number"}'
Search AI news
./scripts/firecrawl.sh search "latest AI news" 5
Notes
- Firecrawl has usage limits (depending on the plan)
- Complex web pages may require longer processing time
- Some websites may have anti-scraping mechanisms