SuperAPI AI Directory

rust-browser-pilot

General & other

View repository

Updated 11-06 16:22

About this skill

Blazing-Fast Browser Automation

A Rust-based browser automation engine that provides a lightweight binary program and directly drives Chrome through CDP. Optimized for efficient DOM extraction, robust session management, and extreme speed.

Terminal demo

🧪 Agent Use Cases

1. Bypass "anti-scraping detection" by simulating human behavior

Simulate mouse jitter and random delays to scrape protected sites.

fast-browser-use navigate --url "https://protected-site.com" \
  --human-emulation \
  --wait-for-selector "#content"

2. "Deep Freeze" snapshots

Capture the complete DOM stateandcomputed styles for perfect later restoration.

fast-browser-use snapshot --include-styles --output state.json

3. Login and Cookie reuse

Log in manually once, then save the session for subsequent headless automation.

Step 1: Open a headed browser and log in manually

fast-browser-use login --url "https://github.com/login" --save-session ./auth.json

Step 2: Reuse the session afterward

fast-browser-use navigate --url "https://github.com/dashboard" --load-session ./auth.json

4. 🚜 Infinite scroll data collector

Extract the latest data from infinitely scrolling pages — ideal for collecting the latest posts, news, or social updates.

# Harvest headlines from Hacker News (scrolls 3x, waits 800ms between)
fast-browser-use harvest \
  --url "https://news.ycombinator.com" \
  --selector ".titleline a" \
  --scrolls 3 \
  --delay 800 \
  --output headlines.json

Actual output(59 unique results obtained in about 6 seconds):

[
  "Genode OS is a tool kit for building highly secure special-purpose OS",
  "Mobile carriers can get your GPS location",
  "Students using \"humanizer\" programs to beat accusations of cheating with AI",
  "Finland to end \"uncontrolled human experiment\" with ban on youth social media",
  ...
]

Works on all infinitely scrolling pages: Reddit, Twitter, LinkedIn feeds, search results, and more.

5. 📸 Quick screenshots

Save a screenshot of any page as PNG:

fast-browser-use screenshot \
  --url "https://example.com" \
  --output page.png \
  --full-page  # Optional: capture entire scrollable page

6. 🗺️ Sitemap and page structure analyzer

Understand how a website is organized overall by parsing sitemaps and analyzing page structure.

# Basic sitemap discovery (checks robots.txt + common sitemap URLs)
fast-browser-use sitemap --url "https://example.com"
# Full analysis with page structure (headings, nav, sections)
fast-browser-use sitemap \
  --url "https://example.com" \
  --analyze-structure \
  --max-pages 10 \
  --max-sitemaps 5 \
  --output site-structure.json

Parameter description:

  • --analyze-structure: Also extract page structure (title, navigation, sections, meta information)
  • --max-pages N: Limit the number of pages for structure analysis (default: 5)
  • --max-sitemaps N: Limit the number of sitemaps to parse (default: 10, suitable for large sites)

Example output:

{
  "base_url": "https://example.com",
  "robots_txt": "User-agent: *\nSitemap: https://example.com/sitemap.xml",
  "sitemaps": ["https://example.com/sitemap.xml"],
  "pages": [
    "https://example.com/about",
    "https://example.com/products",
    "https://example.com/contact"
  ],
  "page_structures": [
    {
      "url": "https://example.com",
      "title": "Example - Home",
      "headings": [
        {"level": 1, "text": "Welcome to Example"},
        {"level": 2, "text": "Our Services"}
      ],
      "nav_links": [
        {"text": "About", "href": "/about"},
        {"text": "Products", "href": "/products"}
      ],
      "sections": [
        {"tag": "main", "id": "content", "role": "main"},
        {"tag": "footer", "id": "footer", "role": null}
      ],
      "main_content": {"tag": "main", "id": "content", "word_count": 450},
      "meta": {
        "description": "Example company homepage",
        "canonical": "https://example.com/"
      }
    }
  ]
}

Use this feature to understand site architecture before scraping, map out navigation flows, or audit SEO structure.

⚡ Performance comparison

Feature Fast Browser Use (Rust) Puppeteer (Node) Selenium (Java)
Startup time < 50ms ~800ms ~2500ms
Memory usage 15 MB 100 MB+ 200 MB+
DOM extraction Zero-copy JSON serialization Slow bridge

Features and tools

Vision and extraction

  • vision_map: Return a screenshot with numbered borders, labeling all interactive elements.
  • snapshot: Capture a raw HTML snapshot (AI-optimized YAML/Markdown format).
  • screenshot: Take a visual screenshot of the page.
  • extract: Extract structured data from the DOM.
  • markdown: Convert the current page content to Markdown.
  • sitemap: Parse site structure through robots.txt, sitemaps, and page semantic analysis.

Navigation and lifecycle

  • navigate: Visit the specified URL.
  • go_back / go_forward: Navigate forward/back through browsing history.
  • wait: Pause execution or wait for a specific condition.
  • new_tab: Open a new tab.
  • switch_tab: Switch to the specified tab.
  • close_tab: Close the current or specified tab.
  • tab_list: List all open tabs.
  • close: Terminate the browser session.

Interactions

  • click: Click an element via CSS selector or DOM index.
  • input: Type text into an input field.
  • press_key: Send keyboard events.
  • hover: Hover over an element.
  • scroll: Scroll the viewport.
  • select: Select an option in a dropdown menu.

State and Debugging

  • cookies: Manage session cookies (get/set).
  • local_storage: Manage local storage data.
  • debug: Access console logs and debugging information.

Usage Instructions

This skill is designed for complex web interaction scenarios that require maintaining state (such as staying logged in), handling dynamic JavaScript content, or managing multiple pages simultaneously. Compared to standard fetch tools, it provides higher performance and finer-grained control.