SuperAPI AI Directory

x-fetcher

Data & analytics

View repository

Updated 10-15 22:40

About this skill

x-fetcher v2 — dual-capability content scraper

Install one skill, scrape two platforms:X (Twitter) + WeChat Official Account articles.

Trigger scenarios

As long as any of the following appears in the user's message, this skill is automatically invoked:

Platform URL features Which script to use
X / Twitter x.com/*/status/* or twitter.com/*/status/* python fetch_x.py <url>
WeChat Official Account mp.weixin.qq.com/s/* python fetch_wechat.py <url>

Core commands

X / Twitter

python fetch_x.py <x_url> [选项]

Options:--save-md / --with-replies / --full / --json / --save-video(🆕 download tweet video)

See the "X scraping" section of the root README for details.

WeChat Official Account

python fetch_wechat.py <wechat_url>

Output: title + author + word count + body text (plain text).

Execution flow

  1. Identify the URL platform (x.com / twitter.com / mp.weixin.qq.com)
  2. Call the corresponding script
  3. Parse the output
  4. Deliver directly to the user, or continue downstream processing (translation / summarization / publishing / archiving)

Notes

  • Only applies to public content (private accounts / articles requiring login cannot be scraped)
  • WeChat links are usually valid for a long time; a very small number of old articles may become invalid
  • Depends on Python requests library (already in requirements.txt)
  • Cross-platform SSL: WeChat scraping uses Python requests(automatically handles certificates), no need for the curl -k hack on macOS