Bulk fetch content from any platform — bookmarks, user timelines, keyword search, album pages, wiki trees.
Trigger
Activate when user mentions batch/bulk operations:
/feedgrab-batch <command> <args>- "Grab all my bookmarks"
- "Bulk scrape this user's tweets"
- "Search keyword AI Agent"
- "Scrape all articles from this official account"
- "Download this Feishu knowledge base"
Prerequisites
- feedgrab installed (
which feedgrab) - Platform-specific cookies/API keys configured (see each command below)
If not ready, suggest /feedgrab-setup.
Command Reference
X/Twitter
Bookmarks
# Requires: X_BOOKMARKS_ENABLED=true + feedgrab login twitter (primary session only)
feedgrab https://x.com/i/history # All bookmarks (current X URL)
feedgrab https://x.com/i/history/bookmarks/2015311287715340624 # Specific folder
feedgrab https://x.com/i/bookmarks # Legacy URL, still accepted
User Tweets
# Requires: X_USER_TWEETS_ENABLED=true + feedgrab login twitter
feedgrab https://x.com/username # All tweets
X_USER_TWEETS_SINCE=2026-01-01 feedgrab https://x.com/username # Since date
# Auto browser search supplement when >800 tweets
List Tweets
# Requires: X_LIST_TWEETS_ENABLED=true + feedgrab login twitter
feedgrab https://x.com/i/lists/LIST_ID # Last 1 day
X_LIST_TWEETS_DAYS=7 feedgrab https://x.com/i/lists/LIST_ID # Last 7 days
X_LIST_TWEETS_SUMMARY=true feedgrab https://x.com/i/lists/LIST_ID # + summary table
Keyword Search (x-so)
feedgrab x-so "AI Agent" # Search tweets
feedgrab x-so "AI Agent" --days 7 # Last 7 days
feedgrab x-so "AI Agent" --min-faves 100 # Min 100 likes
feedgrab x-so WorkBuddy --lang zh+zxx --sort all # Chinese tweets + Article cards, merged Latest/Top
feedgrab x-so "claude,cursor,copilot" --merge # Multi-keyword merged table
feedgrab x-so "AI Agent" --raw # Raw query syntax
Output: Markdown table (sorted by views) + CSV at output/X/search/
Subreddit Batch
feedgrab reddit-sub MachineLearning --sort hot --limit 25
feedgrab reddit-sub ChatGPT --sort top --limit 50
Keyword Search (reddit-so)
feedgrab reddit-so "codex" --sort comments --time all --limit 10
feedgrab reddit-so "AI Agent" --subreddit ChatGPT --sort top --time week
REDDIT_SEARCH_SAVE_POSTS=true feedgrab reddit-so "open source" --limit 5
Output: Markdown summary at output/Reddit/. Use REDDIT_REPLY_MODE=tree|all when deep-fetching posts.
Xiaohongshu (小红书)
Author Notes
# Requires: XHS_USER_NOTES_ENABLED=true + feedgrab login xhs
feedgrab https://www.xiaohongshu.com/user/profile/USER_ID
XHS_USER_NOTES_SINCE=2026-01-01 feedgrab https://www.xiaohongshu.com/user/profile/USER_ID
Search Results
# Requires: XHS_SEARCH_ENABLED=true + feedgrab login xhs
feedgrab "https://www.xiaohongshu.com/search_result?keyword=开学第一课&source=web_explore_feed"
Keyword Search (xhs-so)
feedgrab xhs-so "AI Agent" # Search notes
feedgrab xhs-so "AI Agent" --sort popular # By popularity
feedgrab xhs-so "AI Agent" --type video # Videos only
feedgrab xhs-so "AI Agent" --save # Also save individual .md
feedgrab xhs-so "claude,cursor" --merge # Multi-keyword merged
Output: Markdown table (sorted by likes) + CSV at output/XHS/search/
WeChat (微信公众号)
By Account (mpweixin-id)
# Requires: feedgrab login wechat (MP backend session, ~4 day validity)
feedgrab mpweixin-id "公众号名称"
MPWEIXIN_ID_SINCE=2026-01-01 feedgrab mpweixin-id "公众号名称" # Since date
Album / Collection (mpweixin-zhuanji)
feedgrab mpweixin-zhuanji "ALBUM_URL" # No login needed
MPWEIXIN_ZHUANJI_SINCE=2026-01-01 feedgrab mpweixin-zhuanji "ALBUM_URL"
Sogou Search (mpweixin-so)
feedgrab mpweixin-so "关键词" # Search via Sogou
feedgrab mpweixin-so "关键词" --limit 30 # Max 30 results
YouTube
Search (ytb-so)
# Requires: YOUTUBE_API_KEY
feedgrab ytb-so "machine learning" # Search videos
feedgrab ytb-so "AI" --order viewCount # Sort by views
feedgrab ytb-so "AI" --channel @3blue1brown # Channel-specific
feedgrab ytb-so "AI" --days 30 # Last 30 days
Download
feedgrab ytb-dlv "VIDEO_URL" # Download video (MP4)
feedgrab ytb-dla "VIDEO_URL" # Download audio (MP3)
feedgrab ytb-dlz "VIDEO_URL" # Download subtitles (SRT)
Feishu/Lark (飞书)
Wiki Batch
# Requires: FEISHU_APP_ID + FEISHU_APP_SECRET
feedgrab feishu-wiki "WIKI_SPACE_URL"
Zhihu (知乎)
Keyword Search (zhihu-so)
# Requires: feedgrab login zhihu (for full content)
feedgrab zhihu-so "AI Agent" # Search Q&A + articles
feedgrab zhihu-so "AI Agent" --sort hot # By popularity
feedgrab zhihu-so "AI Agent" --limit 20 # Max 20 results
feedgrab zhihu-so "AI Agent" --days 30 # Last 30 days
feedgrab zhihu-so "claude,cursor" --merge # Multi-keyword merged
Output: Markdown table (sorted by upvotes) + CSV at output/Zhihu/search/
Environment Variables Quick Reference
| Platform | Required Variables | How to Get |
|---|---|---|
| Twitter (basic) | Cookie via feedgrab login twitter |
Login in browser |
| Twitter (paid API) | TWITTERAPI_IO_KEY |
twitterapi.io |
Optional Cookie via feedgrab login reddit; REDDIT_SEARCH_*, REDDIT_REPLY_MODE |
Login only if Cloudflare/private content requires it | |
| Xiaohongshu | Cookie via feedgrab login xhs |
Login in browser |
| WeChat batch | Cookie via feedgrab login wechat |
Login MP backend |
| YouTube | YOUTUBE_API_KEY |
Google Cloud Console |
| GitHub | GITHUB_TOKEN (optional) |
GitHub Settings |
| Feishu | FEISHU_APP_ID + FEISHU_APP_SECRET |
Feishu Open Platform |
| Zhihu | Cookie via feedgrab login zhihu |
Login in browser |
Resume After Interruption
All batch commands support checkpoint resume — if interrupted, just re-run the same command. Already fetched items are skipped via dedup index.
Tips
- Use
feedgrab doctor <platform>to diagnose configuration issues - Media download: set
X_DOWNLOAD_MEDIA=true/XHS_DOWNLOAD_MEDIA=true/MPWEIXIN_DOWNLOAD_MEDIA=true - Multi-account cookie rotation for Twitter: put extra cookies in
sessions/x_2.json,x_3.json