wechat-article-extractor

WeChat Article Extractor

Extract metadata and content from WeChat Official Account (微信公众号) articles.

Capabilities

• Parse WeChat article URLs (mp.weixin.qq.com)
• Extract article metadata: title, author, description, publish time
• Extract account info: name, avatar, alias, description
• Get article content (HTML)
• Get cover image URL
• Support multiple article types: post, video, image, voice, text, repost
• Handle various error cases: deleted content, expired links, access limits

Usage

Basic Extraction from URL

const { extract } = require('./scripts/extract.js');

const result = await extract('https://mp.weixin.qq.com/s?__biz=...');
// Returns: { done: true, code: 0, data: {...} }

Extraction from HTML

const html = await fetch(url).then(r => r.text());
const result = await extract(html, { url: sourceUrl });

Options

const result = await extract(url, {
  shouldReturnContent: true,      // Return HTML content (default: true)
  shouldReturnRawMeta: false,     // Return raw metadata (default: false)
  shouldFollowTransferLink: true, // Follow migrated account links (default: true)
  shouldExtractMpLinks: false,    // Extract embedded mp.weixin links (default: false)
  shouldExtractTags: false,       // Extract article tags (default: false)
  shouldExtractRepostMeta: false  // Extract repost source info (default: false)
});

Response Format

Success Response

{
  done: true,
  code: 0,
  data: {
    // Account info
    account_name: "公众号名称",
    account_alias: "微信号",
    account_avatar: "头像URL",
    account_description: "功能介绍",
    account_id: "原始ID",
    account_biz: "biz参数",
    account_biz_number: 1234567890,
    account_qr_code: "二维码URL",

    // Article info
    msg_title: "文章标题",
    msg_desc: "文章摘要",
    msg_content: "HTML内容",
    msg_cover: "封面图URL",
    msg_author: "作者",
    msg_type: "post", // post|video|image|voice|text|repost
    msg_has_copyright: true,
    msg_publish_time: Date,
    msg_publish_time_str: "2024/01/15 10:30:00",

    // Link params
    msg_link: "文章链接",
    msg_source_url: "阅读原文链接",
    msg_sn: "sn参数",
    msg_mid: 1234567890,
    msg_idx: 1
  }
}

Error Response

{
  done: false,
  code: 1001,
  msg: "无法获取文章信息"
}

Error Codes

Code	Message	Description
1000	Failed to retrieve article	General failure
1001	Unable to retrieve article information	Missing title or publish time
1002	Request failed	HTTP request failed
1003	Response is empty	Empty response
1004	Accessed too frequently	Rate limited
1005	Script parsing failed	Script parsing error
1006	Official Account has been migrated	Account migrated
2001	Please provide the article content or link	Missing input
2002	Link has expired	Link expired
2003	Content suspected of infringement	Content removed (copyright)
2004	Unable to retrieve the link after migration	Migration link failed
2005	Content has been deleted by the publisher	Content deleted by author
2006	Content cannot be viewed due to violations	Content blocked
2007	Content sending failed	Failed to send
2008	System error	System error
2009	Unsupported link	Unsupported URL
2010	Failed to retrieve content	Content fetch failed
2011	Suspected of excessive marketing	Marketing/spam content
2012	Account has been blocked	Account blocked
2013	Account has been voluntarily deregistered	Account deleted
2014	Content has been reported	Content reported
2015	Account is in the migration process	Account migrating
2016	Impersonation and infringement	Impersonation

Dependencies

Required npm packages:

• cheerio - HTML parsing
• dayjs - Date formatting
• request-promise - HTTP requests
• qs - Query string parsing
• lodash.unescape - HTML entities

Notes

• Handles various WeChat page structures and anti-scraping measures
• Automatically detects article type from page content
• Supports extracting from Sogou WeChat search results (weixin.sogou.com)
• Some fields may be null depending on article type and page structure