Horizon - Open-Source AI Information Aggregation System, Build Your Own News Radar

What is Horizon

Horizon is an open-source AI-driven information aggregation system that helps users build their own AI news radar. The tool supports scraping information from multiple sources such as RSS, Hacker News, GitHub, Reddit, Telegram, Twitter/X, and more. It uses AI for deduplication, scoring, summarization, and background knowledge supplementation, and ultimately outputs bilingual daily briefings in Chinese and English via web pages, email, Webhook, or MCP, enabling users to efficiently obtain core developments in the AI field.

Main Features of Horizon

• Multi-Source Information Aggregation: Supports automatic content scraping from channels such as RSS, Hacker News, GitHub Trending, Reddit, Telegram, Twitter/X, OpenBB, and more.
• AI Intelligent Scoring: Uses large models to score the relevance of information (0-10 points), filtering by three levels: high signal, reference-worthy, and low signal.
• Automatic Deduplication and Summarization: Uses AI to remove duplicate content and generate structured summaries, background knowledge, and community discussion highlights.
• Multi-Format Output: Supports generating web dashboards, email briefings, Webhook push, and MCP protocol distribution.
• Flexible Filtering and Search: Can filter content by score threshold, information source category, time window (24h/3 days/7 days), and exact keyword matching.

Technical Principles of Horizon

• Asynchronous Scraping Engine: Uses an asynchronous architecture to pull data from multiple information sources in parallel, improving collection efficiency and real-time performance.
• LLM Scoring and Summarization: Uses large models such as Claude, GPT, Gemini, DeepSeek, Doubao, MiniMax, OpenClaw, Ollama, and others for content quality assessment and text generation.
• Deduplication Algorithm: Filters duplicate information through a content similarity detection mechanism to avoid information redundancy.
• Background Knowledge Enhancement: Uses AI to supplement background, organize references, and aggregate community opinions for high-value content.
• Modular Output Pipeline: Distributes processed content through standardized interfaces such as Pages, Email, Webhooks, and MCP.

How to Use Horizon

• Clone the Repository: Pull the Horizon project source code from GitHub to a local server.
• Install Dependencies: Use the uv tool to install the Python dependency packages required by the project.
• Configure API Key: Fill in the large model vendor API Key (such as OpenRouter) and the required information source credentials in the configuration file.
• Set Information Sources: Enable scraping channels such as RSS, GitHub, Hacker News, Twitter/X, and more as needed, and configure parameters.
• Start Aggregation: Run the main program, and the system automatically scrapes, scores, summarizes, and generates a daily briefing.
• View Output: Receive the AI-filtered information briefing through the generated web dashboard or configured email/Webhook.

Core Advantages of Horizon

• Fully Open Source: Users can freely deploy, customize information sources and output rules, with high data autonomy.
• Multi-Model Compatibility: Supports integration with mainstream and open-source models such as OpenRouter, DeepSeek, xAI, and others, with controllable cost and flexibility.
• Bilingual Briefing: Automatically generates daily briefings in both Chinese and English, covering developments in both domestic and international AI communities.
• Low-barrier deployment: Runs with only a large model API Key, simple configuration, supports quick installation via uv.

Horizon's project address

• Project official website：https://www.horizon1123.top/
• GitHub repository：https://github.com/Thysrael/Horizon

Comparison of Horizon's similar competitors

Horizon's application scenarios

• Daily news quick review for AI practitioners: Quickly grasp trending GitHub projects, Hacker News technical discussions, and official Twitter updates.
• Topic selection for tech self-media content: Screen high-value topics through scoring, assisting in determining article topics and tracking hotspots.
• Team tech radar building: Aggregate cutting-edge technology trends for enterprise tech teams and regularly push internal briefings.
• Personal knowledge management: Build a customized information feed to replace traditional RSS readers and achieve AI-assisted screening.