What is Hy-MT1.5-1.8B-1.25bit
Hy-MT1.5-1.8B-1.25bit is an extremely quantized and compressed on-device offline translation large model released by the Tencent Hunyuan team. The model is built on the Hunyuan translation large model Hy-MT1.5-1.8B(1.8 billion parameters), and through the innovative Sherry sparse ternary quantization technology, the model is compressed to only 440MB. It supports 33 languages, 5 dialects/minority languages, and 1056 translation directions, can run locally on mobile phones without an internet connection, and its translation quality surpasses mainstream commercial systems such as Google Translate.
Main features of Hy-MT1.5-1.8B-1.25bit
-
Offline mutual translation among 33 languages: Covers mainstream languages such as Chinese-English, French-Japanese, Arabic, and Russian, as well as minority languages such as Tibetan and Mongolian, with a total of 1056 translation directions.
-
Local operation on mobile phones: After downloading the model, translation can be performed completely offline, without an internet connection, and without consuming data.
-
Background word capture translation: The accompanying Demo supports a "background word capture mode", allowing translation to be invoked at any time while browsing web pages or checking emails.
-
Real-time text translation: Quickly generates translation results after inputting or pasting text, and supports copying the output.
-
Multilingual direction switching: Supports bidirectional translation switching between any language pair.
Technical principles of Hy-MT1.5-1.8B-1.25bit
-
Base model: Based on the Tencent Hunyuan translation large model Hy-MT1.5-1.8B (1.8B parameters), this model is built through a multi-stage training framework of "general pretraining -> MT-oriented pretraining -> supervised fine-tuning -> online distillation -> reinforcement learning".
-
Sherry sparse ternary quantization (1.25-bit): Adopts a fine-grained sparsity strategy, in which 3 out of every 4 parameters are stored with 1-bit (values -1 or 1), and 1 is set to 0, requiring an average of only 1.25 bits per parameter.
-
STQ dedicated kernel: A sparse ternary quantization inference kernel designed by Tencent specifically for mobile phone CPUs, perfectly adapted to SIMD instruction sets for efficient decoding.
-
Quantization-aware training (QAT): Through distribution alignment and offset optimization during training, it alleviates the accuracy loss caused by ultra-low-bit quantization.
-
GRPO reinforcement learning: Adopts the Group Relative Policy Optimization algorithm, combined with multi-dimensional scoring criteria (accuracy, fluency, consistency, cultural adaptability, readability) to optimize translation quality.
How to use Hy-MT1.5-1.8B-1.25bit
-
Download and install: Download the Demo APK from the ModelScope community https://modelscope.cn/models/AngelSlim/Hy-MT1.5-1.8B-1.25bit-GGUF/resolve/master/Hy-MT-demo.apk or HuggingFace and install it.
-
Launch and load: On first opening, the 440MB model is automatically loaded, and it can be used after loading is complete.
-
Text translation: Input or paste text and click Translate for offline translation; click the language bar at the bottom to switch the translation direction.
-
Background word capture: In other apps, long-press to select text and choose "offline translation"; the floating window directly displays the result without jumping to another page.
Key information and usage requirements of Hy-MT1.5-1.8B-1.25bit
-
Publisher: Tencent Hunyuan Team
-
Model parameters:1.8B
-
Quantization precision: 1.25-bit (Sherry sparse ternary quantization)
-
Model size:440MB
-
Supported platforms: Android (Demo version), iOS official version will be supported later
-
Open Source License: Model weights, code, and technical report are fully open-sourced
-
System: Android phones (the Demo version does not support iOS yet)
-
Memory: 8GB or above is recommended (demo devices were Snapdragon 865/888/7+Gen2 with 8GB/16GB memory)
-
Storage: Reserve about 500MB of space to download the model
-
Network: An internet connection is required to download the model for the first time; after that, it can be used completely offline
Core advantages of Hy-MT1.5-1.8B-1.25bit
-
Extreme lightweight design: The model is only 440MB, while the original FP16 version is 3.3GB, a compression ratio of about 7.5x, so it can stay resident in the background on ordinary phones.
-
High translation quality: On benchmarks such as Flores-200 and WMT25, the original 1.8B model has surpassed commercial APIs such as Google Translate, Baidu Translate, and Microsoft Translator, as well as larger open-source models such as Tower-Plus-72B and Qwen3-32B; the 1.25bit quantized version keeps a very small size while keeping quality loss controllable.
-
Fast inference speed: With the STQ kernel, translation speed on a Snapdragon 888 phone is about 8x faster than the FP16 version (1.9 seconds vs 58.2 seconds).
-
Fully offline with zero privacy risk: Completely local processing, no need to upload any data, no subscription fees, one download for permanent use.
-
Hardware-friendly adaptation: The 1.25bit solution is friendly to SIMD instruction sets, and Android phones across the board can run it smoothly.
Project address of Hy-MT1.5-1.8B-1.25bit
- HuggingFace Model Repository:https://huggingface.co/AngelSlim/Hy-MT1.5-1.8B-1.25bit
- arXiv Technical Paper:https://arxiv.org/pdf/2512.24092
Comparison of Hy-MT1.5-1.8B-1.25bit with similar competitors
| Comparison Dimension | Hy-MT1.5-1.8B-1.25bit | Tower-Plus-72B | Google Translate (Google Translate API) |
|---|---|---|---|
| Product Positioning | On-device offline translation large model | Open-source translation-specific large model | Commercial cloud translation service |
| Publisher | Tencent Hunyuan | Unbabel / Community | |
| Model Size | 440 MB | 145 GB | Cloud deployment (no local size) |
| Parameter Count | 1.8B | 72B | Not disclosed |
| Operation Mode | Runs locally offline on mobile phones | Requires servers / high-performance GPUs such as A100 | Cloud API calls |
| Network Requirement | ❌ Completely unnecessary | ✅ Must be deployed on a server | ✅ Must be connected to the internet |
| Supported Languages | 33 languages + 5 dialects/ethnic-minority Chinese | Multilingual | 100+ languages |
| Flores-200 (ZH↔XX) | 82.2 | 79.7 | 69.3 |
| Flores-200 (EN↔XX) | 87.4 | 86.2 | 77.0 |
| WMT25 | 57.0 | 41.0 | 38.9 |
| Minority↔Mandarin | 59.1 | 35.4 | 33.4 |
| Inference Speed | Extremely fast (on Snapdragon 888 only 1.9 seconds) | Slow (inference cost of a 72B large model is high) | Depends on network latency (usually 1–3 seconds) |
Application scenarios of Hy-MT1.5-1.8B-1.25bit
-
Overseas travel: Real-time translation of menus, road signs, and conversations in no-network environments (remote areas, airplanes, subways), solving the pain point of unstable overseas signal.
-
Business office: Offline processing of foreign-related emails and contract documents; sensitive business information is processed entirely locally, eliminating the risk of data upload.
-
Ethnic minority communication: Supports translation between Tibetan, Mongolian, Uyghur, and other minority languages and Chinese, serving daily communication and government affairs handling in border areas.
-
Academic research: Read foreign-language literature and papers locally, look up word translations at any time, and protect academic privacy and intellectual property.
-
Daily reading: Browse foreign-language web pages, social media, and e-books offline, and obtain high-quality translations without needing mobile data.