What is MnnLlmApp
MnnLlmApp is an Android mobile app open-sourced by Alibaba based on the MNN-LLM framework, supporting offline operation of various large language models (LLMs) on mobile phones. It features multimodal capabilities, enabling text-to-text generation, image-to-text generation, audio-to-text conversion, andtext-to-image generationand other tasks. The app has deeply optimized CPU inference, with prefill speed and decoding speed significantly outperforming similar products, ensuring efficient local operation. MnnLlmApp supports multiple mainstream models, such as Qwen, Gemma, Llama, etc., and users can choose different models for task processing as needed.
Main Features of MnnLlmApp
- Multimodal Interaction: Supports multiple input and output methods, including text-to-text generation, image-to-text generation, audio-to-text conversion, and text-to-image generation (based on diffusion models). Users can input text, images, or voice to obtain corresponding generated results.
- Model Selection and Switching: Built-in multiple mainstream large language models (LLMs), such as Qwen, Gemma, Llama, Baichuan, etc., allowing users to select different models according to their needs.
- Offline Operation: All features run on the local device without the need for an internet connection, ensuring data privacy and security.
- Performance Optimization: Deeply optimized for mobile CPU inference, with significantly improved prefill and decoding speeds, providing faster response speeds compared to similar apps.
- Local Storage: Supports saving generated content locally for users to view and use at any time.
How to Use MnnLlmApp
- Download and Install: The app can be downloaded directly from the Releases page, and developers can also build the app themselves.
- Self-Build Compilation Steps：
- Clone the repository: Visit the Github repository:https://github.com/alibaba/MNN。
- Build the library: Enter the
project/androiddirectory and run the build script. - Copy to the LLM Android app project.
- Build the Android app project and install.
Application Scenarios of MnnLlmApp
- Content Creation and Generation: Users can use the app to generate text content, such as writing articles, creating stories, generating copy, etc.
- Intelligent Assistant: As an intelligent assistant, MnnLlmApp can engage in natural language interaction with users, answer various questions, and provide services such as information queries and learning assistance.
- Language Learning: Helps users practice language expression, correct grammatical errors, and even provides language translation features.
- Creativity and Design: Through text generation and image generation features, it provides creative inspiration for designers, artists, etc. Automatically generates advertising copy, social media copy, etc., improving content creation efficiency.