What is Xiling Digital Human
Xiling Digital Human is a digital human platform launched by Baidu AI Cloud based on artificial intelligence technology, providing enterprise and individual developers with high-performance, easy-to-integrate, and diverse digital human component capabilities. The platform supports multi-scenario applications such as digital human image customization, video synthesis, interactive dialogue, and livestreaming, meeting the needs of different industries. It supports multiple types such as text-to-3D digital humans, 2D few-shot digital humans, 2D premium digital humans, and photo digital humans, and users can upload photos or videos for personalized customization. Through large models, it enables minute-level livestream room setup, supports streaming on multiple platforms, and digital humans can interact with bullet comments in real time. AI one-click script creation can generate high-quality talking-head videos.
Main features of Xiling Digital Human
-
2D and 3D digital human cloning: Users can quickly generate 2D or 3D digital human images by uploading photos, videos, or a simple description. The platform provides 800+ public portraits and 150+ public voice tones to choose from.
-
Efficient cloning modes: Supports two modes: "Premium Clone" and "Express Clone." Premium Clone is suitable for scenarios requiring a high degree of restoration of real people, such as short video production for real-person IPs; Express Clone is suitable for scenarios pursuing rapid generation, such as in-store self-broadcasting.
- AI video creation
- Generate videos from a topic: Describe the video topic, content points, and target audience in the text box. Adjust the settings and generate a video with one click.
- Generate videos from a talking-head script: Simply input a talking-head script, and AI can intelligently understand the script content and automatically generate detailed storyboard visuals.
- Generate videos from PPT: Simply upload a PPT, and AI can automatically parse the PPT content and convert it into an explanatory video.
- Fission video generation：After users upload the main material for a fission video, select a digital human and voice tone, and fill in the product name and product selling points, broadcast copy is automatically generated, and through the large model's comprehension ability the video is mixed-edited and produced, ultimately generating marketing videos after fission in batches.
- AI card video generation: AI cards provide a massive selection of high-quality preset templates for you to choose from. Select a template, upload an ID photo, generate a 2D digital human image, and easily obtain personalized AI business cards, greeting cards, promotional pages, invitations, and postcards.
-
AI livestreaming: Through large model capabilities, ultra-fast streaming launch is achieved. Only a few simple clicks are needed to set up a professional livestream room, helping enterprises reduce costs and increase efficiency.
-
Personalized customization: Users can adjust the digital human in multiple dimensions, including face sculpting, changing hairstyle, clothing, and makeup, and can customize voices through TTS technology.
-
AI one-click creation: No need for a real person to appear on camera. Users input a script or keywords, and the platform can quickly generate high-quality talking-head videos.
-
Multilingual support: Supports multiple languages and voice tone options, suitable for various scenarios such as education and training, news broadcasting, and enterprise marketing.
-
Diverse templates: Provides a rich variety of video production templates, allowing users to quickly generate fission videos, finely edited videos, avatar videos, and more.
-
Intelligent dialogue: Based on Baidu ERNIE large model, digital humans can engage in natural and fluent conversations, supporting precise responses and broad-domain knowledge Q&A.
-
Real-time interaction: AI real-time script rewriting. The digital human can interact with bullet comments in real time and supports streaming on multiple platforms.
How to use Xiling Digital Human
-
Register an account: Visit the official website of Xiling Digital Human, click "Register", and fill in the relevant information (such as username, password, email, etc.) to complete registration.
-
Log in to the account: Use the registered account to log in to the platform. After successful login, you can claim a trial quota.
- Create a digital human
-
Choose a customization type: The platform offers multiple types, including photo digital humans, 2D few-shot digital humans, 2D premium digital humans, and 3D digital humans.
-
Upload materials: Upload the corresponding photo or video materials according to the selected type.
-
Custom settings: Adjust the digital human's appearance, such as facial features, hairstyle, clothing, etc.
-
Start cloning: After filling in the relevant information, click "Start Cloning" and wait for generation.
-
- Photo digital human cloning: The Xiling platform can generate a 2D digital human from a single-frame photo in seconds. Fill in the portrait name - upload the base photo - start cloning; select automatic cutout (which enables automatic cutout for easy background replacement).
- Digital Human Plaza: The platform provides 400+ portraits for users to use in live streaming and video applications. Through filtering, you can choose a digital human image that suits you according to the usage scenario.
- AI video creation
- Generate video from a theme: Describe the video theme, content points, and target audience in the text box. Adjust the settings and generate a video with one click.
- Generate video from a voiceover script: Simply input the voiceover script. AI can intelligently understand the script content and automatically generate detailed storyboard frames.
- Generate video from PPT: Simply upload a PPT, and AI can automatically parse the PPT content and turn it into an explanatory video.
- Fission video generation：After users upload the main material for a fission video, select a digital human and voice, and fill in the product name and product selling points, the platform automatically generates broadcast copy and uses the large model's comprehension ability to mix, edit, and produce the video, ultimately generating fissioned marketing videos in batches.
- AI card video generation: AI cards provide a large number of high-quality preset templates for you to choose from. Select a template, upload an ID photo, and generate a 2D digital human image to easily obtain personalized AI business cards, greeting cards, promotional pages, invitations, and postcards.
Features of Xiling Digital Human
- Natural movements and expressions: Using AI algorithms, the digital human can simulate real people's expressions and movements, achieving natural and accurate speaking mouth shapes and the generation of movements and expressions during real-time conversations.
- Multiple rendering modes: Supports rendering methods for different terminal requirements, is compatible with multiple communication protocols, and adapts to multi-terminal scenarios.
- ERNIE large model: Based on large model technology, it empowers the digital human with intelligence and enables question-and-answer interaction capabilities in multiple scenarios.
- Ultra-fast customization: Provides fast personalized customization services, including 2D real-person digital avatar training and 3D digital human model construction.
- Speech generation: Provides multiple TTS voices, making information delivery more vivid and persuasive.
- Monocular Motion Capture: Use a single camera to achieve 3D digital human motion capture, lowering the driving threshold and improving motion realism.
Application Scenarios of Xiling Digital Humans
- Virtual Live Streaming: Use digital humans for 24-hour uninterrupted live streaming, suitable for news broadcasting, game live streaming, e-commerce live streaming, and more.
- Video Production: Quickly generate high-quality video content, serving brand marketing, product introductions, education and training, and more.
- Virtual Interaction: In fields such as customer service, online education, and virtual tour guides, provide interactive experiences through digital humans.
- IP Incubation: Create virtual images for original IP or brands, and enhance brand influence and user engagement through digital humans.
- Real-Person Cloning: Create digital human avatars of public figures or specific individuals for specific events or long-term endorsements.
- Financial Services: In banking and finance, digital humans can provide wealth management consulting, customer service, investment advice, and more.
- Cultural Tourism Promotion: As virtual tour guides or ambassadors, provide promotional and explanatory services for cultural tourism destinations.
- Enterprise Customer Service: As virtual customer service, provide 24-hour customer consultation services and answer user questions.
