Orbis - A real-time world model from Visko that makes AI video run like a livestream

What is Orbis

Orbis is the first Live Model (real-time world model) from Visko, making AI videorun continuously like a livestream. Users can enter new instructions at any time to change the direction of the visuals in real time, without waiting for a finished clip. The model supports 4K@24FPS real-time streaming generation, maintains hour-level long-term consistency through a multi-scale memory mechanism, and ensures realistic and natural motion based on causal temporal decomposition and physics-aware rewards, suitable for scenarios such as virtual livestreaming, interactive stories, and robot simulation.

Orbis's main features

• Real-time streaming generation: The visuals are output continuously without interruption like a livestream, supporting 4K@24FPS real-time delivery.
• Interaction during generation: Users can add or modify prompts at any time, and new instructions take effect on subsequent visuals within an average of 1 second.
• Multimodal input: Supports three ways to start the world: text-to-video, image-to-video, and video continuation.
• Long-term consistency: Through the multi-scale memory mechanism, it can maintain hour-level continuous generation without obvious quality degradation.
• Physical realism: Based on causal decomposition and world model rewards, it ensures object motion and interactions conform to the laws of physics.

Orbis's technical principles

• Causal temporal decomposition: Generation is treated as an initial value problem; each chunk predicts the next time period only from committed history, naturally matching the Markov structure of physical evolution and avoiding the problem in bidirectional denoising where "future noise contaminates current decisions".
• Bounded multi-scale memory: Recent history retains native latent resolution, distant history is progressively compressed, and information beyond the window is consolidated into a fixed-capacity learned state, decoupling memory and computational cost from rollout length.
• Progressive training pipeline: Use a bidirectional model to learn short-range visual priors, then distill it into a streaming generator, train it on event-aligned long videos, fine-tune it with manually curated data, and finally align it with visual and physical rewards through self-forced distribution matching and GRPO reinforcement learning.
• Physics-aware reward alignment: Introduces a frozen V-JEPA 2 latent world model to evaluate the predictive consistency between candidate frames and historical states, guiding generation to conform to real dynamics, and jointly optimizing with visual quality rewards.
• Streaming inference engineering: State reuse, compiled Transformer execution, multi-GPU sequence parallelism, and a progressive decoding-super-resolution-transmission pipeline work together to achieve 4K real-time delivery.

How to use Orbis

• Start a session: Visit the Visko official website Playground or call the API, enter text, upload an image, or paste a video prefix to start a real-time session.
• Start real-time generation: Click the Live button to start streaming generation, and the visuals will continuously and automatically evolve like a livestream.
• Intervene in the visuals in real time: Enter new prompts or voice instructions at any time during generation, and the direction of subsequent visuals can be changed in real time within an average of 1 second.
• Switch scenes seamlessly: Use "Morph the scene" to describe scene changes, and new instructions will be seamlessly incorporated at the next chunk boundary.
• Choose output quality: Select 1080p, 2K, or 4K output resolution as needed, and the system delivers high-quality visuals in real time through streaming super-resolution.
• Capture and Save Clips: Click the Clip button to capture and save the currently generated video clip at any time for later editing or sharing.
• Integrate into Your Own Application: By obtaining an API Key, Orbis's real-time generation capabilities can be integrated into your own applications, live streams, or robot simulation workflows.

Orbis's Core Advantages