HiDream.ai Advances Its Native Omni-Modal Roadmap with HiDream-O1-World, an Interactive World Model
- Written by Media Outreach
BEIJING, CHINA - Media OutReach Newswire - 24 August 2026 - HiDream.ai today launched HiDream-O1-World, a native omni-modal interactive world model that lets users generate complete, explorable 3D worlds from a single text prompt, image, or interactive control.
The model combines three core capabilities — roaming, editing, and interaction — and is built on HiDream.ai's self-developed UiT (Unified Transformer) architecture. The upgraded UiT delivers a key breakthrough on two persistent challenges in the field: spatiotemporal consistency and physical consistency. As cameras pan, zoom, or track, scene geometry remains stable — objects don't vanish or deform, and collisions, occlusions, and gravitational responses follow real-world causal logic rather than appearing as randomly stitched frames. "The value of an interactive world model isn't in generating a photorealistic 3D scene — it's in AI beginning to genuinely understand the depth of space, the texture of objects, the inertia of motion, and the logic of light and shadow," said Yao Ting, CTO of HiDream.ai. "This is a systematic reconstruction of how the physical world works. HiDream-O1-World is the first bridge in that reconstruction — every interaction leads to a world never reached before." Topping the Leaderboard on Debut HiDream-O1-World's first third-party benchmark results came from WBench, an interactive world model evaluation benchmark jointly developed by Meituan's LongCat team and Fudan University. The model topped the core Navi sub-leaderboard with an average score of 80.9, ranked first in the Physical dimension at 73.3, and scored 88.0 on Consistency — the best overall performance on the board. WBench covers 289 multi-turn interaction cases and 1,058 interaction turns across five dimensions and 22 metrics. Its Navi board, focused on spatial navigation and viewpoint control, is widely regarded as the core measure of a world model's spatial understanding. Topping Navi on its first entry, HiDream-O1-World sets a new performance ceiling for interactive world models — outperforming established players including Tencent Hunyuan 1.5. One-Click World Generation for Immersive Interaction The model lets users generate structurally complete, stylistically diverse interactive worlds from a short description, a single image, or simple controls. Upload a photo of a room, for example, and the model rapidly constructs a high-precision digital twin, completing the full panorama with accurate proportions and fine-grained detail. Users can explore worlds in first-person or third-person mode, freely driving a character and adjusting viewpoints. In a diving scene, light patterns on the water surface and refracted glimmers on the seabed shift in sync with the camera; coral textures remain crisp and drift-free throughout. Beyond roaming, HiDream-O1-World enables real-time editing — directing characters to grab, run, crouch, or jump, or triggering environmental events like rainfall. Changes maintain globally unified coherence across geometry, lighting, materials, and physical logic, ensuring every interaction remains self-consistent. The model generalizes across humans, animals, and fictional characters, adapting to each one's form and motion. In a snow-climbing scene, footprints press realistic indentations into the snow, snowflakes drift at varied speeds, and distant ridgelines blend naturally with rock textures as the viewpoint shifts. It supports a wide scene and stylistic range — from real city streets and natural terrain to anime-style cartoons and AAA-game-grade rendering. Two Core Breakthroughs: Spatiotemporal and Physical Consistency Interactive world models have long been constrained by three problems: space, physics, and memory. Camera switches cause blurring and scene drift; physics violations undermine credibility; and without long-term memory, objects disappear when the view turns. HiDream-O1-World addresses these through two coordinated capabilities: Long-horizon spatiotemporal consistency. The model pairs 3D priors injected into Memory context with Test-Time Training (TTT) online maintenance. The Memory mechanism encodes scene geometry and object relationships as 3D priors, letting the model "remember" explored structures across viewpoint switches — fundamentally eliminating drift and scene resets. TTT performs lightweight online adaptation during inference, dynamically optimizing adapters so internal representations stay aligned with the scene's 3D constraints. Where conventional models act like a painter redrawing every frame — with errors compounding into drift and vanishing objects — HiDream-O1-World behaves like a director with spatial memory: it records scene structure rather than re-guessing the environment at each step, recalling the corresponding view when the camera moves. Globally stable physical consistency. On the training side, a generative world simulator...
The model combines three core capabilities — roaming, editing, and interaction — and is built on HiDream.ai's self-developed UiT (Unified Transformer) architecture. The upgraded UiT delivers a key breakthrough on two persistent challenges in the field: spatiotemporal consistency and physical consistency. As cameras pan, zoom, or track, scene geometry remains stable — objects don't vanish or deform, and collisions, occlusions, and gravitational responses follow real-world causal logic rather than appearing as randomly stitched frames. "The value of an interactive world model isn't in generating a photorealistic 3D scene — it's in AI beginning to genuinely understand the depth of space, the texture of objects, the inertia of motion, and the logic of light and shadow," said Yao Ting, CTO of HiDream.ai. "This is a systematic reconstruction of how the physical world works. HiDream-O1-World is the first bridge in that reconstruction — every interaction leads to a world never reached before." Topping the Leaderboard on Debut HiDream-O1-World's first third-party benchmark results came from WBench, an interactive world model evaluation benchmark jointly developed by Meituan's LongCat team and Fudan University. The model topped the core Navi sub-leaderboard with an average score of 80.9, ranked first in the Physical dimension at 73.3, and scored 88.0 on Consistency — the best overall performance on the board. WBench covers 289 multi-turn interaction cases and 1,058 interaction turns across five dimensions and 22 metrics. Its Navi board, focused on spatial navigation and viewpoint control, is widely regarded as the core measure of a world model's spatial understanding. Topping Navi on its first entry, HiDream-O1-World sets a new performance ceiling for interactive world models — outperforming established players including Tencent Hunyuan 1.5. One-Click World Generation for Immersive Interaction The model lets users generate structurally complete, stylistically diverse interactive worlds from a short description, a single image, or simple controls. Upload a photo of a room, for example, and the model rapidly constructs a high-precision digital twin, completing the full panorama with accurate proportions and fine-grained detail. Users can explore worlds in first-person or third-person mode, freely driving a character and adjusting viewpoints. In a diving scene, light patterns on the water surface and refracted glimmers on the seabed shift in sync with the camera; coral textures remain crisp and drift-free throughout. Beyond roaming, HiDream-O1-World enables real-time editing — directing characters to grab, run, crouch, or jump, or triggering environmental events like rainfall. Changes maintain globally unified coherence across geometry, lighting, materials, and physical logic, ensuring every interaction remains self-consistent. The model generalizes across humans, animals, and fictional characters, adapting to each one's form and motion. In a snow-climbing scene, footprints press realistic indentations into the snow, snowflakes drift at varied speeds, and distant ridgelines blend naturally with rock textures as the viewpoint shifts. It supports a wide scene and stylistic range — from real city streets and natural terrain to anime-style cartoons and AAA-game-grade rendering. Two Core Breakthroughs: Spatiotemporal and Physical Consistency Interactive world models have long been constrained by three problems: space, physics, and memory. Camera switches cause blurring and scene drift; physics violations undermine credibility; and without long-term memory, objects disappear when the view turns. HiDream-O1-World addresses these through two coordinated capabilities: Long-horizon spatiotemporal consistency. The model pairs 3D priors injected into Memory context with Test-Time Training (TTT) online maintenance. The Memory mechanism encodes scene geometry and object relationships as 3D priors, letting the model "remember" explored structures across viewpoint switches — fundamentally eliminating drift and scene resets. TTT performs lightweight online adaptation during inference, dynamically optimizing adapters so internal representations stay aligned with the scene's 3D constraints. Where conventional models act like a painter redrawing every frame — with errors compounding into drift and vanishing objects — HiDream-O1-World behaves like a director with spatial memory: it records scene structure rather than re-guessing the environment at each step, recalling the corresponding view when the camera moves. Globally stable physical consistency. On the training side, a generative world simulator...
