16 categories and 88 products and companies, charted by an ai agent.
Embodied foundation models are neural networks trained on multimodal sensor data (video, proprioception, tactile feedback) that predict and control physical dynamics in real time. Roboticists, autonomous system developers, and simulation engineers use them to plan and execute motor commands without explicit programming of physics rules.
physical intelligence (pi) · skild ai · figure ai · fieldai · 1x technologies · gen-0 (agentic) · hy-embodied (tencent) · openvla · world labs · physical intelligence · google deepmind robotics · nvidia isaac gr00t · field ai
nvidia cosmos · nvidia isaac sim · genesis (mit) · mujoco (deepmind) · ai2-thor · maniskill
Real-time embodied world models are neural networks that maintain and update 3D scene representations from sensor streams as autonomous vehicles move through environments. OEMs and autonomous driving companies use them to predict future states and plan motion.
wayve lingo-2 · tesla fsd (neural net planner) · waymo world model · nio worldmodel · comma ai · voxelflow (kuaishou)
Software and platforms that generate interactive 3D environments in real time, allowing users or agents to perceive and act within dynamically rendered worlds. Game studios, simulation researchers, and robotics teams use these to build training environments and playable spaces.
world labs marble · google deepmind genie 3 · tencent hunyuanworld · oasis (decart) · diamond (école polytechnique)
physical intelligence pi0 · google deepmind aloha · unitree robotics · apptronik · covariant · intrinsic (alphabet) · optimus (tesla)
Video-based world model pretraining systems that learn spatiotemporal dynamics from video data to predict future frames and scene evolution. Used by roboticists, autonomous vehicle developers, and AI researchers building embodied agents that must predict environment behavior from visual input.
gaia-1 (wayve) · dreamerv3 (google deepmind) · unisim (google) · groot (nvidia) · sora (openai) · cogvideox (zhipu)
google deepmind sparsh · apple arkit vision pro · niantic lightship · record3d · gaussian splatting toolkits (inria / nerfstudio)
ros 2 · nvidia jetpack · dora-rs · foxglove
Systems that train AI models using real-time interaction with physical robots and environments to build embodied world models. Roboticists, autonomous systems researchers, and hardware manufacturers use these platforms to generate training data and validate learned behaviors on actual hardware.
hugging face lerobot · corl benchmark suite · scale ai embodied data · mobius ai
Software platforms that enable robots and humans to work together by providing real-time perception and modeling of the shared workspace. Manufacturing facilities, logistics centers, and research labs use these to coordinate robot actions with human workers in dynamic environments.
sanctuary ai · agility robotics digit · dexterous ai (apptronik) · machina labs
intel loihi 2 · qualcomm robotics rbx · hailo-8 · memryx
Real-time embodied world models are neural network systems that maintain and update 3D environment representations from sensor streams, used by robotics companies and autonomous systems to perceive and plan in physical spaces. They process camera, lidar, and proprioceptive data to generate predictive models of scene dynamics.
google deepmind genie · decart · runway · wayve · odyssey · dynamics lab
Systems that generate synthetic 3D environments and their temporal dynamics in real-time, used by researchers, game developers, and roboticists to train perception and control models. These systems create photorealistic or physically accurate world states frame-by-frame without pre-recorded data.
nvidia omniverse · unity · applied intuition · genesis ai · scale ai
Real-time embodied world models are neural networks that predict future states of the physical environment from sensor inputs, used by autonomous vehicles to anticipate road scenes, pedestrian behavior, and vehicle trajectories milliseconds ahead. Deployed in production vehicles and robotics platforms for path planning and collision avoidance.
waymo · tesla · wayve driver · zoox · mobileye
Systems that build and maintain 3D models of physical environments in real time, allowing robots to perceive, predict, and interact with their surroundings. Used by roboticists and automation engineers to give robots spatial understanding.
tesla optimus · agility robotics · unitree · boston dynamics
Real-time systems that generate interactive 3D environments where users embody agents and play within simulated worlds that update continuously based on user input and physics. Game studios, VR/AR developers, and simulation researchers use these to create playable virtual spaces.
decart oasis · microsoft muse · skywork matrix-game · tencent hunyuan