Genie Envisioner - Jiyuan's open-source general-purpose robotics platform with Beihang and others

What is Genie Envisioner?

Genie Envisioner (GE) is a unified platform for robot operation developed by the Genie Robotics team in collaboration with National University of Singapore and Beijing University of Aeronautics and Astronautics. The core of GE consists of three parts: GE-Base, GE-Act, and GE-Sim. GE-Base is a command-driven video diffusion model that captures the dynamics of robot interactions in the real world. -Act is based on GE-Base and transforms potential representations into executable action trajectories, supporting robots with different morphologies.GE-Sim is an action-conditioned neural simulator that generates high-fidelity simulation videos for training and evaluation.

Genie Envisioner Features

• unified operating platform: Genie Envisioner is a universal robot-oriented operating platform that adapts to a wide range of robot morphologies and enables end-to-end processing from sensing to execution.
• Mental rehearsal and action planningThe model of "Imagine First, Act Later" is adopted, in which the robot generates the optimal action plan through mental rehearsal and then executes it in the real world, which improves the accuracy and efficiency of task execution.
• multimodal fusion: The GE-Base model is based on a command-driven video diffusion technique that captures the spatio-temporal and semantic dynamics of robot interactions and realizes the multimodal fusion of vision, speech and action.
• High-fidelity simulation and training: GE-Sim, as a neural simulator of action conditions, generates high-fidelity simulation videos, supports large-scale training and evaluation, and helps robots better adapt to complex environments.
• Standardized assessment benchmarks: Provides the EWMBench benchmark suite for measuring visual fidelity, physical consistency, and command-action alignment to facilitate standardized evaluation of robot performance.
• Open Source and Scalability: All codes, models and benchmarks will be publicly released to facilitate further exploration and application by researchers and developers to advance robotics.

Core Benefits of Genie Envisioner

• Highly versatile: It can be adapted to a wide range of robot morphologies and support different types of robot tasks with broad applicability.
• end-to-end capability: It realizes the integrated processing of the whole process from environment sensing, instruction understanding to action execution, and enhances the robot's autonomy and intelligence.
• mental rehearsal mechanism: Optimize the course of action and reduce errors and risks in real operations by previewing them in a simulated environment.
• high fidelity simulation: GE-Sim generates highly realistic simulation videos that effectively support robot training and strategy optimization.
• Standardized assessment: Provides the EWMBench benchmarking suite, which facilitates standardized evaluation of robot performance and promotes the standardization of the technology.

What is Genie Envisioner's official website?

• Project website:: https://genie-envisioner.github.io/
• GitHub repository:: https://github.com/AgibotTech/Genie-Envisioner
• arXiv Technical Paper:: https://arxiv.org/pdf/2508.05635

Who Genie Envisioner is for

• Robotics researchers: Genie Envisioner provides powerful research tools and an open-source platform that can help researchers explore the frontiers of robotics operations and drive further development of robotic intelligence.
• Robotics Development Engineer: Versatility and end-to-end solutions enable engineers to more efficiently develop and optimize robotic applications, adapting to a wide range of robotic hardware and task scenarios.
• Universities and Research Institutions: Provide standardized assessment benchmarks and rich resources for education and research, facilitate robotics-related teaching and research projects, and train professionals.
• Industrial automation companies: It can be applied to industrial production lines to optimize the robot operation process, improve production efficiency and quality, and reduce manual intervention.
• Service Robot Developer: Apply to the field of service robots, enhance the robot's ability to adapt in complex environments and the ability to perform tasks, and expand the application scenarios of service robots.