SIGGRAPH—To accelerate humanoid development worldwide, NVIDIA is providing top robot manufacturers, AI model developers, and software makers with a suite of services, models, and computing platforms to develop, train, and build the next generation of humanoid robots.
The offerings include new NVIDIA NIM microservices and frameworks for robot simulation and learning, the NVIDIA OSMO orchestration service for running multi-stage robotics workloads, and an AI- and simulation-enabled teleoperation workflow that allows developers to train robots using small amounts of human demonstration data.
NVIDIA is advancing its entire robotics stack, opening access for worldwide humanoid developers and companies to use the platforms, acceleration libraries, and AI models best suited for their needs.
The NIM microservices provide pre-built containers powered by NVIDIA inference software, enabling developers to reduce deployment times from weeks to minutes. The MimicGen NIM microservice generates synthetic motion data based on recorded teleoperated data, while the Robocasa NIM microservice generates robot tasks and simulation-ready environments in OpenUSD.
NVIDIA OSMO is a cloud-native managed service that allows users to orchestrate and scale complex robotics development workflows across distributed computing resources. It simplifies robot training and simulation workflows, cutting deployment and development cycle times from months to under a week.
Developers can use teleoperation to capture human demonstration data, but this process is becoming expensive and lengthy. NVIDIA’s AI- and Omniverse-enabled teleoperation reference workflow allows researchers and AI developers to generate massive amounts of synthetic motion and perception data from a minimal amount of remotely captured human demonstrations.
Fourier, a general-purpose robot platform company, sees the benefit of using simulation technology to synthetically generate training data. “NVIDIA’s new simulation and generative AI developer tools will help bootstrap and accelerate our model development workflows,” said Alex Gu, CEO of Fourier.
NVIDIA provides three computing platforms to ease humanoid robotics development: NVIDIA AI supercomputers to train models; NVIDIA Isaac Sim built on Omniverse, where robots can learn and refine their skills in simulated worlds; and NVIDIA Jetson Thor humanoid robot computers to run the models. Developers can access and use all or any part of these platforms for their specific needs.
Through a new NVIDIA Humanoid Robot Developer Program, developers can gain early access to the new offerings as well as the latest releases of NVIDIA Isaac Sim, NVIDIA Isaac Lab, Jetson Thor, and Project GR00T general-purpose humanoid foundation models.
Source: https://nvidianews.nvidia.com/news/nvidia-accelerates-worldwide-humanoid-robotics-development