WORLDTECHNvidia's model GR00T 2 watches humans on video, then imagines itself as the robot
What happened
In a new research report on GR00T 2 , Nvidia introduces a new AI foundation model designed to shorten this process. Nvidia's new AI model GR00T 2 is designed to teach robots new tasks without laborious teleoperation (a person controlling a machine from somewhere else). NVIDIA is a semiconductor company based in Santa Clara, and its products and services include software.
Instead, the system transfers human hand movements from videos to robotic arms, trained on about 400,000 hours of video footage. Success rates still vary widely, though, ranging from 10 to 80 percent depending on the task.
Nvidia's new AI model GR00T 2 is designed to cut that effort by transferring human movements from videos to robotic arms.
To train a robot for new tasks, engineers usually spend hours remotely controlling the machines. This so-called teleoperation is expensive, slow, and needs its own data for every robot model.
Unlike previous approaches, including its predecessor GR00T 1, GR00T 2 doesn't translate camera images and language commands directly into motor movements. Nvidia says the software works as what the company calls a world-action model.
It simultaneously calculates the next movement and a short video of the immediate future. The system predicts how the camera image should change when a robotic arm picks up an object, for example.