Nvidia Announces Project GR00T Foundation Model to Power Humanoid Robots

Nvidia introduces Project GR00T, a new foundation model designed to help humanoid robots understand language, process environments, and mimic human actions. The company also unveils the Jetson Thor computing platform and updates to its Isaac robotics tools to support this advanced embodied AI.

Nvidia unveils Project GR00T, a general-purpose foundation model designed specifically for bipedal humanoid robots. The company introduces this breakthrough at its GTC 2024 conference to advance embodied AI research and bring robots closer to artificial general robotics. With this new model, robots gain the ability to understand natural language, process their surroundings, and emulate human movements safely in industrial and everyday environments.

To power these advanced AI models, Nvidia reveals Jetson Thor, a specialized computing platform built on the Nvidia Thor system-on-chip. This new "robot brain" features a next-generation GPU with a transformer engine that delivers 800 teraflops of performance for multimodal generative AI tasks. The hardware allows humanoid robots to handle complex actions and process data from multiple sensors simultaneously.

Alongside the new model and hardware, Nvidia updates its Isaac platform with tools like Isaac Lab for reinforcement learning and OSMO for compute orchestration. Industry leaders, such as Agility Robotics, praise these enabling technologies as a historical inflection point that accelerates the development of human-centric robots. These combined advancements pave the way for machines to reduce hazardous labor and assist people in daily life.

Read More at the original source →