The Isaac GR00T platform helps robotics builders scale humanoid information assortment and simulation-based coaching to develop, validate, and deploy insurance policies on actual robots. | Supply: NVIDIA
NVIDIA and Hugging Face are collaborating to carry the NVIDIA Isaac GR00T 1.7 and the NVIDIA Isaac Teleop framework to LeRobot, Hugging Face’s open-source robotics library. The businesses stated they hope to carry NVIDIA Cosmos 3, a frontier mannequin for bodily AI, to the platform quickly.
Isaac GR00T 1.7 is an open, reasoning vision-language-action (VLA) mannequin for humanoid robots. Collectively, these integrations give builders a extra accessible and standardized path for end-to-end robotic improvement whereas driving innovation and collaboration throughout the open robotics neighborhood.
Open-source AI has proven how rapidly builders can innovate when fashions, information, and instruments are shared, stated the companions. Robotics has the identical alternative, however developments in bodily AI improvement can nonetheless be gated by expensive and fragmented sources, from giant datasets and robotic basis fashions to simulation, compute, and validation instruments.
“Open supply is how a subject turns superior analysis into one thing folks can examine, adapt and construct on,” stated Thomas Wolf, co-founder and chief science officer at Hugging Face. “With NVIDIA Isaac GR00T 1.7 and Isaac TeleOp in LeRobot right this moment, robotics builders can use shared fashions, information, and workflows to coach and consider robots within the open. And with NVIDIA Cosmos 3 deliberate subsequent, the neighborhood may have a path to carry frontier world fashions into that very same collaborative loop.”
NVIDIA, Hugging Face join robotics builders with AI builders
Hugging Face LeRobot is an open-source robotics library for coaching, operating, and sharing robotic datasets, fashions, insurance policies, and workflows. NVIDIA’s continued partnership with the corporate connects NVIDIA’s 3 million robotics builders with Hugging Face’s 16 million AI builders, increasing entry to frontier bodily AI instruments via open workflows.
Bringing NVIDIA bodily AI capabilities into LeRobot offers builders a typical approach to gather and standardize information, practice and fine-tune robotic basis fashions, consider efficiency, and deploy fashions via open workflows.
The integrations embody:
- NVIDIA Isaac Teleop is an open-source framework for robotic information assortment, enabling builders to seize high-quality human demonstrations from exterior gadgets utilizing standardized, interoperable codecs. They will then increase and share datasets with the neighborhood, all instantly in LeRobot.
- NVIDIA Isaac GR00T 1.7, the primary open and commercially viable robotic basis mannequin, is designed to make it simpler to post-train and deploy fashions via LeRobot workflows. Builders can use it to adapt GR00T to new robotic embodiments and duties with benchmarked efficiency.
- NVIDIA Cosmos 3, a frontier world basis mannequin for bodily AI coming quickly to LeRobot, can assist builders generate and increase robotics information, simulate situations, and assist coverage improvement when real-world information is restricted or too costly to gather.
NVIDIA know-how is already out there in LeRobot
These integrations construct on a broader set of NVIDIA sources already related to LeRobot to assist the total robotics improvement loop. LeRobot already offers a big open-source bodily AI dataset, downloaded greater than 15 million instances. This dataset contains greater than 350,000 actual and simulated trajectories and 57 million grasps to assist builders kickstart their robotics workflows.
It additionally contains NVIDIA Isaac Sim– and Isaac Lab-based simulation frameworks. These frameworks are designed for builders to arrange environments, generate robotic information, take a look at insurance policies, and validate behaviors earlier than transferring to bodily robots.
NVIDIA Isaac Lab-Enviornment is in LeRobot Atmosphere Hub to allow builders to rapidly prototype complicated simulation environments, register them in LeRobot EnvHub, and use them inside the LeRobot ecosystem to coach and consider generalist robotic insurance policies resembling GR00T, Pi, and SmolVLA.
As well as, NVIDIA Jetson Thor integration with LeRobot’s Reachy 2 helps deployment of VLA fashions on open-source humanoid robots.
Submit your session concept for the 2026 RoboBusinessThe submit NVIDIA and Hugging Face carry new fashions and frameworks to LeRobot appeared first on The Robotic Report.
