Nvidia has launched Isaac ROS 5.0, introducing AI agent capabilities designed to assist builders construct, customise and deploy robotics functions extra shortly utilizing the open-source Robot Operating System ecosystem.
Launched at ROSCon in Toronto, Canada, Isaac ROS 5.0 provides new agentic growth workflows alongside expanded assist for Nvidia’s Jetson computing platform and its bodily AI fashions and libraries.
Isaac ROS is a set of GPU-accelerated packages constructed on ROS, the open-source robotics framework maintained by Open Robotics. Nvidia says its software program brings accelerated computing and production-ready libraries to a ROS group numbering nearly 1.3 million customers.
One of many main additions in model 5.0 is assist for AI brokers that may help builders with robotics growth duties.
Nvidia has launched new Isaac abilities for setup and manipulation, offering reusable workflows that can be utilized by each builders and AI brokers. Agent-ready documentation is meant to permit AI techniques to know Isaac ROS instruments and translate developer directions into working functions.
A brand new FoundationStereo fine-tuning ability, for instance, allows an AI agent to assist adapt a stereo notion mannequin to a developer’s cameras, working atmosphere and utility.
Nvidia has additionally made its pick-and-place workflow out there as a standalone, agent-ready ability. The workflow connects object detection, depth estimation and pose output for robotic manipulation functions.
FoundationPose, Nvidia’s basis mannequin for object pose estimation and monitoring, in the meantime good points an agent-ready inference library that the corporate says allows robots to understand and monitor the place and orientation of objects as much as 5.5 instances quicker.
Isaac ROS 5.0 additionally introduces assist for ROS Lyrical and Ubuntu 24.04. Nvidia says it labored with the Open Supply Robotics Alliance on a typical data-handling interface meant to enhance the best way robotics software program operates throughout totally different computing {hardware}, together with GPUs.
A number of robotics firms are already integrating Isaac ROS into their techniques.
RealSense-sponsored open-source venture AgenticROS connects Isaac ROS with Nvidia Nemotron open fashions and NemoClaw blueprints, enabling AI brokers to work together with ROS-based robots.
Intrinsic is utilizing Nvidia FoundationPose in its newly launched Open Machine Tending Resolution, a part of the open-source Intrinsic Core platform.
The system makes use of the notion pipeline to dynamically detect and deal with elements, decreasing reliance on bodily fixtures and specialised integration.
Common Robots has integrated Isaac ROS into its AI Accelerator software program growth package, whereas Flexiv is integrating the expertise with its Rizon 4 adaptive robotic.
Different customers and companions highlighted by Nvidia embrace Magna, Seeed Studio, Robotis, FieldAI, Noble Machines and Mentee Robotics.
Mentee makes use of Isaac ROS because the notion and AI spine of its MenteeBot humanoid, whereas FieldAI is integrating the software program into robotic basis fashions working immediately on Jetson {hardware} with out requiring cloud connectivity.
Isaac ROS 5.0 helps Nvidia {hardware} starting from the Jetson Orin Nano by means of to the higher-performance Jetson Thor platform, offering a standard growth and deployment path as robotic AI workloads improve in complexity.
Isaac ROS 5.0 is on the market now as free, open-source software program.
