Nvidia Unveils Cosmos: A Family of Foundational AI Models for Training Humanoids, Industrial Robots, and Self-Driving Cars
Revolutionizing AI Training with Physical World Simulations
Nvidia announced today its release of a family of foundational AI models called Cosmos, designed to generate images and 3D models of the physical world. Unlike language models that learn by training on vast amounts of text data, Cosmos is trained on 20 million hours of real footage of humans performing everyday activities, enabling AI systems to understand and interact with the physical world.
Applications in Warehouse and Robotics
During a keynote presentation at the annual CES conference in Las Vegas, Nvidia CEO Jensen Huang demonstrated examples of Cosmos being used to simulate activities inside warehouses. The technology can generate realistic video footage of boxes falling from shelves, allowing robots to recognize accidents and respond accordingly. This technology has the potential to improve the efficiency and safety of industrial robots, making them more effective in various industries.
Partnerships and Adoption
Cosmos has already been adopted by several companies, including humanoid robot startups Agility and Figure AI, as well as self-driving car companies like Uber, Waabi, and Wayve. These partnerships aim to leverage the power of Cosmos to develop more sophisticated AI systems capable of understanding the physical world.
Isaac Robot Simulation Platform
Nvidia also announced a new feature within its existing Isaac robot simulation platform, designed to help different kinds of robots learn new tasks more efficiently. The feature allows users to take a small number of examples of a desired task, such as grasping a particular object, and generate large amounts of synthetic training data.
Project Digits and Next-Generation GPUs
In addition to Cosmos, Nvidia announced Project Digits, a $3,000 "personal AI supercomputer" capable of running a large language model of up to 200 billion parameters without relying on cloud services. The company also unveiled its highly anticipated next-generation RTX Blackwell GPUs and incoming software tools to help build AI agents.
Conclusion
Nvidia’s release of Cosmos represents a significant milestone in the development of AI technology, enabling the creation of more sophisticated and intelligent systems capable of understanding and interacting with the physical world. As the technology continues to evolve, we can expect to see significant advancements in industries such as robotics, self-driving cars, and more.
FAQs
Q: What is Cosmos?
A: Cosmos is a family of foundational AI models designed to generate images and 3D models of the physical world.
Q: How is Cosmos different from language models?
A: Unlike language models that learn by training on vast amounts of text data, Cosmos is trained on real footage of humans performing everyday activities, enabling AI systems to understand and interact with the physical world.
Q: What are the potential applications of Cosmos?
A: Cosmos has the potential to improve the efficiency and safety of industrial robots, making them more effective in various industries, and enabling the development of more sophisticated AI systems capable of understanding and interacting with the physical world.
