Nvidia announced today it’s releasing a family of foundational AI models called Cosmos that can be used to train humanoids, industrial robots, and self-driving cars. While language models learn how to generate text by training on copious amounts of books, articles, and social media posts, Cosmos is designed to generate images and 3D models of the physical world.
During a keynote presentation at the annual CES conference in Las Vegas, Nvidia CEO Jensen Huang showed examples of Cosmos being used to simulate activities inside of warehouses. Cosmos was trained on 20 million hours of real footage of “humans walking, hands moving, manipulating things,” Jensen said. “It’s not about generating creative content, but teaching the AI to understand the physical world.”
Researchers and startups hope that these kinds of foundational models could give robots used in factories and homes…
