The Pace of Technology Innovation
The pace of technology innovation has accelerated in the past year, most dramatically in AI. And in 2024, there was no better place to be a part of creating those breakthroughs than NVIDIA Research.
NVIDIA Research: Pushing the Frontiers of Knowledge
NVIDIA Research is comprised of hundreds of extremely bright people pushing the frontiers of knowledge, not just in AI, but across many areas of technology.
Research Discoveries and Breakthroughs
In the past year, NVIDIA Research laid the groundwork for future improvements in GPU performance with major research discoveries in circuits, memory architecture and sparse arithmetic. The team’s invention of novel graphics techniques continues to raise the bar for real-time rendering. And we developed new methods for improving the efficiency of AI — requiring less energy, taking fewer GPU cycles and delivering even better results.
Generative AI: The Most Exciting Developments of the Year
We’re now able to generate, not just images and text, but 3D models, music and sounds. We’re also developing better control over what is generated: to generate realistic humanoid motion and to generate sequences of images with consistent subjects.
ConsiStory: AI-Generated Images With Main Character Energy
ConsiStory, a collaboration between researchers at NVIDIA and Tel Aviv University, makes it easier to generate multiple images with a consistent main character — an essential capability for storytelling use cases such as illustrating a comic strip or developing a storyboard.
Edify 3D: Generative AI Enters a New Dimension
NVIDIA Edify 3D is a foundation model that enables developers and content creators to quickly generate 3D objects that can be used to prototype ideas and populate virtual worlds.
Fugatto: Flexible AI Sound Machine for Music, Voices and More
A team of NVIDIA researchers recently unveiled Fugatto, a foundational generative AI model that can create or transform any mix of music, voices and sounds based on text or audio prompts.
GluFormer: AI Predicts Blood Sugar Levels Four Years Out
Researchers from the Weizmann Institute of Science, Tel Aviv-based startup Pheno.AI and NVIDIA led the development of GluFormer, an AI model that can predict an individual’s future glucose levels and other health metrics based on past glucose monitoring data.
LATTE3D: Enabling Near-Instant Generation, From Text to 3D Shape
Another 3D generator released by NVIDIA Research this year is LATTE3D, which converts text prompts into 3D representations within a second — like a speedy, virtual 3D printer.
MaskedMimic: Reconstructing Realistic Movement for Humanoid Robots
To advance the development of humanoid robots, NVIDIA researchers introduced MaskedMimic, an AI framework that applies inpainting — the process of reconstructing complete data from an incomplete, or masked, view — to descriptions of motion.
StormCast: Boosting Weather Prediction, Climate Simulation
In the field of climate science, NVIDIA Research announced StormCast, a generative AI model for emulating atmospheric dynamics. While other machine learning models trained on global data have a spatial resolution of about 30 kilometers and a temporal resolution of six hours, StormCast achieves a 3-kilometer, hourly scale.
NVIDIA Research Sets Records in AI, Autonomous Vehicles, Robotics
Through 2024, models that originated in NVIDIA Research set records across benchmarks for AI training and inference, route optimization, autonomous driving and more.
Conclusion
NVIDIA Research has made significant strides in AI, computer graphics, computer vision, self-driving cars and robotics, and has set records in various areas. The future of technology is exciting, and we look forward to seeing what the next year will bring.
FAQs
- What is NVIDIA Research?
NVIDIA Research is a team of hundreds of scientists and engineers worldwide, focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics. - What are the most exciting developments in AI this year?
Generative AI, which can generate 3D models, music, and sounds, and control over what is generated, such as realistic humanoid motion and sequences of images with consistent subjects. - What are some of the applications of generative AI?
Generative AI can be used in weather forecasting, predicting blood sugar levels, developing autonomous vehicles, and more.
