The Rise of Physical Intelligence: A New Era in AI
The Current State of AI
Recent AI models have made significant progress in generating text, audio, and video when prompted. However, these algorithms have largely remained confined to the digital world, struggling to perform adequately in the physical, three-dimensional world we live in. The challenges are evident, even in the development of safe and reliable self-driving cars.
The Need for Physical Intelligence
To expand AI beyond its digital boundary, it is essential to rework how machines think, fusing the digital intelligence of AI with the mechanical prowess of robotics. This is what I call "physical intelligence," a new form of intelligent machine that can understand dynamic environments, cope with unpredictability, and make decisions in real-time. Unlike traditional AI models, physical intelligence is rooted in physics, understanding the fundamental principles of the real world, such as cause-and-effect.
Liquid Networks: A New Form of Physical Intelligence
In our research group at MIT, we are developing models of physical intelligence, which we call liquid networks. In one experiment, we trained two drones, one operated by a standard AI model and another by a liquid network, to locate objects in a forest during the summer, using data captured by human pilots. While both drones performed equally well when tasked to do exactly what they had been trained to do, when they were asked to locate objects in different circumstances, only the liquid network drone successfully completed its task. This experiment showed us that, unlike traditional AI systems, liquid networks continue to learn and adapt from experience, just like humans do.
Interpreting and Executing Complex Commands
Physical intelligence is also able to interpret and physically execute complex commands derived from text or images, bridging the gap between digital instructions and real-world execution. For example, in our lab, we’ve developed a physically intelligent system that can iteratively design and then 3D-print small robots based on prompts like "robot that can walk forward" or "robot that can grip objects."
Breakthroughs in Other Labs
Other labs are also making significant breakthroughs. For example, robotics startup Covariant, founded by UC-Berkeley researcher Pieter Abbeel, is developing chatbots that can control robotic arms when prompted. They have already secured over $222 million to develop and deploy sorting robots in warehouses globally. A team at Carnegie Mellon University has also recently demonstrated that a robot with just one camera and imprecise actuation can perform dynamic and complex parkour movements using a single neural network trained via reinforcement learning.
The Future of Physical Intelligence
If 2023 was the year of text-to-image and 2024 was the year of text-to-video, then 2025 will mark the era of physical intelligence, with a new generation of devices, not just robots, but also anything from power grids to smart homes, that can interpret what we’re telling them and execute tasks in the real world.
Conclusion
The rise of physical intelligence has the potential to revolutionize the way we live and work. As we move forward, it is essential to continue pushing the boundaries of what is possible, exploring new ways to apply physical intelligence in various domains, and developing the next generation of intelligent machines that can seamlessly interact with our world.
Frequently Asked Questions
Q: What is physical intelligence?
A: Physical intelligence is a new form of intelligent machine that can understand dynamic environments, cope with unpredictability, and make decisions in real-time, rooted in physics and understanding the fundamental principles of the real world.
Q: What is the difference between physical intelligence and traditional AI?
A: Traditional AI models are limited to the digital world, while physical intelligence is capable of interacting with and adapting to real-world environments.
Q: How does physical intelligence differ from liquid networks?
A: Liquid networks are a specific type of physical intelligence that can learn and adapt from experience, similar to humans.
Q: What are the potential applications of physical intelligence?
A: Physical intelligence has the potential to revolutionize various domains, from robotics to power grids, smart homes, and more.
