What Does It Mean When an A.I. System Reasons?
Reasoning just means that the chatbot spends some additional time working on a problem. "Reasoning is when the system does extra work after the question is asked," said Dan Klein, a professor of computer science at the University of California, Berkeley, and chief technology officer of Scaled Cognition, an A.I. start-up. It may break a problem into individual steps or try to solve it through trial and error.
Can You Be More Specific?
In some cases, a reasoning system will refine its approach to a question, repeatedly trying to improve the method it has chosen. Other times, it may try several different ways of approaching a problem before settling on one of them. Or it may go back and check some work it did a few seconds before, just to see if it was correct. "Basically, the system tries whatever it can to answer your question," said Klein.
What Kind of Questions Require an A.I. System to Reason?
It can potentially reason about anything. But reasoning is most effective when you ask questions involving math, science, and computer programming.
How is a Reasoning Chatbot Different from Earlier Chatbots?
You could ask earlier chatbots to show you how they had reached a particular answer or to check their own work. Because the original ChatGPT had learned from text on the internet, where people showed how they had gotten to an answer or checked their own work, it could do this kind of self-reflection, too. But a reasoning system goes further. It can do these kinds of things without being asked. And it can do them in more extensive and complex ways.
Why is A.I. Reasoning Important Now?
Companies like OpenAI believe this is the best way to improve their chatbots. For years, these companies relied on a simple concept: The more internet data they pumped into their chatbots, the better those systems performed. But in 2024, they used up almost all of the text on the internet. That meant they needed a new way of improving their chatbots. So they started building reasoning systems.
How Do You Build a Reasoning System?
Last year, companies like OpenAI began to lean heavily on a technique called reinforcement learning. Through this process — which can extend over months — an A.I. system can learn behavior through extensive trial and error. By working through thousands of math problems, for instance, it can learn which methods lead to the right answer and which do not.
Does Reinforcement Learning Work?
It works pretty well in certain areas, like math, science, and computer programming. These are areas where companies can clearly define the good behavior and the bad. Math problems have definitive answers. Reinforcement learning doesn’t work as well in areas like creative writing, philosophy, and ethics, where the distinction between good and bad is harder to pin down.
Are Reinforcement Learning and Reasoning Systems the Same Thing?
No. Reinforcement learning is the method that companies use to build reasoning systems. It is the training stage that ultimately allows chatbots to reason.
Do These Reasoning Systems Still Make Mistakes?
Absolutely. Everything a chatbot does is based on probabilities. It chooses a path that is most like the data it learned from — whether that data came from the internet or was generated through reinforcement learning. Sometimes it chooses an option that is wrong or does not make sense.
Is This a Path to a Machine that Matches Human Intelligence?
A.I. experts are split on this question. These methods are still relatively new, and researchers are still trying to understand their limits. In the A.I. field, new methods often progress very quickly at first, before slowing down.
Conclusion
A.I. systems that can reason are a significant step forward in the development of chatbots. By building reasoning systems, companies like OpenAI and others are creating chatbots that can think more like humans. While these systems are not yet perfect, they are getting closer to mimicking human intelligence.
Frequently Asked Questions
Q: What is reasoning in A.I. systems?
A: Reasoning means that the chatbot spends some additional time working on a problem, breaking it down into individual steps or trying to solve it through trial and error.
Q: What kind of questions require an A.I. system to reason?
A: It can potentially reason about anything, but reasoning is most effective when you ask questions involving math, science, and computer programming.
Q: How is a reasoning chatbot different from earlier chatbots?
A: Reasoning chatbots can do things like show how they reached a particular answer or check their own work without being asked, and can do these things in more extensive and complex ways.
Q: Why is A.I. reasoning important now?
A: Companies like OpenAI believe this is the best way to improve their chatbots, as they need a new way of improving their chatbots after using up almost all of the text on the internet.
