The Prophetic Warnings of Samuel Butler
The text anticipated several modern AI safety concerns, including the possibility of machine consciousness, self-replication, and humans losing control of their technological creations. These themes later appeared in works like Isaac Asimov’s The Evitable Conflict and the Matrix films.
A Model of the Past
A model of Charles Babbage’s Analytical Engine, a calculating machine invented in 1837 but never built during Babbage’s lifetime.
Butler’s Vision of Machine Evolution
In a letter, Butler dug deep into the taxonomy of machine evolution, discussing mechanical "genera and sub-genera" and pointing to examples like how watches had evolved from "cumbrous clocks of the thirteenth century"—suggesting that, like some early vertebrates, mechanical species might get smaller as they became more sophisticated. He expanded these ideas in his 1872 novel Erewhon, which depicted a society that had banned most mechanical inventions. In his fictional society, citizens destroyed all machines invented within the previous 300 years.
Reactions and Legacy
Butler’s concerns about machine evolution received mixed reactions, according to Butler in the preface to the second edition of Erewhon. Some reviewers, he said, interpreted his work as an attempt to satirize Darwin’s evolutionary theory, though Butler denied this. In a letter to Darwin in 1865, Butler expressed his deep appreciation for The Origin of Species, writing that it "thoroughly fascinated" him and explained that he had defended Darwin’s theory against critics in New Zealand’s press.
The Significance of Butler’s Vision
What makes Butler’s vision particularly remarkable is that he was writing in a vastly different technological context when computing devices barely existed. While Charles Babbage had proposed his theoretical Analytical Engine in 1837—a mechanical computer using gears and levers that was never built in his lifetime—the most advanced calculating devices of 1863 were little more than mechanical calculators and slide rules. Butler extrapolated from the simple machines of the Industrial Revolution, where mechanical automation was transforming manufacturing, but nothing resembling modern computers existed. The first working program-controlled computer wouldn’t appear for another 70 years, making his predictions of machine intelligence strikingly prescient.
Some Things Never Change
The debate Butler started continues today. Two years ago, the world grappled with what one might call the "great AI takeover scare of 2023." OpenAI’s GPT-4 had just been released, and researchers evaluated its "power-seeking behavior," echoing concerns about potential self-replication and autonomous decision-making.
A Modern Relevance
GPT-4’s release inspired several open letters signed by AI researchers and tech executives warning of potential extinction-level risks posed by advanced artificial intelligence. One of the letters, reminiscent of fears about nuclear weapons or pandemics, called for a global pause on AI development. Around the same time, OpenAI CEO Sam Altman testified of AI dangers in front of the US Senate.
Conclusion
Samuel Butler’s warnings about the potential dangers of machine intelligence were eerily prescient, anticipating concerns that continue to this day. His work serves as a reminder of the importance of considering the long-term consequences of technological advancements and the need for ongoing debate and discussion about the responsible development of AI.
FAQs
- What were Samuel Butler’s concerns about machine evolution?
Butler’s concerns revolved around the potential for machines to evolve beyond human control and potentially pose a threat to humanity. - What was the significance of Butler’s work?
Butler’s work was significant because he predicted the potential dangers of machine intelligence in a time when computing devices barely existed, making his predictions strikingly prescient. - What are the modern implications of Butler’s work?
The modern implications of Butler’s work are that the concerns he raised about machine intelligence are still relevant today, and there is a need for ongoing debate and discussion about the responsible development of AI.
