The Daily · Podcast summary
The Techno-Religion at the Center of the A.I. Debate
In this episode, Cade Metz explains the origins of the rationalist movement, a powerful subculture that believes in the power of technology to do anything, and how their ideas have influenced the current debate around AI safety.
Listen on the show ↗Key takeaways
- 🚨The debate over AI safety has entered a new phase, with accusations that those raising concerns are part of a "doomsday cult."00:43
- 🧠A powerful subculture of "rationalists" and "effective altruists" believes in the power of technology to solve everything, influencing the creation of AI labs.03:55
- 🚀The "Extropians," an early internet group, envisioned technology allowing humanity to leave Earth and explore new civilizations, believing in "extropy" (the opposite of entropy).05:48
- 🤖Key figures like Eliezer Yudkowsky and Nick Bostrom, instrumental in AI development, were part of this group, believing in "the singularity" where machines surpass human intelligence.07:24
- ⚠️The initial optimism shifted to caution, with Bostrom warning that powerful AI could harm or even kill humanity, leading to the push for "friendly AI."10:01
- ✍️Yudkowsky's blog "LessWrong" became a hub for these ideas, emphasizing that "mathematical thought will change the world" and that the singularity is a harmful inevitability.11:55
Chapters
- 0:38Introduction to the AI Safety Debate and the "Doomsday Cult" Accusation
- 5:55The Rationalist Subculture and Effective Altruism
- 8:13The Genesis of the Extropians and Their Beliefs
- 11:59Key Figures: Eliezer Yudkowsky and Nick Bostrom
- 16:41The Shift from Optimism to Caution and the Creation of LessWrong
- 19:15The Philosophical Underpinnings and the AI Threat
- 23:49From Ideas to Industry: The Rise of DeepMind, OpenAI, and Roko's Basilisk
- 31:37The "Hyperstition" and the Race to Build AI
- 39:06The Competing Philosophies and the Trillions at Stake
The digest
In a recent episode of The Daily, host Natalie Kitroeff speaks with New York Times reporter Cade Metz about the backlash against calls for AI safety and the unusual claim that those raising the alarm are part of a "doomsday cult." Metz delves into the origins and beliefs of this powerful subculture, revealing its surprising influence on the tech industry and the current debate surrounding artificial intelligence.
The "Doomsday Cult" Accusation
Kitroeff begins by noting the recent wave of criticism directed at those calling for guardrails on AI. Accusations range from outright lying to being part of a "doomsday cult." Metz confirms that many things are indeed going on, with some claiming that today's AI technologies are not as powerful as "doomsayers" suggest. Others argue that companies are engaging in "regulatory capture," trying to solidify their position at the top of the industry by influencing regulations to their advantage. This would make it harder for new competitors to emerge, essentially icing out rivals. The core of this argument is that these companies want regulation on their terms, defining rules that suit them best and putting others at a disadvantage.
However, the most extreme claim, which topped off this wave of criticism, is that these "doomsayers" are part of a cult. Metz acknowledges that while these claims are often extreme and not entirely trustworthy, there is a "real something there" at the heart of the matter.
Keep reading in The Digest
The full 8-minute article, 8 more sections, and every new episode from The Daily and the creators you follow.
- The Rationalist Subculture and Effective Altruism
- The Genesis of the Extropians
- Key Figures and Their Influence
- The Shift in Perspective: From Optimism to Caution
- The Philosophical Underpinnings and the AI Threat
- From Ideas to Industry: The Rise of DeepMind and OpenAI
- The "Hyperstition" and the Race to Build AI
- The Competing Philosophies and the Trillions at Stake
More from The Daily
Chris Rock Has Been Thinking About Forgiveness
Chris Rock discusses his new film Misty Green, reflections on Hollywood, comedy, forgiveness, and personal growth.
He Was Deported to a Country He’d Never Heard Of
Nicholas Casey reveals the Trump administration's controversial practice of deporting immigrants to unfamiliar third countries, spotlighting Roberto Mosquera's harrowing story in Eswatini.
The Best TV Shows of the 21st Century
Gilbert Cruz and James Poniewozik discuss the New York Times' list of the 100 best TV shows of the 21st century, exploring the evolution of television storytelling and culture.
The Trump Administration Defangs the Endangered Species Act
The Trump administration is rolling back environmental protections, specifically targeting the Endangered Species Act. Rachel Abrams speaks with New York Times colleague Catrin Einhorn about the history of the act, the recent changes, and the potential impact on vulnerable animals and ecosystems.
How a 1,000-Year-Old Tapestry Took London by Storm
Culture reporter Alex Marshall explains how the 1,000-year-old Bayeux Tapestry, a piece of fabric depicting the Norman Conquest, became the hottest ticket in London, and why its temporary return to the UK is such a big deal.
Aaron Sorkin Still Believes in American Institutions, Even If No One Else Does
Aaron Sorkin discusses his new film, "The Social Reckoning," a follow-up to "The Social Network," and delves into his writing process, his views on social media, and his enduring optimism for American institutions.