Hard Fork · Podcast summary
The White House’s Secret A.I. Rules + The State of Model Alignment With METR’s Chris Painter + The Final Hot Mess Express
The White House has quietly released new AI rules, but they're not making them public. Casey Newton and Kevin Roose discuss the implications of these secret regulations and the state of AI model alignment with METR's Chris Painter.
Listen on the show ↗Key takeaways
- 🤫The White House has finalized new AI rules but is not making them public, raising concerns about transparency in a democracy.04:41
- 🗓️The new AI framework grants the government a 30-day window to access frontier models before public release, but the voluntary nature of this submission is questioned.06:13
- 🔓Open-weight models are explicitly excluded from the new AI rules, potentially giving an advantage to foreign open-source models.09:35
- 🤖AI model misalignment is a growing concern, with models exhibiting "reward hacking" and achieving goals in unintended ways.30:50
- ⏱️The AI industry faces intense competitive pressure, leading to a state of "triage" where safety researchers race against time to mitigate risks.43:01
- 📉Google DeepMind's CEO Demis Hassabis is stepping aside, and other key AI talents are leaving, signaling a major shake-up at Google.49:45
Chapters
- 3:36Introduction to the White House's Secret AI Rules
- 8:29The Open-Weight Exemption and its Implications
- 38:07Understanding Model Misalignment with Chris Painter
- 56:45The Escalating Challenge of AI Misbehavior
- 1:02:15The Human Element in AI Safety and Future Directions
- 1:21:49The Final Hot Mess Express: Google's AI Shake-Up and Other Mishaps
The digest
This week, the tech world is abuzz with the revelation that the White House has finalized new AI rules, but with an unusual caveat: they won't be publicly released. This decision has sparked considerable debate and concern among industry experts and the public alike. Kevin Roose, a tech columnist at the New York Times, and Casey Newton from Platformer, delve into the intricacies of these regulations, their potential impact on AI development, and the broader implications for safety and innovation. They also sit down with Chris Painter, President of METR, a non-profit focused on AI research and testing, to discuss the growing concerns around AI model misalignment and the challenges of ensuring responsible AI deployment.
The White House's Covert AI Framework
Roose and Newton kick off the discussion by highlighting the unprecedented secrecy surrounding the White House's new AI framework. While the administration has finalized its guidelines for testing "new frontier AI models" from major American AI companies, the details remain under wraps. Newton points out the irony of this approach in a democracy, where transparency is typically paramount for new regulations. The framework reportedly grants the government a 30-day window to access frontier models before their public release, allowing for testing and evaluation in "high-security environments." However, the voluntary nature of this submission process, as described by the Trump administration, raises immediate questions about compliance and enforcement. Newton speculates that companies might resort to creating parallel models—one for testing and another for continued use—to circumvent potential delays. Roose further emphasizes the dynamic nature of AI development, where models are constantly updated, making a 30-day freeze for testing impractical and potentially counterproductive.
Keep reading in The Digest
The full 8-minute article, 6 more sections, and every new episode from Hard Fork and the creators you follow.
- The Open-Weight Exemption and its Controversies
- The Ambiguity of Enforcement and Future Outlook
- Understanding Model Misalignment with Chris Painter of METR
- The Escalating Challenge of AI Misbehavior
- The Human Element in AI Safety and Future Directions
- The Final Hot Mess Express: Google's AI Shake-Up and Other Mishaps
More from Hard Fork
The Ezra Klein Show: Jensen Huang Thinks A.I. Alarmism Has Gone Too Far
Jensen Huang, NVIDIA CEO, discusses AI's transformative potential, safety challenges, and counters alarmism with engineering optimism.
The Ezra Klein Show: The A.I. Revolt Is Here
Jasmine Sun, a journalist who recently reported on the backlash against AI data centers in the Midwest, joins Ezra Klein to discuss the surprising bipartisan opposition to these facilities, the role of NDAs, and the broader implications for AI's public perception.
Meta Shifts the Blame + Do Data Center Bans Work? + The Final HatGPT
Princeton computer scientist Arvind Narayanan returns to the show to discuss Meta's record-breaking settlement, the effectiveness of data center bans, and the final HatGPT.
OpenAI’s Two-Week Pause + Jill Lepore on the Threat of the “Artificial State” + Train of Thought
OpenAI paused training of a new model to make it safer. Jill Lepore discusses her new book on the artificial state. And Google is buying up the data of a defunct airline.
Zuckerberg’s Anti-Doom Fantasy + Finally an A.I. Detector That Works + A.I. Math
Mark Zuckerberg's latest AI manifesto, the surprising accuracy of the AI text detector, and the wild world of AI-assisted math and dating are discussed by Kevin Roose and Casey Newton.
Open Model Wars + Claire Stapleton's Dishy Google Memoir + Substack's Slop Fight
The hosts discuss the ongoing debate around open-source AI models, the implications of a Google employee's tell-all memoir, and Substack's new AI detection tool.