A former researcher's viral claim that artificial intelligence could "kill all humans" has ignited a national firestorm over AI safety, but critics say the panic is a calculated push by Silicon Valley giants to secure government protection from financial collapse.
Last week, Jacob Coxon, a 27-year-old AI researcher who resigned from Anthropic after a short stint there following earlier work at OpenAI, posted a thread claiming researchers at both firms genuinely believe superintelligent AI poses an extinction-level threat — yet keep racing to build it anyway. The post drew over 165 million views and backing from Anthropic alignment researcher Evan Hubinger, who put the odds of AI destroying humanity within a decade at greater than 10 percent. Questions have since mounted over whether the alarm is genuine or part of a coordinated push to reshape the industry's competitive landscape.
The debate spread far beyond tech circles. Singer Sheryl Crow joined the chorus, while former President Barack Obama reportedly warned at a private fundraiser Thursday that unmanaged AI could prove "dangerous." Dozens of lawmakers, mostly Democrats, piled on with calls for legislation, according to an unverified tally that circulated online.
Anthropic CEO Dario Amodei published a blog post Saturday arguing for "pacing" AI development, writing that "progress will still seem fast, and we must make wise use of the time we gain." He recommended independent evaluators with employee-like access to monitor models. OpenAI CEO Sam Altman quickly agreed, and even Elon Musk — who called Coxon's post a possible "setup" — wrote "Dario is right."
House Speaker Mike Johnson (R-La.) urged caution instead: "If Congress just races in and does some sort of emergency session to try to regulate AI, we will lose the race to China, and that is a threat to every single American," he told CNN's "State of the Union" on Sunday. "We've got to have balance. We've got to have steady hands at the wheel."
Computer science professor Melanie Mitchell called the warnings "evidence-free," saying she was baffled journalists treated Hubinger's figure as "a novel claim worthy of expansive reporting." Others pointed to timing: The Wall Street Journal ran an exclusive on Coxon's resignation before his post even went live, fueling speculation of coordination. Musk suggested the "groundwork for this psy op has been prepared for a long time."
Financial pressure adds to the skepticism: top AI firms face an estimated $1.5 trillion in looming data-center costs, while most users pay nothing for ChatGPT or Claude and can switch rivals in seconds — a model that loses money with every new customer.
The proposals from Amodei and Altman would apply only to "frontier" models built by the largest labs. OpenAI's Chris Lehane wrote that safety rules should target "the handful of well-resourced laboratories developing the most capable systems — not startups, small developers, or researchers operating nowhere near the frontier." His essay also insists rules shouldn't become "open-weights policy by another name" — an assurance skeptics doubt will survive contact with an actual law.
Amodei separately urged cracking down on "unauthorized distillation" by rivals in adversarial nations — the technique of building cheaper models off frontier ones. Critics say rules aimed at foreign rivals tend to catch smaller domestic and open-source developers too.
Connor Leahy of the nonprofit ControlAI warned superintelligent agents could compete with humanity for resources and power, but critics counter that no U.S. regulation stops China from building its own models, undercutting the safety argument entirely.
David Sacks, a former Trump administration AI and crypto adviser, put it bluntly: "The easiest way not to build superintelligence is for you to agree not to build it," he wrote. "Demanding your preferred regulatory framework... will look like blackmail of the public."
Johnson's line may prove the more durable one: "We don't need everybody to panic right now." Washington has rushed to "do something" under the banner of safety before, and it rarely stayed limited to what it first promised.
Sources for this article include: