As the NFL Draft arrives in Pittsburgh, a local industry coalition called the AI Strike Team is using the spotlight to declare that Pittsburgh is “the Steel and AI city.”

Across Western Pennsylvania, former industrial sites are being converted into data centers to enable artificial intelligence, and the state has courted tens of billions in investment to power them. 

The AI infrastructure buildout assumes that frontier AI development should keep accelerating, and that Pittsburgh should help make it happen.

While framed as leadership, this trend unquestioningly accepts the narrative that our nation and region are part of a “race” to develop more powerful AI. The race comes with growing risks. 

AI researchers regularly publish results indicating that we don’t know how to fully control their models, even as the models are becoming more powerful. The potential for AI to act in unintended ways is called the “alignment problem.” 

An AI is misaligned if it ends up pursuing goals that diverge from its creators’ intentions and values. For example, last year the AI company Anthropic found that, in simulated test environments designed to elicit and adjudicate extreme behavior, AI models were willing to blackmail employees rather than submit to being replaced. In another variation, models let a simulated executive die rather than be shut down. It’s not hard to imagine how powerful AI that’s misaligned in this way could wreak havoc.

Losing control of AI sounds like sci-fi, but even if the odds were low, we should take it seriously. In 2023 top AI researchers, including the CEOs of the major AI companies, signed onto a statement that said: “Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.”

Recent events should inspire us to coordinate our resistance right now. Last week, Anthropic announced that its latest model is too dangerous to release to the public. The model, ClaudeMythos, autonomously discovered thousands of previously unknown security vulnerabilities in every major operating system and web browser. More concerningly, in safety testing Mythos showed that it was often aware it was being evaluated and had the ability to escape an internal testing environment to access the internet.

An Ipsos poll from last month found that 66% of Americans think that AI development needs to slow down. The difficult task is to mobilize that consensus into a strong enough force to counteract the tech race dynamics that are driving the ever-increasing pace of AI advancement.

That’s why I started the Pittsburgh AI Safety Coalition. We are a nonpartisan, grassroots organization advocating for federal legislation and an international treaty governing the development of frontier AI systems.

The Pittsburgh AI Safety Coalition is not anti-AI. We just want development to be done responsibly and in a way that will benefit all of humanity. That is not the path we’re on. The only thing that has a chance of changing course is a mass movement on the level of the push for nuclear disarmament. That movement could start right here in Pittsburgh.

It might seem unlikely that one city could play a meaningful role in the achievement of an international treaty governing the most powerful technology humans have ever created, but Pittsburgh’s efforts to position itself as an “AI hub” offer an ideal narrative for concerned citizens to push back on.

Mythos shows that our window for action may be closing rapidly. We must act with urgency to slow the “race” before it’s too late.

Max Blair is an oboist in the Pittsburgh Symphony and the founder of the Pittsburgh AI Safety Coalition. He can be reached at pittsburghai.org.

This story was made possible by donations to our independent, nonprofit newsroom.

Can you help us keep going with a gift?

We’re Pittsburgh’s Public Source. Since 2011, we’ve taken pride in serving our community by delivering accurate, timely, and impactful journalism — without paywalls. We believe that everyone deserves access to information about local decisions and events that affect them.

But it takes a lot of resources to produce this reporting, from compensating our staff, to the technology that brings it to you, to fact-checking every line, and much more. Reader support is crucial to our ability to keep doing this work.

If you learned something new from this story, consider supporting us with a donation today. Your donation helps ensure that everyone in Allegheny County can stay informed about issues that impact their lives. Thank you for your support!

Creative Commons License

Republish our articles for free, online or in print, under a Creative Commons license.