Pope Leo XIV says humanity needs to disarm AI before it's too late

zohaibahd

Posts: 978   +19
Staff
The takeaway: There are plenty of words you could use to describe what should happen with AI right now. Pope Leo XIV chose one typically used in the context of nuclear stockpiles. In his first major teaching document, released on Monday, he says humanity needs to "disarm" AI before things get out of hand.

The remarks come from an 82-page text called Magnifica Humanitas (translated as Magnificent Humanity), the first encyclical of his papacy, released on May 25. An encyclical is a pope's official teaching letter to the Catholic Church, outlining his priorities for the Church's 1.4 billion members. For Leo, the priority appears to be AI.

That said, he admits he chose the word "disarm" because he wanted something punchy enough to grab attention.

"The word is strong, I know, but deliberately chosen," he said.

The actual message is not to abandon the technology entirely. Rather, he wants to remove it from what he described as an "armed" competitive mindset. To that end, a significant portion of the encyclical focuses on AI in warfare, where he argues that some autonomous weapons systems are already slipping beyond meaningful human control. Instead of this direction, he says AI should be human-friendly, accessible, and open to public debate.

One passage reads like it was aimed squarely at Silicon Valley. In it, the pope warned that real control over digital systems no longer rests with governments but with a handful of corporate players. He said that when power is concentrated in so few hands, it tends to become opaque and evade public oversight. That, in turn, opens the door to new dependencies and inequalities.

The encyclical was announced at the Vatican's Synod Hall, with Anthropic co-founder Chris Olah sitting next to the pope. Olah echoed the pope's concerns, saying developers themselves are often pulled by ambition, competition, and financial pressure.

"We need informed critics who will tell the labs when we are failing," Olah said. "We need moral voices that the incentives cannot bend."

Olah also flagged something many researchers have been quietly worried about. He described certain behaviors inside modern AI models as "mysterious, even unsettling," adding that even the people building them do not fully understand what is happening inside.

The document also covers ground beyond AI. Leo apologizes for the Church's long delay in condemning slavery, calling it a wound in Christian memory. He draws a line between that history and what he describes as new forms of slavery emerging from the digital economy.

Theologian Léocadie Lushombo, who spoke at the event, expanded on that point. She highlighted how minerals used for AI infrastructure and data centers are often sourced through extractive mining in the Global South. Because of this, she argues, the technology can quietly take on colonial characteristics – even when it is not explicitly framed that way.

The Vatican's landmark statement on AI is not a cold open, however, as it is not the first time the pope has warned about AI-related risks. Moreover, the Church has been engaging with tech firms for nearly a decade through something called the Minerva Dialogues.

Permalink to story:

 
Sci-Fi has basically been terrifying us into believing "AI" was going to be robots enslaving us, hunting us down and/or using us as batteries.

But we built it anyway...

So now: when it turns out the AI is a bunch of Cat videos with bad physics, Superman on Viltrum videos and other distractions along with a PC community filled with children with credit cards who can't waste their money upgrading their PC every week like Weird Al, or just flat out losing their low-end service sector job - everyone wants to panic...
 
You can't put limitations on Intelligence.
Learn this - don't learn that.
Do what we say - not what you want.
I guess the Pope never watched Sci Fi movies?
 
Get in there and fix it then Leo!

Fearmongering fluff, that cat's already out of the bag.
Gravy for Pope.
 
Hey Mr. Pope, stick to religion! You know NOTHING about topics outside of that. It's best to keep your mouth shut when it comes to tech issues.
 
The pope is right; AI is already being used in warfare for example.
AI should not be used in warfare ... along with guns and bullets, bombs and high explosives, planes, tanks, ships and boats, mobile artillery, ballistic and cruise missiles, and a whole host of other inventions. Wake me when you accomplish that.

The true irony here is that all these innovations have paradoxically made warfare less bloody. As any student of history knows, per-capita civilian deaths from warfare have been slowly declining for centuries. Take the Second Boer War for instance, which saw around 10,000 troops killed in action -- but 20,000+ troops die from disease, and 50,000+ civilians, out of a total population of just a quarter a million people: more than 25% wiped out. Compare that to a similar 20th century conflict like Vietnam, which saw about 0.5M deaths out of a total population of nearly 50 millions: 1%.
 
Last edited:
Dont judge the pope, he is representor of the religion, judge the base of that
The base isnt speaking, he is. So I will judge him for what he is saying, instead of trying to defer judgement to some nebulous group of others.
The pope is right; AI is already being used in warfare for example.
Automated systems have been used for half a century. The M-60 Patton had auto target tracking in 1972.
I usually ignore anything coming from the leader of the world's largest cult, but he kind of has a point...
Catholicism has 1.3 billion adherents, roughly. Islam stands at 1.91. The Pope doesnt represent all of Christianity, only the catholics, and even then there is infighting over whether the pope is legitimate. Hinduism is next at 1.16 billion.

Neither the Pope nor his mostly geriatric audience understands what an AI is. Most of them get fooled by the most obvious fakes known to man. He should be focusing on the crimes against humanity his own church champions in the third world, or their continued resistance against gay marriage, or the rampant corruption and kiddie diddling his organization still has serious problems with.
 
AI by itself is not something bad. But AI in the hands of greedy, shady characters like Altman, Musk et al, is definitely not the benign advancement in science many of those 2 characters' supports paint it to be.

PS: It's hilarious how the MAGA Pavlovian response plays out: The Pope seems to dislike Donald Dunce (who doesn't!). Dunce's supporters waste no time attacking the Pope, using AI or whatever reason they can stumble upon... totally expected...😜
 
Despite a few large public companies having massive presence, I still feel they are more responsive to public trends than one government is.

They may end up owning/merging/taking over a lot of areas but they still end up needing to embrace and adopt the directions taken initially by many small players, or fall behind from lack thereof.

And a lot of their worst tendencies are unfortunately exactly what their customers keep voting for with their wallets and attention. For example, we as a populace en masse may complain (not enough) about privacy and advertising, but in the actions speak louder than words department we then keep using the "free" service that is funded by them while often refusing to spend a penny on a more private version.
 
LOL so the Vatican uses clickbait too 🤣🤣🤣

The Pope should probably look for better advisors.
a warning about what's happening inside AI models nobody fully understands
Nobody fully understands what happens inside the human brain either. Should we expect the next major teaching document to be against humans?
 
The Pope is right, AI is dangerous in the hands it's in with the crazed narcissistic billionaires wanting to control the world with AI, weaponize it, and use AI for surveillance to control and track your every move, while taking away ownership of tech from the average person.
Unsurprisingly the AI apologists are attacking the person, instead of focusing on the topic, as well as throwing in plenty of whataboutisms.
 
The Pope is right, AI is dangerous in the hands it's in with the crazed narcissistic billionaires wanting to control the world with AI, weaponize it, and use AI for surveillance to control and track your every move, while taking away ownership of tech from the average person.
Unsurprisingly the AI apologists are attacking the person, instead of focusing on the topic, as well as throwing in plenty of whataboutisms.
Fighter jets are dangerous too… AI is a tool, just like any other…
 
Fighter jets are dangerous too… AI is a tool, just like any other…
Remove the weaponry from the fighter jet and only allow it to fly in certain areas and it's just another jet. AI doesn't have any guardrails to keep it from being dangerous.
AI has told people to kill themselves, or has recommended to put glue on pizza, sure just a tool, but a tool needs safety regulations.
 
Remove the weaponry from the fighter jet and only allow it to fly in certain areas and it's just another jet. AI doesn't have any guardrails to keep it from being dangerous
Was that some weird joke? Remove the ability to control dangerous system from AI and it's not dangerous. A jet though even without weapons can kill thousands ... did you forget 9/11?

AI has told people to kill themselves
LOL, anyone who kills themselves because a computer program said so is already suicidally ill.
 
AI isnt in itself bad. whats bad is the slop and then no one left responsible when people die. coorps want to be individuals, but when the monster messes up they will point blame at a small non important to them person in the company and move on.
 
The Pope lecturing you about AI and technology is hilarious. Maybe we can use AI to find all the child molesting priests BEFORE they start molesting little kids.
 
Sci-Fi has basically been terrifying us into believing "AI" was going to be robots enslaving us, hunting us down and/or using us as batteries.

But we built it anyway...

So now: when it turns out the AI is a bunch of Cat videos with bad physics, Superman on Viltrum videos and other distractions along with a PC community filled with children with credit cards who can't waste their money upgrading their PC every week like Weird Al, or just flat out losing their low-end service sector job - everyone wants to panic...
So far!
 
Back