San Francisco warns Apple and Google to stop profiting from AI nudify apps

[midian182]

What just happened? San Francisco has demanded that Apple and Google remove 13 AI-powered apps capable of creating nonconsensual nude images. City Attorney David Chiu has accused the companies of profiting from technology overwhelmingly used to target women and girls.

Chiu sent cease-and-desist letters to the two tech giants on Thursday, demanding that they remove eight apps from Apple's App Store and five from Google Play.

The programs are advertised primarily as face-swapping tools, but investigators found that they could also place people's faces onto explicit images or generate fake nude content.

The letters accuse Apple and Google of "aiding and abetting" the sale of illegal deepfake pornography by hosting the apps, processing their in-app payments, and taking a cut of the proceeds. Chiu said the companies have likely earned millions of dollars in fees from theit cut of the apps' sales.

San Francisco has given Apple and Google 28 days to explain how they will comply. The city could otherwise pursue civil enforcement carrying penalties of at least $25,000 per violation.

The demands also call on the companies to cut payment-processing ties with the developers and introduce recurring reviews designed to stop replacement apps from appearing.

Courtesty of the Tech Transparency Project

Google said it had removed all five Android apps identified by Chiu's office. The company added that it has suspended hundreds of apps containing nudification features and restricted related search terms such as "nudify."

Apple said it removed three of the flagged apps and is terminating their developers' accounts. Four other developers have been told to address policy violations or face removal. Both companies already prohibit pornography and abusive sexual content, which raises questions about how the apps made it through their review processes.

The problem isn't limited to the named 13 programs. Two Tech Transparency Project investigations this year uncovered around 100 nudify-capable apps across both stores. They were estimated to have generated about $120 million in combined revenue and accumulated roughly 480 million downloads.

A separate Cornell and Georgetown study found 420 face-swap apps on the stores. Researchers tested 155 and discovered that 70% allowed users to place faces onto nude images without technical safeguards. None openly advertised itself as a nudification app, illustrating how seemingly ordinary photo tools can evade moderation.

San Francisco previously sued 16 of the most popular AI undressing websites in 2024, which had attracted 200 million visits during the first half of that year. Meta later sued the developer of Crush AI after more than 8,000 ads for the nudify service appeared on Facebook and Instagram in two weeks.

Last month, the Justice Department also seized two websites accused of publishing hundreds of thousands of deepfake nude images featuring famous women. Chiu warned that Apple and Google must become more proactive, adding that his office will consider further legal action if they fail to respond.

Permalink to story:

San Francisco warns Apple and Google to stop profiting from AI nudify apps

 

[pnntmp]

I bet those living there would strongly prefer San Francisco to deal with the problems in their order of importance, starting with the most important ones .. not from the other end of the list.

 

[Kirby1]

I bet those living there would strongly prefer San Francisco to deal with the problems in their order of importance, starting with the most important ones .. not from the other end of the list.

Typical Maga Logical fallacy.

City Attorney David Chiu is one person. He is not all of San Francisco. San Francisco can do more than one thing at a time and one man in the city doing a thing does not mean the whole city stops and waits for that man to finish before the whole city does anything else.

They always like to frame things as if they're one or the other because that's a very simple equation that their tiny brains can manage.

 

[Theinsanegamer]

Typical Maga Logical fallacy.

City Attorney David Chiu is one person. He is not all of San Francisco. San Francisco can do more than one thing at a time and one man in the city doing a thing does not mean the whole city stops and waits for that man to finish before the whole city does anything else.

They always like to frame things as if they're one or the other because that's a very simple equation that their tiny brains can manage.

Total logical fallacy.

San Francisco's legal department is represented by their attorney, and given how nothing is getting fixed, clearly they cannot do more then one thing at a time.

But leftists like to frame things as if they're one or the other because that's a very simple equation that their tiny brains can manage.

 

[Endymio]

City Attorney David Chiu is [not] all of San Francisco. San Francisco can do more than one thing at a time

San Francisco is rapidly proving you wrong. Homelessness and drug use are way up, murders are up, downtown commercial vacancies are up as businesses flee, and the cost of living and housing continues to rise, placing the city as one of the three least affordable in the entire country.

and one man in the city doing a thing does not mean the whole city stops

Anyone who doesn't understand that - especially at the local city level - prosecutorial and court resources are limited probably should remain silent while the better informed speak.

 

[Endymio]

Is this the most important problem around this attorney could solve? Very obviously no. He's just trying to impress the woke morons and get some cheap popularity points

What's worse is the idiocy of those who believe that a city attorney can do anything meaningful to address this problem, when clearly it will require action at the national and international level.

For my part, I'm not fully convinced there even is a problem. We already have crimes to cover fraud and misrepresentation of such images as the actual individuals. Other than that, what exactly is the issue? A Leftist publication I read once ran a cartoon of Trump's head atop an enormously obese nearly-naked drag queen body. Should that be a crime?

 

[Kirby1]

What's valid for all of San Francisco is also valid for this one person.
Is this the most important problem around this attorney could solve? Very obviously no. He's just trying to impress the woke morons and get some cheap popularity points

Same logical fallacy.

The city attorney can do more than one thing at a time. Attorney's don't file a case and then wait for it to finish before they do anything else, and they never suggested this is the most important thing they are doing.


Stop being so dumb. Your opinion is 100% devoid of any logic or common sense at all.

Maga always has to misrepresent reality so they can be mad about it.

 

[Endymio]

The city attorney can do more than one thing at a time. Attorney's don't file a case and then wait for it to finish

Why do the same individuals always double down on these comically fallacious positions? Each case adds to an attorney's caseload, and large cases like this against multinational corporations can easily consume thousands of attorney man-hours. You think that, now that the case is filed, the work is done? Discovery alone in this case will take years of additional effort.

And this doesn't even count the judicial backlog in SF, with some cases taking years to reach trial. Each new case filed further bogs down the system, and delays every other case filed after it.

 

[axiomatic13]

This is a topic we should all be on the same side of? Yet here we are taking partisan sides.(big sigh)

 

[pnntmp]

This is a topic we should all be on the same side of? Yet here we are taking partisan sides.(big sigh)

I believe we all condemn the waste of public resources in pursuit of cheap popularity, when there are so many huge real problems around .. and we desperately need more resources to solve or at least alleviate each of them.

 

[Kirby1]

It doesn't matter the city attorney can handle more than one case at a time. If he has a capacity for one more case, he should prioritize and engage with the case that's most important for the people he works for, not with something that wastes everyone's time but brings cheap popularity among the morons.

SF is full of junkies, illegals and other assorted scum, murders and robberies are rising, in more than half of it it's not safe to walk even during the day .. and the people who have to deal with that have very limited resources. Wasting these resources on BS means more murders and robberies around.

Dallas and Houston are also full of junkies, as you put it. Almost all major cities are.

It absolutely matters that an attorney can handle more than one case at a time, since you quite stupidly are implying that he cannot, and that by telling apple and google to stop letting these apps onto their platforms, he is incapable of doing anything else. You're also implying that it's his job to address the homeless, which is not the case. You are just a maga troll, who will ignore all logic and common sense, no matter how basic, to make angry noise about anything you think is woke or things that just involve democrats at all in anyway and by doing so you have basically taken the stance of defending apps that use AI to undress people.

Maga will literally piss on their own feet just so they can blame the left for the smell of piss in the air. It's crazy to me that techspot doesn't ban these accounts that are basically indistinguishable from a Russian bot account, they are clearly here to do one thing and one thing only, complain about the left, and they absolute do not care how stupid it makes the seem in the process.

This article could say literally anything at all about San Francisco and it would still get the same maga/russian bot response. It could say "San Francisco Creates Free Perpetual Energy for All of Mankind" and some brainless bot account would reply and say "They should focus on (insert topical buzz word here) instead!", because as soon as their tiny brain's see the name "San Francisco", the few functioning neurons they have short circuit and all they can do is repeat the same logical fallacies they've conditioned themselves to fall for over and over again.

 

[Inthenstus]

SF can fall into the ocean for all I care. That city has become a cesspool.

 

[Kirby1]

I believe we all condemn the waste of public resources in pursuit of cheap popularity, when there are so many huge real problems around .. and we desperately need more resources to solve or at least alleviate each of them.

No you ****ing don't. You don't believe anything, you just complain about the left and literally noting else. Nothing you say is based on any facts, logic, or reason. It is purely blaming the left, ignore logic and reason no matter what, and that's it. You're entire account history is that and nothing else. I genuinely don't not believe you are a real person. You might be a human, but you're persona here is false and you are only here to create noise.

 

[Kirby1]

SF can fall into the ocean for all I care. That city has become a cesspool.

Another brainless account.

 

[Inthenstus]

Another brainless account.

Agreed

 

[Kirby1]

Agreed

Maga level retort here.

 

[Rocky4040]

Typical Maga Logical fallacy.

City Attorney David Chiu is one person. He is not all of San Francisco. San Francisco can do more than one thing at a time and one man in the city doing a thing does not mean the whole city stops and waits for that man to finish before the whole city does anything else.

They always like to frame things as if they're one or the other because that's a very simple equation that their tiny brains can manage.

Yes, but this is the only one that made any kind of headlines. If they are doing other things and taking care of problems none of those have made any kind of headlines. lol

 

[Kirby1]

Yes, but this is the only one that made any kind of headlines. If they are doing other things and taking care of problems none of those have made any kind of headlines. lol

Yea, because what makes headlines is what is really important these days.

/s

Sorry you were born yesterday. Welcome to the internet.

 

[pnntmp]

Dallas and Houston are also full of junkies, as you put it. Almost all major cities are.

It absolutely matters that an attorney can handle more than one case at a time, since you quite stupidly are implying that he cannot, and that by telling apple and google to stop letting these apps onto their platforms, he is incapable of doing anything else. You're also implying that it's his job to address the homeless, which is not the case. You are just a maga troll, who will ignore all logic and common sense, no matter how basic, to make angry noise about anything you think is woke or things that just involve democrats at all in anyway and by doing so you have basically taken the stance of defending apps that use AI to undress people.

Maga will literally piss on their own feet just so they can blame the left for the smell of piss in the air. It's crazy to me that techspot doesn't ban these accounts that are basically indistinguishable from a Russian bot account, they are clearly here to do one thing and one thing only, complain about the left, and they absolute do not care how stupid it makes the seem in the process.

This article could say literally anything at all about San Francisco and it would still get the same maga/russian bot response. It could say "San Francisco Creates Free Perpetual Energy for All of Mankind" and some brainless bot account would reply and say "They should focus on (insert topical buzz word here) instead!", because as soon as their tiny brain's see the name "San Francisco", the few functioning neurons they have short circuit and all they can do is repeat the same logical fallacies they've conditioned themselves to fall for over and over again.

You keep not getting it, deliberately or otherwise.
I'm not saying an attorney can't handle more than one case at a time. I'm saying this particular attorney works for the people of SF and should handle with priority the cases that matter to them most - not the cases that bring headlines and cheap popularity, but have zero positive effect.

When SF becomes a safe city without junkies, crazies, illegals, robberies and murders - that's the moment the city attorneys may focus their attention on face -swapping apps.

 

[Kirby1]

You keep not getting it, deliberately or otherwise.
I'm not saying an attorney can't handle more than one case at a time. I'm saying this particular attorney works for the people of SF and should handle with priority the cases that matter to them most - not the cases that bring headlines and cheap popularity, but have zero positive effect.

When SF becomes a safe city without junkies, crazies, illegals, robberies and murders - that's the moment the city attorneys may focus their attention on face -swapping apps.

You don't get it. You donr get anything. You are just a disingenuous person pretending to be mad about the left even when it makes you look incredibly stupid, just so you can fill the internet with hate. You are an NPC.

 

[Endymio]

You don't get it. You donr get anything. You are just a disingenuous person pretending to be mad about the left even when it makes you look incredibly stupid, just so you can fill the internet with hate. You are an NPC.

It's comically ironic that, after spewing a lengthy vicious stream of hate-filled political posts, you accuse others of "spreading hate". But hypocrisy is a hallmark of today's fascist Left.

 

[Burty117]

I know we’re screwed here across the pond in the UK, but wow, the comments section on a few articles recently, Americans properly hate each other at the moment don’t they.

 

[madboyv1]

I know we’re screwed here across the pond in the UK, but wow, the comments section on a few articles recently, Americans properly hate each other at the moment don’t they.

I think most Americans just want to be left alone to their own devices (figuratively and literally) and do not have the time, energy, or desire to disagree so, well, enthusiastically... but social media and the internet as a whole provide the perfect megaphone for the loud bombastic minority to outshout the hushed meek majority.

It has been especially loud over the last few years.

 

[Kirby1]

I know we’re screwed here across the pond in the UK, but wow, the comments section on a few articles recently, Americans properly hate each other at the moment don’t they.

All sane people hate Maga. You either hate the cause of the problem or you are the cause of the problem.

 

[bigreddyde]

They always like to frame things as if they're one or the other [...]

Like... The only purpose of a face swapping app is to create non consensual images of women and girls?