ChatGPT gets scarily good at guessing photo locations, sparking doxxing concerns

midian182

Posts: 11,714   +177
Staff member
A hot potato: Now that people have mostly stopped using ChatGPT to turn themselves into action figures, it seems the next trend involving the AI is using it to guess locations based on photos. While some are finding this reverse location search functionality fun, it raises several privacy concerns, especially when it comes to doxxing.

OpenAI released its latest o3 and o4-mini models last week, which can "reason" through uploaded images. This means it can crop, rotate, and zoom in on photos, even if they're of poor quality.

Combined with the models' other abilities, people have found that they are particularly good at identifying locations in uploaded photos.

Users are feeding o3 images of everything from restaurant menus to selfies and telling the model to imagine it is playing the online guessing game GeoGuessr, which tasks players with guessing locations based on Google Street View images.

It's easy to see this as all fun and games, but there's a potentially darker side. This reverse image search could easily allow someone to be doxxed – the public revealing of where they live or are located – based on minute details in an image that most humans would not notice. A simple selfie with few background items, or a story on social media, could be fed into ChatGPT to learn where it was taken.

While users have praised the o3 model's ability to identify locations from images, it isn't something that arrived with the latest releases. TechCrunch notes that GPT-4o, which was released without image reasoning, was able to come up with the same answers as o3 more often than not, and it did so in less time. However, there was one instance in the publication's testing where o3 was able to correctly guess that a picture of a purple rhino head mounted in a bar was from a Williamsburg speakeasy – GPT-4o thought it was from a UK pub.

It's important to note that even o3 doesn't get its guesses right every time, and sometimes it gets stuck in a loop when trying to determine a location.

An OpenAI spokesperson said that visual reasoning will make its tools more helpful in areas like accessibility, research, or identifying locations in emergency response.

As for preventing doxxing, the spokesperson said the models refuse requests for private or sensitive information, and the company has added safeguards intended to prohibit the models from identifying private individuals in images.

Masthead: Alex Shuper

Permalink to story:

 
4chan found the girl that tossed puppies in a river in Bosnia, a Syrian rebel camp based on a few pictures that was bombed by Russia afterwards and some others like some guy posting a picture of his garden fence.

These all predate publicly available AI... I personally have no idea what to look for in a picture, but people are able to find locations based on trees, weather and the sky.
 
It’s impressive how good these models are at picking up obscure visual clues—like architectural styles or regional signage—but also a reminder that what feels like harmless content online might carry way more metadata than we think.
 
4chan found the girl that tossed puppies in a river in Bosnia, a Syrian rebel camp based on a few pictures that was bombed by Russia afterwards and some others like some guy posting a picture of his garden fence.

These all predate publicly available AI... I personally have no idea what to look for in a picture, but people are able to find locations based on trees, weather and the sky.

For me, the most impressive I've ever seen is when 4chan pinpointed the location of Shia Lebouf's anti-Trump flag during his 2017 anti-Trump campaign, based on almost nothing. Just a livestream of the flag in an open grassy field without any obvious reference points. Weather and sky was indeed one of the clues they used.
 
For me, the most impressive I've ever seen is when 4chan pinpointed the location of Shia Lebouf's anti-Trump flag during his 2017 anti-Trump campaign, based on almost nothing. Just a livestream of the flag in an open grassy field without any obvious reference points. Weather and sky was indeed one of the clues they used.
HWNDU season 3 was indeed very entertaining, but season 5 with the completely muted audio and no background was almost more impressive (and showed why you need good OpSec).
 
Back