Your ChatGPT conversations could end up in court, and they're not protected

Skye Jacobs

Posts: 2,263   +64
Staff
The takeaway: Private conversations with AI chatbots are increasingly being used in court cases, creating a new source of evidence for police, prosecutors, and civil litigants. These records can expose a user's intentions, private thoughts, and sensitive disclosures, yet they generally receive none of the legal confidentiality protections afforded to conversations with lawyers, doctors, or therapists.

ChatGPT and similar tools are often used for personal questions, legal worries, health concerns, and emotional support. Those conversations can feel private, but they may be accessible through a phone search, a subpoena, discovery in a lawsuit, or a report by the AI company itself.

A review by The Washington Post found chatbot conversations cited in 12 public court cases over the past two years. The number is likely higher because much of the evidence collected during investigations and lawsuits never becomes public.

One case involved a teenager identified in court records as R.K.C., who sued Meta, Snap, TikTok, and YouTube in 2023. He alleged that their platforms contributed to social media addiction and mental health problems.

Defense lawyers obtained his ChatGPT history during the case. In one October 2024 conversation, R.K.C. asked the chatbot to explain a statement from his father about a possible settlement.

"My dad Said that I'm will get a settlement worth of 1million dollar," he wrote. "He said that If that doesn't make me happy what does. What does he mean."

R.K.C.'s lawyers settled with Snap, TikTok, and YouTube by late July. They also dropped the case against Meta, saying they were concerned about putting the teenager through a long trial. The companies denied his claims. Mike Morgan, a partner at Morgan & Morgan, said the ChatGPT messages did not affect the outcome of the case.

Morgan said young people may share more with a chatbot than they would with family members, friends, or therapists. "A fifteen-year-old may type things into a chatbot that he may not say to a therapist, a parent, or a friend, and he does it without realizing that it could end up in a defense expert's report," he said in a statement.

Chatbot records have also become part of criminal cases.

In Palm Beach County, Florida, OpenAI contacted the FBI after a ChatGPT user repeatedly described plans to harm an ex-girlfriend, according to a police affidavit. The FBI passed the information to local police, who identified the woman and found that the user, Darren Zhou, had sent her anonymous messages after their relationship ended.

Police said the ChatGPT conversations supported the credibility of the threats. Zhou was arrested in May and charged with stalking and making electronic threats. He pleaded guilty this month and was sentenced to eight years of probation.

OpenAI has said it uses software to detect conversations that may involve dangerous behavior. Those conversations can be reviewed by staff. If reviewers determine there is "an imminent and credible risk of harm to others," the company may contact law enforcement.

The company has not said how often it makes such reports. Its transparency data, however, shows a sharp increase in government and law-enforcement requests for user information. OpenAI disclosed data from more than 80 accounts during the second half of 2025, more than four times the total from the same period a year earlier.

In many cases, police do not need to obtain records from an AI company. They find the conversations on a person's phone.

Michael Price, litigation director of the Fourth Amendment Center at the National Association of Criminal Defense Lawyers, said people often agree to let officers search their phones. In most situations, people have the right to refuse a search unless police have a warrant.

"The short answer is that most people consent," Price told The Washington Post. "They shouldn't, but they do."

That happened in the case of Ryan Schaefer, a Missouri State University student accused of damaging 17 cars in a campus parking lot. According to police records, Schaefer agreed to let officers search his phone. They found ChatGPT messages he sent shortly after the alleged vandalism.

"How f----d am I bro," Schaefer wrote. "What if I smahsed the s--- oitta mutlipls cars."

He later wrote: "Is there any way they could know it was me."

Schaefer later pleaded guilty to felony property damage and was sentenced in July to five years of probation.

AI chats can also be pulled into civil lawsuits through the discovery process. In a Michigan employment case, a tire salesman's former employer alleged that he had taken customers after joining a rival company. The salesman had asked ChatGPT whether deleted Yahoo emails could still be retrieved, including through a court subpoena.

The employer argued that the messages showed he had tried to hide evidence. A judge later ordered him to pay an undetermined amount in attorneys' fees and allowed the lawsuit to continue.

Chatbot exchanges do not have the legal protections that apply to conversations with lawyers, doctors, or therapists. OpenAI CEO Sam Altman has said AI conversations should have stronger privacy protections because people increasingly use chatbots for sensitive matters. Courts have not recognized that type of privilege.

A federal judge in New York made that clear in a case involving financial executive Bradley Heppner. Heppner argued that prosecutors should not be allowed to review his conversations with Anthropic's Claude about potential fraud defenses. The judge ruled that the chats were not protected because Claude is not a lawyer and Heppner's attorneys had not told him to consult the chatbot.

Heppner was convicted in May of securities fraud, wire fraud, and other charges.

The issue may grow as AI tools take on more tasks for users and gain access to more personal data. Andrew Ferguson, a law professor at George Washington University who studies digital surveillance, said chatbot records may be only the beginning.

"Your entire world is going to now be available for police," Ferguson said.

Permalink to story:

 
Fortunately, I'm not a complete dumb-a** (only slightly) and I wouldn't put anything online or ask anything online that could get me arrested, or even just get me in trouble.
I don't understand folks fascination with putting their whole lives online for the world to see.
 
My ChatGPT conversations? I do not have any.
I don't use LLM's and don't feel like I'm missing out at all.
I'm my own man and that's the way I like it. <<<
The only AI I use is my iPhone's camera software and I'd turn it off if I could.
 
My ChatGPT conversations? I do not have any.
I don't use LLM's and don't feel like I'm missing out at all.
I'm my own man and that's the way I like it. <<<
The only AI I use is my iPhone's camera software and I'd turn it off if I could.

100% agree with you, I do use AI at work to help with PowerShell scripts, but that is it!
 
People should make bots to flood CPT with things like "how to get rid of a body" or "are the pigeons at the park free"

Create so much garbage that it essentially makes AI conversations in admissable because of the high possibility of it being fake.

You think that would stop courts from using it anyway?
 
People should make bots to flood CPT with things like "how to get rid of a body" or "are the pigeons at the park free"

Create so much garbage that it essentially makes AI conversations in admissable because of the high possibility of it being fake.
The sort of thing being discussed here are the courts requesting a specific suspect's AI chat records, not the records of random other people and/or bots posting stuff. Chat GPT and other AI services generally know who is posting what. Other people/bots asking crime related questions are not going to have any impact on whether or not a specific person's chat record can be admitted.

And for that matter, if the suspect of a crime has been running one of these bots, well that would probably make them look a lot more suspicious to the courts, if their AI chat records came up. "Ladies and gentlemen of the jury, John Doe's computer here had a chat bot program that asked Chat GPT hundreds of questions on how to commit various crimes every day. Now, why would someone want to run that sort of thing, unless they were using it to hide the questions they had about committing their own crimes? "
 
Last edited:
The sort of thing being discussed here are the courts requesting a specific suspect's AI chat records, not the records of random other people and/or bots posting stuff. Chat GPT and other AI services generally know who is posting what. Other people/bots asking crime related questions are not going to have any impact on whether or not a specific person's chat record can be admitted.

And for that matter, if the suspect of a crime has been running one of these bots, well that would probably make them look a lot more suspicious to the courts, if their AI chat records came up. "Ladies and gentlemen of the jury, John Doe's computer here had a chat bot program that asked Chat GPT hundreds of questions on how to commit various crimes every day. Now, why would someone want to run that sort of thing, unless they were using it to hide the questions they had about committing their own crimes? "
If people being interested in how crime was done then making crime shows wouldn't be a billion dollar industry
 
If people being interested in how crime was done then making crime shows wouldn't be a billion dollar industry
True, just saying there would be a gigantic difference in how a jury perceives someone asking a lot of true crime questions on their own versus someone running a bot on their computer that asks endless crime related questions on its own to AI services. During a serious court case a suspect will usually have their devices seized and inspected, and any such bot that they have been running would be detected.
 
I would just claim ChatGPT was either my lawyer or my spiritual counselor (would have added wife but that is a little to freaky for me). Both are privileged sources that can't disclose conversations.
 
True, just saying there would be a gigantic difference in how a jury perceives someone asking a lot of true crime questions on their own versus someone running a bot on their computer that asks endless crime related questions on its own to AI services. During a serious court case a suspect will usually have their devices seized and inspected, and any such bot that they have been running would be detected.
I almost hope my stuff gets seized because I do stupid **** like this all the time. I have Gemini talking to itself constantly because I have 7 android devices I'm not using.
 
This is probably the mental model people should have had from the beginning: if you're typing something deeply sensitive into a service operated by somebody else's servers, don't assume it's equivalent to talking privately with your lawyer.
 
Everything & anything you do online can be used against you. Doesn't matter if it was a text message, email, Snapchat, social media DM, "encrypted" messenger, chatbot. Anyone who doesn't know that is an *****.

That said, there are ways to ask AI questions anonymously. But I still wouldn't trust those ways completely.
 
This is probably the mental model people should have had from the beginning: if you're typing something deeply sensitive into a service operated by somebody else's servers, don't assume it's equivalent to talking privately with your lawyer.
This is the wrong comparison to make. ChatGPT chat logs are equivalent to posting your DMs on a public forum. In both theory and practice, anyone can access that information―especially because chat logs are fed back into the system as training data.

Every non-P2P and/or -E2E-encrypted messaging service (so, basically ALL of them) use someone else's servers. By your logic, even Signal Messenger is not as private as talking to a lawyer. Hell, your private conversations with your lawyer are also not actually private, because those messages get transmitted using―wait for it―"someone else's servers".

The difference between chatbot logs provided by a commercial, for-profit entity, and conversations granted attorney-client privilege, is law enforcement and expectations of discretion. Otherwise, it's all the same.
 
People should make bots to flood CPT with things like "how to get rid of a body" or "are the pigeons at the park free"

While I can understand, and somewhat share the opinion from a privacy-over-security point of view, I must disagree in practice : chatting with a LLM, whether the prompts are smart or totally dumb, consumes lots of electricity and water (not even taking into account what was built to get the datacenter up and running).

Such a response would be an environmental disaster.
 
Back