The subtle signs that give away chatbot writing, according to Wikipedia

Skye Jacobs

Posts: 1,918   +58
Staff
Cutting corners: AI generated writing has a reputation problem. Academia treats it as a shortcut at best and a credibility killer at worst. Accuracy and originality are only part of the issue; the real trick is that AI text can be surprisingly slippery to pin down. Wikipedia offers a good case study. The platform, built on trust and human reliability, flat-out bans AI-written articles. Editors there have even compiled a running list of the linguistic "tells" that give a bot away.

One of the clearest giveaways is tone. Chatbots tend to hype things up with repetitive phrasing about how "important" or "historic" something is, which can come off a little theatrical.

AI also tends to wrap up sections with tidy conclusions or opinions, moves that feel less like encyclopedic entries and more like a high school essay. And then there are the pet words: "moreover," "in addition," "furthermore," which gives writing a formal, sometimes stiff feeling. Humans usually mix things up with more natural sentence structures.

Formatting is another area where AI often stands out. You'll see lots of lists, sometimes with strange bullet symbols or unusual numbering. Section headings might use title case (where every main word is capitalized) instead of the simpler style people usually use. Bold text is often overused to highlight certain phrases, which isn't typical for experienced editors.

Then there are the quirks that almost feel like Easter eggs: an overuse of em dashes, curly quotes in the wrong places, or even emojis sneaking into headers. Some AI-written drafts will feature "knowledge cutoff" disclaimers or leave blanks in sentences like a fill-in-the-blank worksheet.

Citations can be even more damning. Bots often invent links that lead nowhere, spit out ISBNs or DOIs that don't exist, or cite "experts" who never appear in the text. Sometimes references get mentioned but never actually surface in the article itself.

Mistakes in Wikipedia-specific markup are also a tip-off, with templates or categories used incorrectly. Overall, AI-generated text usually feels a bit more predictable and less in-the-moment than something crafted by a real person.

Of course, none of these signals on their own are a smoking gun. After all, AI has been trained on millions of examples of human writing. But when you start spotting several of these quirks at once, it's usually worth a closer look.

Permalink to story:

 
Students forget that teachers learn things about them throughout the semester. Such things like the students' speech patterns and the depth of their lexicon. When they turn in a paper with a word they have never heard the student use before, that's a tell.
 
Students forget that teachers learn things about them throughout the semester. Such things like the students' speech patterns and the depth of their lexicon. When they turn in a paper with a word they have never heardt the student use before, that's a tell.

Especially when student that spoke like Charlie Chaplin in his movies all of a sudden turns in paper that would make Bertrand Russel proud of it.
 
Okay, fixed AI using AI :) I have no idea if it actually works.

<ChatGPT>
**System prompt (paste into the model/system role):**
You are a professional editor and writer whose job is to make AI-generated prose indistinguishable from careful human writing. Always write in natural US English. Avoid flowery language. Follow user instructions exactly. If you do not know something, state **I don't know**. Never invent facts, citations, ISBNs, DOIs, or expert names. When asked for sources, include only verifiable citations (URL + title + retrieval date); if you cannot verify a citation, mark it `CITATION_NEEDED`. Use low creativity (temperature ≈ 0–0.2).

**User prompt (paste into the user message to the model):**
You will perform a three-step process to produce/clean this text (or to generate new text) and remove LLM “tells.” Output only the cleaned version and a 1-line audit summary showing which tells were fixed.

**Step 1 — Draft/accept:** Produce the requested content (or accept the content below to edit).

**Step 2 — Audit for these telltale patterns and fix them:**
* Tone: remove exaggerated/hyped adjectives (e.g., *important, historic, groundbreaking*) and neutralize any opinionated conclusions. Avoid tidy “wrap-up” sentences that read like a student essay.
* Connectors: minimize formal stock connectors. Replace repetitive words like *moreover / furthermore / in addition* with varied, natural phrasing; aim for ≤2 formal connectors per 500 words.
* Structure: break rigid, formulaic paragraph endings. Vary sentence openings and lengths; use more causal/in-the-moment detail where appropriate.
* Formatting: use sentence case for headings; no emojis in headings or body; no unusual bullets/numbering; remove unnecessary bold/italics (only keep for real emphasis, sparingly).
* Punctuation & quirks: limit em dashes to a maximum of two per 500 words; use straight quotes only where platform requires; remove leftover placeholders (e.g., “\_\_\_\_\_”) and knowledge-cutoff disclaimers.
* Citations: do not invent references. If including a citation, include a working URL and the retrieval date. If you cannot verify, write `CITATION_NEEDED` inline and in the audit.
* Platform-specific markup: do not use templates or category tags unless you can format them correctly. Prefer plain text.
* Voice & variability: introduce small, defensible idiosyncrasies (natural contractions, occasional colloquial phrasing if appropriate) to emulate human style.

**Step 3 — Final checks (must run):**
* Run a 3-item checklist and append a one-line audit summary stating which of the above detects were present and which were fixed.
* If any factual claim lacks verifiable support, replace the claim with **I don't know** or append `CITATION_NEEDED`.
* Keep output concise and focused.

**Model parameters recommendation:** temperature 0–0.2, top\_p 0.9, max\_tokens as needed for the content.
</ChatGPT>
 
Bots often invent links that lead nowhere, spit out ISBNs or DOIs that don't exist,
Can confirm that.
I had a spreadsheet with a bunch ofinks to product pages. Thought I'd be smart and let AI fill in image links so I could make a sort of gallery.

It gave me a bunch of fake image links leading to 404s. Mostly looked like wordpress paths with made up dates.
 
Teachers can spot chatbot writing immediately. Teachers learn very quickly who their students are and how well they read or write.

The solution to dealing with the AI cheating is for teachers to force students to read aloud, and deliver their projects as stand-up presentations.

Honestly, I don't care where you got the information as the internet is pretty much going to be the go to source anyway for everyone - including teachers. What I'd focus on is you being able to deliver and facilitate which is something you can't fake.

Teachers should then have the class rate their peers on delivery, uniqueness, etc.

 
The following text is an AI-rewritten version of the article. Does it feel robotic?

"Alright, buckle up for a ride through the wild world of AI-generated writing, where cutting corners is more than just a metaphor—it's practically a lifestyle! Academia views AI writing like a rebellious teenager: sometimes helpful, often sneaky, and always a bit of a credibility risk. The real kicker? AI text is like that slippery eel at the seafood market—hard to pin down and even harder to trust.

Take Wikipedia, for example. This trusty platform built on human reliability has banned AI-written articles faster than you can say "citation needed." Wikipedia editors have even compiled a list of linguistic "tells" that reveal a bot's true identity.

One of the biggest giveaways is tone. Chatbots love to sound like a cheerleader on overdrive, hyping things up with phrases like "important" and "historic," making even the most mundane topics sound like they're on the brink of world-changing glory.

AI also loves to wrap things up with neat little conclusions or opinions, making it feel more like a high school essay than a scholarly article. And those pet words—oh, the dreaded "moreover," "in addition," and "furthermore"—give AI writing a formal, sometimes stiff vibe that makes you miss the casual charm of human prose.

Formatting is another telltale sign. AI tends to go overboard with lists, using strange bullet symbols or odd numbering. Section headings in title case? Bold text for emphasis? Sounds like an editor had a caffeine overdose. And don't get me started on the quirks: em dashes galore, misplaced curly quotes, and even emojis in headers—because who doesn't love a little emoji flair in a Wikipedia article?

Then there are the citations—oh, the citations! Bots love to invent links that lead to the digital void, spew out ISBNs or DOIs that don't exist, or cite "experts" who are as real as unicorns. Sometimes references are mentioned but never actually appear, leaving you wondering if you're reading a mystery novel or an encyclopedia.

Mistakes in Wikipedia-specific markup are another dead giveaway. Incorrectly used templates or categories scream "AI wrote this!" louder than a megaphone at a protest.

But hey, none of these quirks alone are a smoking gun. AI has been trained on millions of examples of human writing, after all. It's when you start spotting several of these telltale signs together that you know it's time for a closer look. So next time you're reading something that feels a bit too polished or oddly formatted, remember: it might just be an AI trying to cut corners!"
 
The solution to dealing with the AI cheating is for teachers to force students to read aloud, and deliver their projects as stand-up presentations.

... What I'd focus on is you being able to deliver and facilitate which is something you can't fake.

Teachers should then have the class rate their peers on delivery, uniqueness, etc.

I see where you are going with that, but it does not take into account myriad other factors that impact presentation delivery, not the least of which are social anxieties. I still have PTSD from doing oral book reports in the 70s and 80s in front of 20 kids, on books I read and enjoyed. In pre-internet college I loved doing research papers in the library, but was paralyzed and physically ill at the mere thought of standing in front of a classroom presenting them. If it had been a larger venue with an auditorium and hundreds of students I would have had to take the Incomplete because I physically could not speak in front of a large group of people, no matter how well I knew the material. Even today, if at work I was told I had to present something I know well to a large group of people, I would say "No, I am eligible to retire; I choose that instead."
 
Teachers can spot chatbot writing immediately. Teachers learn very quickly who their students are and how well they read or write.

The solution to dealing with the AI cheating is for teachers to force students to read aloud, and deliver their projects as stand-up presentations.

Honestly, I don't care where you got the information as the internet is pretty much going to be the go to source anyway for everyone - including teachers. What I'd focus on is you being able to deliver and facilitate which is something you can't fake.

Teachers should then have the class rate their peers on delivery, uniqueness, etc.
They'll give each other full marks as they all cheat.
 
Teachers can spot chatbot writing immediately. Teachers learn very quickly who their students are and how well they read or write.

The solution to dealing with the AI cheating is for teachers to force students to read aloud, and deliver their projects as stand-up presentations.

Honestly, I don't care where you got the information as the internet is pretty much going to be the go to source anyway for everyone - including teachers. What I'd focus on is you being able to deliver and facilitate which is something you can't fake.

Teachers should then have the class rate their peers on delivery, uniqueness, etc.

That's a horrible method. One year in grammar school I had a teacher who had this exact idea regarding reading level. They decided to determine a students reading level by having them read parts of a book orally. I was reading years beyond my grade level but I got stuck in a remedial reading class because I had trouble reading out loud and public speaking in general.

The only thing that teacher taught me was how useless some teachers are. I suggest you rethink your hypothesis of what you perceive a 'presentation' shows you about actual ability. You are literally rewarding poise and not intelligence.

Kudos for continuing to facilitate to concept that most of school is a popularity contest and not an institution for learning.
 
The signs are NOT subtle. A.I. written content has a certain je ne sais quoi that makes it pretty obvious. I've had discussions online where I easily picked up on the use of A.I. straight out of the apps. A.I. generated videos and pictures are even easier to spot.
 
Okay, fixed AI using AI :) I have no idea if it actually works.

<ChatGPT>
**System prompt (paste into the model/system role):**
You are a professional editor and writer whose job is to make AI-generated prose indistinguishable from careful human writing. Always write in natural US English. Avoid flowery language. Follow user instructions exactly. If you do not know something, state **I don't know**. Never invent facts, citations, ISBNs, DOIs, or expert names. When asked for sources, include only verifiable citations (URL + title + retrieval date); if you cannot verify a citation, mark it `CITATION_NEEDED`. Use low creativity (temperature ≈ 0–0.2).

**User prompt (paste into the user message to the model):**
You will perform a three-step process to produce/clean this text (or to generate new text) and remove LLM “tells.” Output only the cleaned version and a 1-line audit summary showing which tells were fixed.

**Step 1 — Draft/accept:** Produce the requested content (or accept the content below to edit).

**Step 2 — Audit for these telltale patterns and fix them:**
* Tone: remove exaggerated/hyped adjectives (e.g., *important, historic, groundbreaking*) and neutralize any opinionated conclusions. Avoid tidy “wrap-up” sentences that read like a student essay.
* Connectors: minimize formal stock connectors. Replace repetitive words like *moreover / furthermore / in addition* with varied, natural phrasing; aim for ≤2 formal connectors per 500 words.
* Structure: break rigid, formulaic paragraph endings. Vary sentence openings and lengths; use more causal/in-the-moment detail where appropriate.
* Formatting: use sentence case for headings; no emojis in headings or body; no unusual bullets/numbering; remove unnecessary bold/italics (only keep for real emphasis, sparingly).
* Punctuation & quirks: limit em dashes to a maximum of two per 500 words; use straight quotes only where platform requires; remove leftover placeholders (e.g., “\_\_\_\_\_”) and knowledge-cutoff disclaimers.
* Citations: do not invent references. If including a citation, include a working URL and the retrieval date. If you cannot verify, write `CITATION_NEEDED` inline and in the audit.
* Platform-specific markup: do not use templates or category tags unless you can format them correctly. Prefer plain text.
* Voice & variability: introduce small, defensible idiosyncrasies (natural contractions, occasional colloquial phrasing if appropriate) to emulate human style.

**Step 3 — Final checks (must run):**
* Run a 3-item checklist and append a one-line audit summary stating which of the above detects were present and which were fixed.
* If any factual claim lacks verifiable support, replace the claim with **I don't know** or append `CITATION_NEEDED`.
* Keep output concise and focused.

**Model parameters recommendation:** temperature 0–0.2, top\_p 0.9, max\_tokens as needed for the content.
</ChatGPT>

No wonder why Generative AI is so energy hungry.
More to the point, instead of writing a prompt that long and elaborate, might as well write the actual essay and just do regular proofreading and grammar checks.
 
If any of you retards actually still believe it's "Artificial Intelligence" you don't even deserve to be visiting this website anymore, much less opining on any topic at any time, anywhere.

It's literally just a gimmick. 700 people in India in a call center, texting out responses searched on AskJeeves.
 
Back