We Tested 5 AI Detectors on 100 Text Samples — Here's What We Found
Everyone claims their AI detector is "99% accurate." We were skeptical — including of our own tool. So we ran a structured test: 100 text samples across three categories, checked against 5 popular detectors, and recorded everything. Here are the honest results.
How we tested
40 human-written samples: essays, blog posts, and emails written by real people (2019–2023, pre-ChatGPT era to guarantee human origin). 40 AI samples: raw, unedited output from ChatGPT, Claude, and Gemini across essays, articles, and product descriptions. 20 edited samples: AI text lightly edited by humans — paraphrased sentences, added personal anecdotes, varied rhythm. Each sample was 300–800 words.
The results
| Detector | Unedited AI caught | Human correctly cleared | Edited AI caught |
|---|---|---|---|
| GPTZero | 92% | 90% | 68% |
| Originality.ai | 89% | 88% | 64% |
| ZeroGPT | 81% | 84% | 57% |
| Our statistical detector | 83% | 86% | 61% |
| Scribbr | 78% | 91% | 55% |
Three honest takeaways
1. Unedited AI text is easy to catch. Every detector scored 78%+ on raw model output. The statistical tells — uniform sentence length, cliché phrases, missing contractions — are strong when text is untouched.
2. Light editing breaks most detectors. This is the finding that matters. A human spending 10 minutes paraphrasing drops detection rates to 55–68% — barely better than a coin flip for some tools. Anyone using detector scores as "proof" in academic or hiring decisions should understand this.
3. False positives are real. 8–16% of genuinely human samples were flagged by at least one tool. Formal, structured human writing — legal memos, technical docs, non-native English — triggers the same signals as AI text.
What this means for you
Use detectors as a screening signal, not a verdict. A 95% "AI" score on unedited-looking text is meaningful. A 60% score on anything is noise. And never — as our own terms state — use a score as the sole basis for accusing someone of cheating. Read our deeper explainer on what detector scores actually mean.
Try Our Free DetectorMethodology notes & limitations
Samples were English-only, 300–800 words. Detector versions tested October 2026; models update frequently, so treat this as a snapshot. We have no affiliation with any tested company. Raw sample set available on request for researchers.
Last updated: October 14, 2026.