Trial by junk science.
For decades, juries were told that a bite mark, a hair, a burn pattern, or a bullet could be traced to one person or one source and no other — with the authority of science. Then science itself was asked to check, and the answer, over and over, was that it could not.
Dr. Grigson, the subject of One Hundred Percent Certain, was not an aberration. He was one instance of a courtroom-wide pattern: experts in lab coats delivering a certainty the underlying method could not support, and a system that rewarded the confidence and rarely checked the science. This is that pattern, graded.
What this page is about
In 2009 the National Academy of Sciences published a landmark report on the state of American forensic science. Its finding was devastating and came from inside the scientific establishment: with the single exception of DNA analysis, no forensic method had been rigorously shown to reliably connect a piece of evidence to a specific individual or source. Bite-mark comparison, microscopic hair comparison, firearms “toolmark” matching, shoe-print and tire analysis, arson indicators — the techniques juries had trusted for generations had never been validated the way real science demands. A 2016 report by the President's Council of Advisors on Science and Technology (PCAST) looked again and confirmed it for method after method.
This was not academic. In 2015 the FBI and the Justice Department admitted that, for decades, nearly every examiner in the FBI's elite microscopic hair unit had given scientifically flawed testimony overstating “matches” — a review of 268 trials found errors by 26 of 28 examiners, in at least 90 percent of cases, including the cases of 32 people sentenced to death. Men served decades on bite-mark testimony that DNA later exploded. And in Texas, Cameron Todd Willingham was executed in 2004 for setting a fire that arson experts later concluded showed no scientific sign of arson at all. The price of junk science was measured in lifetimes, and sometimes in lives.
We grade the record and we fence it honestly. DNA is real science, and it is the hero of this story as much as the villain of the others — it is the tool that proved the rest were failing. Not every conviction that used these methods was wrong, and reform since 2009 is real, if partial and resisted. But the core finding stands and belongs in Judges & Prosecutors: for most of the twentieth century, the thing presented to juries as unassailable “forensic science” was frequently neither as scientific nor as certain as the person in the witness box claimed.
The same investigation, restaged one beat at a time. Step through it here, or present it fullscreen.
Trial by Junk Science.
For decades juries were told a bite mark, a hair, a burn pattern, or a bullet could be traced to one person and no other — with the authority of science. Then science was asked to check, and over and over the answer was: it can't.
What the lab coat promised, and what science found
Science's own institutions found that, apart from DNA, the forensic methods juries trusted were never validated.
FACTThe indictment comes from the top of American science. The National Academy of Sciences' 2009 report, 'Strengthening Forensic Science in the United States: A Path Forward,' concluded that with the exception of nuclear DNA analysis, no forensic method had been rigorously shown to have the capacity to consistently and reliably demonstrate a connection between evidence and a specific individual or source. In 2016 the President's Council of Advisors on Science and Technology (PCAST) examined the leading feature-comparison methods — bite marks, firearms, footwear, microscopic hair — and found they lacked 'foundational validity': there was no adequate scientific basis for the identification claims examiners were making in court. The techniques had the form of science (labs, jargon, credentials) without the substance (testing, error rates, validation).
Hair microscopy: the FBI admitted nearly every examiner overstated 'matches' for decades — in 32 death-penalty cases.
FACTThe most sweeping confession in forensic history. In 2015 the FBI and the Justice Department acknowledged that, for decades before 2000, nearly every examiner in the Bureau's microscopic hair comparison unit had given testimony that overstated the significance of a hair 'match.' A review of 268 trials found that 26 of the FBI Laboratory's 28 examiners had made erroneous statements favoring the prosecution — errors in at least 90 percent of the cases reviewed — and that 32 of the affected defendants had been sentenced to death. The review was triggered by the exoneration of men like Santae Tribble, who served 28 years for a murder on the strength of a hair 'match' that DNA later showed was wrong — the sample even included hairs from a dog. The nation's premier crime lab had been wrong, in the same direction, almost every time.
Bite marks: a technique with no scientific basis that still sent people to prison and death row.
FACTOf all the discredited methods, bite-mark comparison may be the starkest, because its core premises fail at the first scientific question. There is no proof that human dentition is unique in a way skin can record, and no proof that examiners can reliably match a mark to a biter; both the 2009 NAS and 2016 PCAST reviews found the discipline had no established validity. Yet it convicted people for decades. Keith Harward spent 33 years in a Virginia prison — much of it on bite-mark testimony from experts who told the jury his teeth matched marks on a victim — before DNA exonerated him in 2016 and identified the real attacker. He is one of more than two dozen people known to have been wrongly convicted or charged on bite-mark evidence. A method that cannot pass a basic test of reliability was treated as proof of identity in capital cases.
Arson: Cameron Todd Willingham was executed on 'science' that later experts said showed no arson at all.
FACTThe gravest case, because it cannot be undone. The old arson 'indicators' — crazed glass, certain burn and pour patterns read as proof of an accelerant — were largely folklore passed between investigators, not validated science; modern fire science has discredited much of it. Cameron Todd Willingham was convicted of setting the 1991 house fire that killed his three daughters and was executed by Texas in 2004. Before the execution, fire scientist Gerald Hurst reviewed the evidence and concluded the arson findings were baseless; after it, a report by fire expert Craig Beyler for the Texas Forensic Science Commission found the original analysis did not meet the standards of the field and that a finding of arson could not be sustained. Texas very likely executed a man for a crime that forensic science cannot show was even a crime. We grade FACT that the arson evidence was scientifically invalid; whether Willingham was innocent is, by the nature of the case, no longer provable — which is exactly the point.
DNA is the exception that proved the rule — the real science that exposed the fake.
FACTThe honest hero of the story matters as much as the villains. DNA analysis is rigorously validated — it has known error rates, population statistics, and a genuine scientific foundation — and it is precisely by re-testing old cases with DNA that the failures of the other methods were exposed. Every time a DNA test freed someone whom a bite mark or a hair 'match' had convicted, it was a controlled experiment proving the earlier 'science' had been wrong. The National Registry of Exonerations and the Innocence Project have documented that false or misleading forensic evidence is a contributing factor in a large share of wrongful convictions later overturned — roughly a quarter of all known exonerations. DNA did not just free the innocent; it audited the entire forensic enterprise and returned a failing grade for everything but itself.
The honest fence: the problem is overstated certainty, not the existence of forensics — and reform is real but partial.
FACTPrecision is what separates this from a blanket 'CSI is fake' take. The failure was specific and twofold: methods that were never scientifically validated, and testimony that dressed subjective judgment in the language of certainty ('a match,' 'to the exclusion of all others,' '100 percent'). That is the same move Dr. Grigson made with psychiatric prediction, generalized across disciplines. It does not mean fingerprints or firearms evidence are worthless — some carry real information when claimed modestly — nor that every examiner acted in bad faith; many sincerely believed their fields were sound. And reform since 2009 is genuine: the FBI's audit, the PCAST report, new standards, some courts excluding the worst methods. But it is also partial and resisted — the Justice Department publicly disputed PCAST's conclusions, and discredited techniques still appear in courtrooms. The fix is not abolishing forensics; it is forcing it to meet the standard it always claimed to have.
How the unproven got into the courtroom
The strange thing is that none of these methods ever had to prove themselves before being used to convict. Courts are supposed to screen expert evidence for reliability — that is what the Frye and later Daubert standards are for — but in practice judges deferred to whatever was already customary, and once a technique had been admitted a few times, its own track record of admission became the argument for admitting it again. Bite-mark testimony entered American courts in the 1970s and simply stayed, never having passed the test real science requires. The crime lab carried institutional prestige, usually sat on the prosecution's side, and spoke a confident language juries were primed by television to trust. The adversarial system was supposed to expose weak science through cross-examination, but a public defender with no budget cannot out-argue a state analyst about a field neither the judge nor the jury understands.
What finally forced the reckoning was DNA, because for the first time there was a method rigorous enough to serve as ground truth. When DNA testing began freeing people in the 1990s and 2000s, it did not just correct individual cases; it created a growing pile of controlled proof that the older methods produced false positives — and often that examiners had overstated what their methods could show. That evidence is what the 2009 NAS report synthesized, and it is why the report could be so blunt: the people writing it were scientists looking at other scientists' claims and finding no data behind them. The tragedy is how long the gap stayed open — decades in which the confident testimony kept coming and the verdicts kept landing, with the heaviest consequences falling, as they do across Policing the Poor, on defendants without the resources to fight back.
And the machine has been slow and grudging about undoing it. A finding of invalid science does not automatically reopen the convictions built on it, and courts have shown far more appetite for finality than for correction — the same institutional reflex visible when Texas's highest criminal court famously closed at five on a death-row appeal. Willingham was never cleared before he was executed; the 32 death sentences the FBI flagged did not vanish with the admission. Junk science, once it has produced a verdict, acquires the verdict's weight — which is the strongest possible argument for keeping it out in the first place.
Certainty is the most powerful thing a courtroom can counterfeit
The engine of a wrongful conviction is almost never a single lie; it is misplaced confidence — a witness, an analyst, a doctor who is sure, and a jury that reasonably trusts sureness. Junk forensic science is so dangerous precisely because it manufactures that confidence at scale and wraps it in the one authority a layperson is least equipped to question: science. “The hair matches.” “The bite is his.” “This fire was set.” Each sounds like a fact read off an instrument; each was, too often, a subjective guess stated as certainty. When the method underneath turns out to be unvalidated, every verdict it ever anchored becomes suspect — and because the system treats a verdict as settled, the suspicion rarely gets to do its work. The deepest cost is not the specific innocents already identified; it is that we cannot know how many more there are, because the tool that would tell us only exists for cases that happen to have DNA.
- If the FBI's own review found its hair examiners wrong in 90 percent of cases, including 32 death sentences, how many of those verdicts have actually been overturned — and what does the answer say about whether the system wants to know?
- DNA can only audit the cases that left DNA behind. For every exoneration it produced, how many convictions rest on bite marks, hair, or arson “science” that no test will ever be able to check?
- A judge is supposed to keep unreliable science out of the courtroom. If these methods sat in front of juries for decades without ever meeting that standard, what exactly was the gatekeeper doing — and why did it take outside scientists, not the courts, to say so?
Questions worth taking seriously
Doesn't this just prove the system works — it caught the errors and reformed?
Partly, and we credit that — the NAS and PCAST reports, the FBI audit, and DNA exonerations are real corrections. But look at the timing and the source: the courts admitted these methods for decades and didn't catch the problem; it took outside scientists to force the reckoning, and even then the Justice Department publicly disputed PCAST's findings. Meanwhile the verdicts largely stand — Willingham was executed, the 32 death sentences weren't erased by the admission. A system that only self-corrects after outside pressure, and then resists acting on its own findings, isn't quite the clean success story. Catching the error is not the same as undoing it.
So is all forensic evidence worthless now?
No, and saying so would be its own kind of junk claim. DNA analysis is genuinely rigorous and is the tool that exposed the rest. Some other methods carry real information when their claims are kept modest — a fingerprint examiner saying “consistent with” is on far firmer ground than one saying “a match to the exclusion of everyone on earth.” The problem was never that forensics exists; it was unvalidated methods plus overstated certainty. The reform that follows isn't “ban forensics” — it's require validation, report error rates, and bar examiners from claiming a confidence the science doesn't support. Forensics should have to meet the standard it always claimed to already have.
If you are named on this page
If you are named on this page, or are a party materially affected by the claims made here, and you wish to respond, correct the record, or add context, use the Contact page. Responses are published verbatim alongside the original claim, with the sender identified and the date of receipt. The channel stays open for the life of the page.
This site aggregates and grades a record that other outlets and primary sources have already put on the record. Every FACT-graded claim above is sourced to court filings, government reports, sworn whistleblower disclosures, published investigative journalism, or named-source statements. The citations are the accountability mechanism; this section is how you get on the record too.
The record
- National Academy of Sciences (2009) — 'Strengthening Forensic Science in the United States: A Path Forward'
- PCAST (2016) — Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods
- Equal Justice Initiative — FBI admits flawed hair testimony affected at least 32 death-penalty cases
- FBI — microscopic hair analysis testimony contained errors in at least 90% of cases reviewed
- The Washington Post (2015) — FBI overstated forensic hair matches in nearly all criminal trials for decades
- Innocence Project — erroneous FBI hair testimony; bite-mark and forensic wrongful convictions
- On the 2009 NAS report and Texas forensics (context for the Willingham arson review)
- Black Book Audit — One Hundred Percent Certain (Dr. Grigson)
- Black Book Audit — Sharon Keller: 'We Close at Five'
- Black Book Audit — Judges & Prosecutors