Is there a world-wide epidemic of "health care serial killers" (killer nurses?). Or is there an epidemic of falsely accused health care serial killers? Analysis of the case of Lucia de Berk together with discussion of the role of statistics - in that case, and in forensic statistics in general
2. Overview of Lecture
• Background
• Theory (statistical paradigms)
• Lucia
• Conclusions
3. Background
• Serial killer nurses: is there an epidemic?
• Victorino Chua (UK)
• Daniela Poggiali (It)
• Nils H. (Germany)
• Ben Geen (UK)
• …
• But perhaps also an epidemic of falsely
convicted innocent nurses !
4. Academic (?) research
• Katherine Ramsland (2007) Inside the minds
of health care serial killers: why they kill
• ElizabethYardley and David Wilson (2014)
In Search of the ‘Angels of Death’:
Conceptualising the Contemporary Nurse
Healthcare Serial Killer
“Red flag check-list”: inspired (in part) by the case of Lucia de Berk …
from the time when everyone knew she was guilty
Sources: newspaper reports and prosecution documents
6. Theory:
statistical paradigms
• Bayes (one person statistics)
• Frequentist (two person, collaborative statistics)
• Likelihood (avoiding the issue)
NB two paradigms of probability: “subjective” (Bayesian), “objective” (frequentist)
7. Bayes’ rule
• Posterior odds
= prior odds * likelihood ratio
• Likelihood ratio
= Prob( data | HP ) : Prob( data | HD )
Bayesian/frequentist peaceful coexistence theorem:
{Decision theoretic admissible} = {Bayesian (for some prior)}
8. Current research:
use of Bayes net
(aka graphical model)
• Bayesian model of (probabilistic) causality
• Bayesian means “probability as degree of
belief” (epistemological, not ontological)
• Statistical correlations “explained” by causal
dependence on past events
• Some of those events are known, others unknown
• Computations: with GeNIe, HUGIN Lite, or in R
9. wid and Evett (1997) consider a fictitious burglary case, described
ows:
An unknown number of o↵enders entered commercial premises
late at night through a hole which they cut in a metal grille. In-
side, they were confronted by a security guard who was able to set
o↵ an alarm before one of the intruders punched him in the face,
causing his nose to bleed.
The intruders left from the front of the building just as a police
patrol car was arriving and they dispersed on foot, their getaway
car having made o↵ at the first sound of the alarm. The security
guard said that there were four men but the light was too poor for
him to describe them and he was confused because of the blow he
had received. The police in the patrol car saw the o↵enders only
from a considerable distance away. They searched the surrounding
area and, about 10 minutes later, one of them found the suspect
trying to “hot wire” a car in an alley about a quarter of a mile
from the incident.
Example: Dawid and Evett (1997)
10. Example (ctd) : Dawid and Evett (1997)
At the scene, a tuft of red fibres was found on the jagged end of
one of the cut edges of the grille. Blood samples were taken from
the guard and the suspect. The suspect denied having anything to
do with the o↵ence. He was wearing a jumper and jeans which
were taken for examination.
A spray pattern of blood was found on the front and right sleeve
of the suspect’s jumper. The blood type was di↵erent from that of
the suspect, but the same as that from the security guard. The tuft
from the scene was found to be red acrylic. The suspect’s jumper
was red acrylic. The tuft was indistinguishable from the fibres of
the jumper by eye, microspectrofluorimetry and thin layer chro-
matography (TLC). The jumper was well worn and had several
holes, though none could clearly be said to be a possible origin for
the tuft.
In this example there are three general kinds of evidence: eye-witne
J. Mortera A. P. Dawid (2006), Probability and Evidence, Research Report No. 264,
Department of Statistical Science, University College London.
11. Example: Dawid and Evett (1997)
Squares = observed = evidence; circles = not observed; C = hypothesis of interest
12. Dawid and Evett (1997)
blood, and fibre; and for each kind a variety of individual evidential items.
We can summarise the salient features of the evidence against the suspect as
follows:
EYEWITNESS
G : The evidence of the security guard
W : The evidence of the police o cer who arrested the suspect
BLOOD
R : The bloodstain in the form of a spray on the suspect’s jumper
X1: Suspect’s blood type
X2: Guard’s blood type
Y2: Blood type of blood spray on jumper
FIBRES
X3: Properties of the suspect’s jumper
Y1: Properties of fibre tuft
The uncertain hypotheses and variables that enter are:
HYPOTHESES
C: Whether the suspect was or was not one of the o↵enders
11
We can summarise the salient features of the evidence against the suspect as
follows:
EYEWITNESS
G : The evidence of the security guard
W : The evidence of the police o cer who arrested the suspect
BLOOD
R : The bloodstain in the form of a spray on the suspect’s jumper
X1: Suspect’s blood type
X2: Guard’s blood type
Y2: Blood type of blood spray on jumper
FIBRES
X3: Properties of the suspect’s jumper
Y1: Properties of fibre tuft
The uncertain hypotheses and variables that enter are:
HYPOTHESES
C: Whether the suspect was or was not one of the o↵enders
11
A: The identity of the person who left the fibres on the grille
B: The identity of the person who punched the guard
N: The number of o↵enders
13. Of these the specific charge before the court is C = true; the others are
included to provide a complete account of the problem.
Figure 1: Bayesian network for burglary example
Dawid and Evett (1997)
J. Mortera A. P. Dawid (2006), Probability and Evidence, Research Report No. 264,
Department of Statistical Science, University College London.
17. Shifts Court dataCourt dataCourt data CorrectedCorrectedCorrectedCorrected
JKZ MCU-1 incidentincident incidentincident
Oct ’00 – Sept ’01 with without with with
Lucia
with 9 b133 b7 b13
Lucia
without 0 b887 b4 b88
RKZ-42
Aug – Nov ’97
Lucia
with b6 b52 b5 b5
Lucia
without b9 272 10 27
RKZ-41
Aug – Nov ’97
Lucia
with 1 bb0 1 bb
Lucia
without 4 361 4 35
Lucia: the data
19. Lucia: time-line
• Sept. 4, 2001,“unexpected” death of Amber
• 2003: life sentence for 4 murders and 2 attempts;
proof: statistical
• 2004: life sentence of 7 murders and 3 attempts;
proof: medical
• 2006: confirmed by supreme court
• 2006: publication of book by Ton Derksen
(philosopher of science)
• 2006: case submitted to special committee for
review of exceptional possibly unsafe convictions
20. • 2008: CEAS reports death of Amber natural,
recommends reopening
• 2008:“advocate-general” to supreme court admits
there is no “novum”, commissions further
investigations
• 2009:AG recommends case is reopened (with
“novum” if required: former key pathologist agrees
with new findings – he had less information at his
disposal
• 2009: supreme court accepts, case is reopened
• 2010: not-guilty verdict (all deaths natural; nurses
behaviour exemplary; medical errors)
21. Lucia: likelihood ratio
• Hypothesis of the prosecution: (most of
the) Lucia incidents are murders or
attempted murders
• Hypothesis of the defence: the events are
natural and would have happened anyway
• Prob(data|HP):Prob(data|HD)=1:1
22. Lucia: the original
statistical analysis
• Frequentist approach; hypothesis test;
null hypothesis = “balls in vases”
• For each of three data sets, court’s statistician
computed the “p-value” P(as extreme as Lucia or
more | balls in vases model)
• For JKZ MCU-I, he multiplied by 26
(= # nurses worked on the ward that year)
• Product of three p-values = 1 in 342 million
23. Lucia: the defense
• Judge:“what is the probability the coincidence is due
to chance?”
• Defence 1.There are so many different probability
models, you cannot compute a probability
• Defence 2. Multiplying p-values is wrong (reductio
ad absurdam)
• Judges:“we are not here to do thought experiments,
but to determine facts”
• Judges:“The verdict of the court does not depend
on a statistical computation of probabilities”
24. Lucia: the defense
• Judge:“what is the probability the coincidence is due
to chance?”
• Defence 1.There are so many different probability
models, you cannot compute a probability
• Defence 2. Multiplying p-values is wrong (reductio
ad absurdam)
• Judges:“we are not here to do thought experiments,
but to determine facts”
• Judges:“The verdict of the court does not depend
on a statistical computation of probabilities”
25. No one checked the
data!
• Three children responsible for multiple identical
events, some in Lucia’s shifts, some not
• No consistent definition of “incident”
• No consistent definition of “time of incident”
• The data suggested the hypothesis
• No-one studied the “normal” situation (clusters
of events, clusters of shifts are normal)
26. Shifts Court dataCourt dataCourt data Corrected dataCorrected dataCorrected dataCorrected data
JKZ MCU-1 incidentincident incidentincident
Oct ’00 – Sept ’01 with without with without
Lucia
with 9 b133 b7 b135
Lucia
without 0 b887 b4 b883
RKZ-42
Aug – Nov ’97
Lucia
with b6 b52 b5 b53
Lucia
without b9 272 10 273
RKZ-41
Aug – Nov ’97
Lucia
with 1 bb0 1 bb2
Lucia
without 4 361 4 359
1
27. Some p-values
• Cochran-Mantel-Haenszel test & Elffers’
post-hoc correction
1 in 916
• Ultimate stratification
11 days at JKZ with both incident & Lucia
on duty
1 in 25
• Gamma(1) heterogeneity over Poisson
intensity JKZ, RKZ pooled
1 in 25
28. Aftermath
• Since 2010, no more media interest
• The legal system got the blame,
the taxpayer paid the bill
• There have been reforms, improvements,
communication between legal and scientific
communities
• Medical community is silent
29. Interview with president
Council for Justice
• “The system worked fine”
• “Murderers who escape conviction usually
confess on their deathbed”
30. What really happened?
• In Dutch hospitals: 2000 deaths per year due to
avoidable medical errors; culture of denial; frequent
communication failures
• During 9 months up to 4 Sept. 2001, there was gossip
about Lucia among nurses and specialists
• Medical errors by specialists were being associated
with Lucia
• Director and top medical staff (but not all),
under oath: there was no suspicion till 4 Sept. 2001
31. • No suspicion at all till 4 September, 2001?
Director Paul Smits reported 10 unnatural deaths
and suspicious reanimations, over last year, within
15 minutes of being informed of death of Amber,
and on the very same day
• Strange fact: these 10 “incidents” were also
reported to Health Inspectorate. Conclusion:
nothing wrong.
• 4 medical specialists, it appears, have lied to police
and to courts (and to one another) concerning the
treatment of their own patients
What really happened?
32. Key case: baby Amber
• Baby Amber did not die of digoxin poisoning
• In fact the circumstances of her death are completely
consistent with a “natural” process
• Lucia did not have opportunity (doctors were with
the baby at the time when the court had determined
she must have acted)
• It seems there might have been digoxin in the body,
but it did not play any role in her death, and there
are many innocent explanations for how it got there
… if it was there at all
33. HCSK’s
• Once a hospital has “identified” a HCSK,
the suspect has no chance any more
• Lucia got accused through a combination of
unlucky coincidences
• She got exonerated through another
combination of lucky coincidences … and a
lot of very hard work of very many
“outsiders”