Ensuring the Reliability of Fire-Arm Identification Evidence

Keywords: Firearm identification, reliability, validity, cross-examination, relevance, forensic science, cartridge, bullet, criminal justice, firearm


Notwithstanding the acceptance of firearm identification by courts, the scientific community has been reluctant to recognise firearm identification as a reliable method of conclusively establishing a connection between a particular bullet and a particular gun. The National Institute of Justice (NIJ) in the United States (US) has categorised firearm identification as a discipline under forensic science, and forensic science has been described as a "fractured and burdened discipline". In addition, in 2009 the National Academy of Sciences (NAS) concluded that forensic science is broken. With regard to firearm identification, the NAS Report emphasised the need for sufficient studies to be done because this report regarded this type of evidence as unreliable and lacking repeatability. The President's Council of Advisors on Science and Technology (PCAST) Report, released in September 2016, came to a conclusion similar to that of the 2009 NAS Report with regard to forensic science evidence. With regard to firearm identification, the report asserted that firearm identification evidence still "falls short of the scientific criteria for foundational validity". It is disturbing that courts across the globe are using different types of forensic science without subjecting them to scrutiny so as to determine their reliability. In the light of this, reliability and validity have become important factors which demand attention in Anglo-American litigation, even in jurisdictions that do not have a formal reliability standard (such as England and Wales, and South Africa). This article shows the role of cross-examination in establishing the reliability of firearm expert evidence. It also focusses on the role that South African forensic practitioners, prosecutors, defence counsels and presiding officers can play in ensuring the reliability of firearm identification evidence





Acharya N "Law's Treatment of Science: From Idealization to Understanding" 2013 Dalhousie LJ 57-?

AFTE Criteria for Identification Committee "Theory of Identification, Range of Striae Comparison Reports and Modified Glossary Definitions – AFTE Criteria for Identification Committee Report" 1992 AFTE Journal 1-390

AFTE Glossary "Theory of Identification as it relates to Toolmarks" 1998 AFTE Journal 86-88

Black HC Black's Law Dictionary 5th ed (West St Paul, Minn 1979)

Black MR "Cross Examination: The Greatest Legal Engine for the Discovery of Truth: A Comparative Analysis of the American and English Rules of Cross-Examination" 1988 SUL Rev 397-405

Bonnie L "Firearms Identification: The Need for a Critical Approach to, and Possible Guidelines for, the Admissibility of ʹBallistics Evidenceʹʺ 2012 Suffolk J Trial & App Advoc 54-442

Breyer S Reference Manual on Scientific Evidence (Federal Judicial Center Washington DC 2000)

Commission on Identifying the Needs of the Forensic Science Community, Research Council of the National Academy of Sciences Strengthening Forensic Science in the United States: A Path Forward (National Research Press Washington, DC 2009)

Committee to Assess the Feasibility, Accuracy, and Technical Capability of a National Ballistics Database, National Research Council of the National Academies Ballistic Imaging (National Academies Press Washington, DC 2008)

Cooper SL "Judicial Responses to Challenges to Firearms-Identification Evidence: A Need for New Judicial Perspectives on Finality" 2014 TM Cooley L Rev 457-465

Cooper SL "Forensic Science Identification Evidence: Tensions between Law and Science" 2016 JPSL 1-35

Cunliffe E "Independence, Reliability and Expert Testimony in Criminal Trials" 2013 AJFS 284-295

Dutton G "Commentary: Ethics in Forensic Firearms Investigation" 2005 AFTE Journal 79-82

Edmond G "[Ad]ministering Justice: Expert Evidence and the Professional Responsibilities of Prosecutors" 2013 UNSWLJ 921-953

Edmond G "What Lawyers should Know about the Forensic Sciences" 2015 Adel L Rev 33-106

Edmond G and Meintjes-van der Walt L "Blind Justice? Forensic Science and the Use of Closed Circuit Television Images as Identification Evidence in South Africa" 2014 SALJ 109-148

Edmond G et al "Admissibility Compared: The Reception of Incriminating Expert Evidence in Four Adversarial Jurisdictions" 2013 U Denv Crim L Rev 31-109

Edmond G et al "How to Cross-examine Forensic Scientists: A Guide for Lawyers" 2014 Aust Bar Rev 174-196

Edmond G et al "Contextual Bias and Cross-contamination in the Forensic Sciences: The Corrosive Implications for Investigations, Plea Bargains, Trials and Appeals" 2015 Law, Probability and Risk 1-25

Edmond G et al "Model Forensic Science" 2016 AJFS 1-42

Faurie A The Admissibility and Evaluation of Scientific Evidence in Court (LLM-dissertation University of South Africa 2000)

Foster K and Huber P Judging Science (MIT Press Cambridge, Mass 1999)

Gabel JD "Realizing Reliability in Forensic Science from the Ground Up" 2014 J Crim L & Criminology 284-351

Garry M et al "Memory: A River Runs Through It" 1994 Consciousness and Cognition 438-451

Gershman BL "Misuse of Scientific Evidence by Prosecutors" 2003 Okla City U L Rev 1-22

Giannelli P and McMunigal K "Prosecutors, Ethics, and Expert Witnesses" 2007 Fordham L Rev 1493-1537

Giannelli PC, Imwinkelried EJ and Peterson JL "Reference Guide on Forensic Identification Expertise" in National Research Council Reference Manual on Scientific Evidence (National Academies Press Washington, DC 2011) ch 16

Green BA and Zacharias FC "Prosecutorial Neutrality" 2004 Wis L Rev 837-890

Grzybowski RA and Murdock J "Firearm and Toolmark Identification - Meeting the Daubert Challenge" 1998 AFTE Journal 3-14

Grzybowski RA et al ʺFirearm/Toolmark Identification: Passing the Reliability Test under Federal and State Evidentiary Standardsʺ 2003 AFTE Journal 1-34

Gunther CO "Markings on Bullets and Shells Fired from Small Arms" 1932 Mechanical Engineering 334-345

Hatcher JS Textbook of Firearms Investigation, Identification and Evidence (Small Arms Technical Publishing Marines, NC 1935)

Ho HL A Philosophy of Evidence Law: Justice in the Search for Truth (Oxford University Press London 2008)

Inbau FE "Scientific Evidence in Criminal Cases" 1934 Am Inst Crim L & Criminology 825-844

Inbau FE "Firearms Identification: Ballistics" 1999 J Crim L & Criminology 1293-1314

Irwin A and Wynne B Misunderstanding Science? The Public Reconstruction of Science and Technology (Cambridge University Press Cambridge 2001)

Koehler JJ and Meixner JB "An Empirical Research Agenda for the Forensic Sciences" 2016 J Crim L & Criminology 1-34

Koen WJ and Bowers CM Forensic Science Reform: Protecting the Innocent (Elsevier Amsterdam 2016)

Krane DE et al "Sequential Unmasking: A Means of Minimizing Observer Effects in Forensic DNA Interpretation" 2008 Journal of Forensic Sciences 1006-1007

Laurin JE "Criminal Law's Science Law: How Criminal Justice Meets Changed Scientific Understanding" 2015 Tex L Rev 1751-1765

Law Commission Expert Evidence in Criminal Proceedings in England and Wales: Report Presented to Parliament Pursuant to Section 3(2) of the Law Commissions Act 1965 (The Stationary Office London 2011)

Luna E and Wade M "Prosecutors as Judges" 2010 Wash & Lee L Rev 1413-1532

Mahoney MJ Scientist as Subject: The Psychological Imperative (Ballinger Press Cambridge 1976)

Meintjes-van der Walt L Expert Evidence in the Criminal Justice Process: A Comparative Perspective (Rozenberg Press Amsterdam 2001)

Meintjes-van der Walt L "The Proof of the Pudding: The Presentation and Proof of Expert Evidence in South Africa" 2003 J Afr L 88-106

Michelson RS Crime Scene Investigation: An Introduction to CSI (Law Tech San Clemente 2009)

Mnookin J et al "The Need for a Research Culture in the Forensic Sciences" 2011 UCLA L Rev 725-761

Moriarty JC "'Misconvictions', Science and the Ministers of Justice" 2007 Neb L Rev 1-42

Mulkay MJ "Norms and Ideology in Science" 1976 Soc Sci Inf 637-656

Murdock JE et al "The Development and Application of Random Match Probabilities to Firearm and Toolmark Identification" 2017Journal Forensic Science 619-625

Mutsavi T The Reliability of Firearm Identification in South Africa: A Comparative Perspective (LLM-dissertation University of Fort Hare 2018)

Nichols R ʺThe Scientific Foundations of Firearms and Toolmark Identification - A Response to Recent Challengesʺ 2006 California Association of Criminalists News 8-27

Nichols R "Defending the Scientific Foundations of the Firearms and Toolmark Identification Discipline: Responding to Recent Challenges" 2007 Journal of Forensic Science 581-593

President's Council of Advisors on Science and Technology Report to the President - Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods (Executive Office of the President Washington, DC 2016)

Puzniak J "Expert Evidence: The Road from Daubert to Joiner and Kumho Tire" 2000 Court Review 32-54

Raeder MS "See No Evil: Wrongful Convictions and the Prosecutorial Ethics of Offering Testimony by Jailhouse Informants and Dishonest Experts" 2007 Fordham L Rev 1413-1452

Risinger DM et al "The Daubert/Kumho Implications of Observer Effects in Forensic Science: Hidden Problems of Expectation and Suggestion" 2002 CLR 1-56

Riva F and Champod C "Automatic Comparison and Evaluation of Impressions Left by a Firearm on Fired Cartridge Cases" 2014 Journal of Forensic Sciences 637-647

Rosenthal R and Rubin DB "Interpersonal Expectancy Effects: The First 345 Studies" 1978 Behav Brain Sci 377-386

Saks MJ "Scientific Evidence and the Ethical Obligations of Attorneys" 2001 Clev St L Rev 421-437

Schwartz A "A Systemic Challenge to the Reliability and Admissibility of Firearms and Toolmark Identification" 2005 Colum Sci & Tech L Rev 1-42

Schwartz A "Challenging Firearms and Toolmark Identification – Part Two" 2008 The Champion 44-51

Thornton JI "Courts of Law v Courts of Science: A Forensic Scientist's Reaction to Daubert" 1994 Shepard's Expert and Scientific Evidence Quarterly 475-485

Case law

Bee v Road Accident Fund 2018 4 SA 366 (SCA)

Bentley v Scully 41 F 3d 818 (2d Cir 1994)

Burchett v State 172 NE 555 (Ohio Ct App 1930)

Burge v State 282 So 2d 223 (Miss 1973)

Commonwealth v Hoss 283 A 2d 58 (Pa 1971)

Commonwealth v Meeks Nos 2002-10961, 2003-10575, 2006 WL 2819423 (Mass Super Ct Sept 28, 2006)

Commonwealth v Pytou Heang 458 Mas 827, 942 NE 2d 927 (2011)

Commonwealth v Whitacre 878 A 2d 96 (Pa Sup Ct 2005)

Daubert v Merrell Dow Pharmaceuticals Inc 509 US 579 (1993)

Evans v Commonwealth 19 SW 2d 1091 (Ky 1929)

General Electric Co v Joiner 522 US 136 (1997)

In Re Paoli Railroad Yard PCB Litigation 35 F 3d 717 (3rd Cir 1994)

Jones v United States 27 A 3d 1130 (DC 2011)

Kumho Tire Co v Carmichael 526 US 137 (1999)

Luttrell v Commonwealth 952 SW 2d 216 (Ky 1997)

People v Fisher 172 NE 743 (Ill 1930)

People v Horning 102 P 3d 228 (Cal 2004)

R v Jacobs 1940 TPD 142

R v T 2010 EWCA Crim 2439

R v Tang 2006 65 NSWLR 681

Ramirez v State of Florida (Florida Supreme Court) (unreported) case number SC92975 of 20 December 2001

Resurrection Gold Mining Co v Fortune Gold Mining Co 129 F 668 (8th Cir 1904)

S v Rohde 2019 1 All SA 740 (WCC)

Sedma Removals CC v Never General Dealers CC 2018 ZAGPPHC 789 (19 October 2018)

SMD Telecommunications CC v Mutual and Federal Insurance Company Ltd 2009 ZAWCHC 147 (18 May 2009)

State v Davidson 509 SW 3d 156 (Tenn 2017)

State v Mack 653 NE 2d 329 (Ohio 1995)

State v Samonte 928 P 2d 1 (Haw 1996)

Tuite v The Queen 2015 VSCA 148

Twine v Naidoo 2018 1 All SA 297 (GJ)

United States v Anderson 2009 CF1 20672 (Sept 3, 2010)

United States v Ashburn 88 F Supp 3d 239 (EDNY 2015)

United States v Diaz No CR 05-00167 WHA, 2007 WL 485967 (ND Cal Feb 12, 2007)

United States v Foster 300 F Supp 2d 375 (D Md 2004)

United States v Glynn 578 F Supp 2d 567 (SDNY 2008)

United States v Green 405 F Supp 2d 104 (D Mass 2005)

United States v Hicks 389 F 3d 514 (5th Cir 2004)

United States v Hines 55 F Supp 2d 62 67 (D Mass 1999)

United States v Mikos No 02 CR 137, 2003 WL 22922197 (ND III 2003)

United States v Monteiro United 407 F Supp 2d 351 (D Mass 2006)

United States v Natson 469 F Supp 2d 1253 (MD Ga 2007)

United States v Santiago 199 F Supp 2d 101 (SDNY 2002)

United States v Wolff 5 MJ 923 (NCMR 1978)

US v Baines 573 F 3d 979 (2009)

US v Taylor 663 F Supp 2d 1170 (DNM 2009)

US v Willock 696 F Supp 2d 536 (D Md 2010)

Velevski v The Queen 2002 187 ALR 233

White Burgess Langille v Abbott and Haliburton Co 2015 SCC 23

Williams v State 384 So 2d 1205 (Ala Crim App 1980)

Internet sources

Brand J 2017 Faulty Forensics: Explained https://injusticetoday.com/faulty-forensics-explained-cd102d3f0a2e accessed 22 November 2017

Collaborative Testing Services Inc 2018 Firearms & Toolmarks https://cts-forensics.com/program-3.php accessed 18 November 2018

Cromwell T 2011 The Challenges of Scientific Evidence http://www.scottishlawreports.org.uk/publications/macfadyen-2011.html accessed 27 July 2016

Dack JR 2014 Using Forensic Ballistics in the Courtroom https://scholarship.shu.edu/cgi/viewcontent.cgi?article=1631&context=student_scholarship accessed 2 December 2019

Devasia C and Koutsoudakis A 2011 Magistrate Judges: A Primer for Young Lawyers https://koehler-isaacs.com/2011/12/29/magistrate-judges-a-primer-for-young-lawyers/ accessed 31 August 2017

Dinzeo M 2017 Skepticism of Forensic Methods Urged at 9th Circuit Conference https://www.courthousenews.com/skepticism-forensic-methods-urged-9th-circuit-conference/ accessed 7 August 2017

Federal Rules of Evidence 2020 Rule 401 – Test for Relevant Evidence https://www.rulesofevidence.org/article-iv/rule-401 accessed 7 January 2020

Federal Rules of Evidence 2011 Rule 702: Testimony by Expert Witnesses https://www.law.cornell.edu/rules/fre/rule_702 accessed 7 January 2020

Hogan Lovells 2016 Confirmation Bias and the Law https://www.hoganlovells.com/en/publications/confirmation-bias-and-the-law accessed 14 June 2018

National Academies of Sciences Engineering Medicine 2008 Is Evolution a Theory or a Fact? https://www.nas.edu/evolution/TheoryOrFact.html accessed 27 April 2017

Organisation of Scientific Area Committees 2014 OSAC on Forensic Science http://www.nist.gov/forensics/osac/hfc.cfm accessed 5 August 2017

How to Cite
Meintjes, L., & Mutsavi, T. (2020). Ensuring the Reliability of Fire-Arm Identification Evidence. Potchefstroom Electronic Law Journal, 23, 1-39. https://doi.org/10.17159/1727-3781/2020/v23i0a6046