NOVEMBER 2009 (Volume 3, Number 11)                                                                                                                                        Current circulation:  2,184
CRIME LAB REPORT
Media and public-policy analysis for the forensic science community
Email *                                                    First Name                                           Last Name                                          Affiliation
         
                                                   If you aren't a subscriber, it's time to get connected!

Stochastics - The real science behind forensic pattern identification


November 24, 2009 by John M. Collins, CLR Chief Managing Editor &
Director of the DuPage County Crime Laboratory in Wheaton, IL
    

 
Click here to Print

It is the science in which all of forensic science will grow newer and deeper roots.   

It is a mathematical foundation for common forensic testing methods that never before could be quantified in understandable terms.

It provides, without a doubt, a statistical and philosophical framework that can drive revolutionary research in all of the forensic sciences, including DNA.

It is called Stochastics – the science of randomness.  Many forensic scientists have never heard of it.  But it waits with open arms to welcome a profession that is in desperate need of a home.   

For over a century, many of the classical forensic disciplines such as latent prints, toolmarks, and footwear impressions have struggled to overcome a debilitating identity crisis.  Practitioners in these disciplines rightly insist that their work is rooted in good science.  But when scrutinized by persistent inquisitors who expect conclusions of uniqueness to be accompanied by a quantitative assessment, many forensic scientists are left to simply present their “training and experience” as the ultimate foundation upon which their conclusions rest.   

Undoubtedly, a forensic scientist’s training and experience are critical and relevant.  We also know that accurate and reliable forensic determinations are being made each day even though mathematical formulas don’t yet exist to back them up.  But it is not enough to make forensic science determinations.  They must be communicated as well. 

That’s where the problem lies. 

In today’s scientific and legal environments, presenting one’s training and experience as the exclusive, underlying foundation of critically important conclusions, particularly statements of certainty and uniqueness, is no longer seen as appropriate and never will be again.  No matter how forensic science practitioners feel about this trend, many current practices must eventually give way to something more transparent and perceptibly objective – both for scientific reasons and to command a higher level of confidence, which is actually what science is about anyway.

That time may not have come just yet, but it will.  So if the forensic science community is to be seen as trustworthy, responsible, and truly desirous of continual advancement, it must actively support and encourage the newer kinds of research that will allow scientists to communicate their results more effectively.

It seems that within the realm of stochastics all of the nuances and complexities of forensic science, which so often frustrate judges and lawyers, make complete sense.  Here’s why.

Take something as seemingly simple as the flip of a coin.  Despite all of the scientific and mathematical knowledge at our disposal – knowledge that has found cures to the most devastating diseases and has safely landed astronauts on the moon – there is no way to predict with any degree of mathematical certainty on which side a well-flipped coin will land. 

Yes, we can calculate the odds that the coin will land with heads or tails up.  But we cannot conclusively predict it.    

In other words, the flip of a coin is not so simple after all. The random processes that result in one side facing upwards are infinitely complex and therefore escape our predictive reach.

Calculating the odds that a coin will land either heads up or tails up is a deterministic problem.  Predicting exactly which event will occur is a stochastic problem. 

In the pattern identification disciplines, the words deterministic and stochastic are generally not used.  The terms class and individual are used instead but they mean the same thing.  In DNA testing, stochastic phenomena are dealt with on a regular basis and are described as such. Random appearances and disappearances of genetic alleles occur unpredictably during the analysis of extremely low levels of DNA and can’t be mathematically explained.     

In reality, stochastic problems and processes are everywhere and are relevant to the most complex issues in the human experience.  Forensic evidence is no exception and the absence of exact mathematical models to describe what many practitioners observe in a forensic testing laboratory does not, and should not, minimize its scientific standing.

Doctors, for example, cannot predict the exact number of days that a terminally ill patient will survive after his or her diagnosis.  The outcome is dependent upon stochastic processes.

Behavioral psychologists cannot predict the chance that a child will grow up to become a serial killer.  The outcome is dependent upon stochastic processes.

Geophysicists cannot reliably predict the chance that an active volcano will erupt in the next year.  The outcome is dependent upon stochastic processes.

The natural world is dominated by random variations and infinite possibilities, a problem that cursed even the great Albert Einstein who believed that mathematical equations could ultimately explain and predict everything.

“God does not play dice with the universe,” he once wrote to a friend.

“But God does play poker,” warned the famous physicist Stephen Hawking.

The patterns observed in latent fingerprints, on bullets, in a person’s handwriting or on the bottom surface of their shoes are also the results of stochastic processes that cannot be controlled.  Patterns that result from these processes are judged to be unique mainly because decades of observation and research have only validated the formulation of such judgments.

But there is one small problem.

Those who conduct comparisons of stochastic patterns in forensic science know very well that there are limits to their ability to assess uniqueness.  With enough smudging or interference, a latent fingerprint cannot be identified to the person who deposited it.  With enough damage, a bullet cannot be identified to the gun that fired it. 

Not all identifications are created equally.  Some are easy.  Some are difficult.  In the most extreme instances, comparisons can result in identifications with which not all examiners would agree.

It is precisely these extreme instances – the gray areas in forensic science – that require attention.  It is also the reason that identifications, or conclusive statements of origin, demand the highest levels of scientific justification.

Make no mistake, forensic practitioners present authoritative and reliable opinions about the identity and origin of latent prints, toolmarks, footwear impressions, and other stochastic pattern evidence.  But as questions begin to explore a practitioner’s opinion about all other sources, other people, other guns, and other shoes, a more conservative and cautious approach is now expected until the research justifies “the exclusion of all others.”

In the meantime, a more responsible and perhaps a more compelling approach is for forensic scientists to simply state the truth about identifications.  “I have never seen, nor would I expect to see, this amount of similarity in [friction ridge patterns, bullet striations, footwear impressions, or other types of pattern evidence] that came from different sources.”

This is a statement of fact and is supported by the practitioner’s education, training, and experience.  Arguing, on the other hand, that an identification excludes every possible source that ever did, does, or could exist is probably correct, but it cannot be entirely defended under the scientific expectations that our courts now have.  And when identifications fall increasingly close to those marginal gray areas, the risks naturally increase.     

So how are the courts to know if an identification falls close to or far from these margins of higher risk?  Where are the margins?  How much is enough?  Judges and juries have a right to know.      

To get a glimpse of where future research can take the profession, the following questions are posed.

Would you believe that the odds of two different guns leaving the same pattern on the primer of a cartridge case (the small metal disc that ignites the gun powder when struck by the gun’s firing pin) were less than 1 in 60.5 sextillion?  Would a judge or jury find this information to be compelling if there was ample research to support the claim?

Consider the following example.

Imagine a circle.  Now imagine dividing this circle into 360 equally spaced radial-lines (spokes), and 100 equally spaced concentric circles (percent of the radius). 

http://www.cs.cmu.edu/~tlm/silent/silent_circle4.jpgIf you count every location where lines intersect, you wind up with 36,001 “points” of comparison.

Using this rough model, one can quickly see how easy it is for nature to create unique stochastic patterns that can be evaluated by forensic scientists. 

If two different people drew one of these hypothetical circle-grids then randomly and independently selected five of the 36,001 available points, the odds of them selecting the same pattern of points is as follows:

Selecting one identical point = 1 in 36,001

Selecting two identical points = 1 in 1.3 billion

Selecting three identical points = 1 in 47 trillion

Selecting four identical points = 1 in 1.6 quintillion

Selecting five identical points = 1 in 60.5 sextillion

The real-life patterns observed by forensic scientists are even more complex and varied; therefore, the subsequent statistical expressions of uniqueness will likely be even more impressive, and possibly more mathematically definitive, than DNA. 

We just need the research to show it.

We can never know the exact chance that two different persons will leave the same fingerprint pattern, or that two guns will impart the same pattern of striae on the surface of a bullet.  The randomness of the stochastic processes involved simply will not allow it.  Perhaps this is one reason why statistical research in the pattern identification disciplines was never funded or prioritized with any enthusiasm. 

But research can, in fact, quantify the margins and establish useful thresholds to help practitioners explain the significance of their observations.  This will be a huge achievement.

Coincidently, Taylor and Francis, the same organization that publishes the new journal Forensic Science Policy and Management, also publishes Stochastics – an International Journal of Probability and Stochastic Processes.  

Dr. Elart Von Collani at the University of Wurzburg in Germany has become a leading expert in the stochastic sciences.  In 1995, he published an article in the European Journal of Engineering that seemed to provide a reasonable explanation for one of the problems observed by the National Academy of Sciences in its 2009 report, Strengthening Forensic Science in the United States – A Path Forward.

The NAS report complained that “the forensic science enterprise is hindered by its extreme disaggregation—marked by multiple types of practitioners with different levels of education and training and different professional cultures and standards for performance and a reliance on apprentice-type training and a guild-like structure of disciplines, which work against the goal of a single forensic science profession.”

But according to Von Collani, this type of fragmentation is to be expected.  “Each field of traditional science creates its own stochastical branch,” he explained, “thus preventing unification.”

In other words, fragmentation exists in the forensic sciences precisely because each segment of the profession is dealing with its very own specialized stochastical branch.  The details and minutia observed by a latent print examiner is of no relevance to a toolmark examiner. 

Admittedly, Von Collani was not writing about forensic science specifically.  But there are strong parallels and common ties that bind all of the stochastic pattern disciplines.  It will take some time for forensic practitioners to become fully aware of them.  In the meantime, the right research conducted by the right people can liberate many embattled forensic disciplines and empower their practitioners to report conclusions with more scientific certainty. 

One way for this transformation to begin is for forensic scientists and researchers in academia to think differently about stochastic patterns. 

A striation on the surface of a bullet, for example, is not just a scratch.  Nor is the bifurcation of a friction ridge in a fingerprint pattern simply a second-level detail. 

Instead, both the bullet striation and the friction ridge bifurcation are events.  And like all events, they have a certain probability of occurring. 

It will take some time for forensic scientists to stop thinking of patterns as a collection of characteristics.  But sooner than later, they must begin to evaluate these patterns as a collection of events.  Only then can they further elevate their respective forensic disciplines to the new heights of scientific credibility that are now expected.

The forensic pattern identification disciplines are, and have been, reliable and valid.  It’s the expectations that have changed.  For this reason, research must be designed and executed to help us meet this new challenge.

This new opportunity to enhance what is done in the future must not be construed as an indictment of what was done in the past. 

Anyone with scientific sense knows the difference between the two. *****

Please click here to submit a comment.  We welcome opposing view points.

ANNOUNCEMENTS

Attention Subscribers:

We would like to apologize for the delay in this month's report.  Both of our managing editors had conflicts that prevented our report from being distributed at its normal time.

We hope everyone in the United States a Happy Thanksgiving.  We are thankful for the support and interest of our readers and hope you will continue to encourage your colleagues to subscribe to our publication.  We are excited about the new projects we have planned for 2010 and look forward to bringing them to you.

Also, we would like to remind everyone that we welcome guest authors who would like to try their hand at writing an editorial on a current topic of interest.  Attracting guest authors will be a priority of our editors in the coming year.  If you are interested in writing an editorial for publication in Crime Lab Report, please contact us or send us a manuscript. 

Again, best wishes and thanks for your interest!  

John Collins & Jay Jarvis
Managing Editors

NEWS HEADLINES
EVENTS
FORENSIC SCIENCE JOB EXCHANGE


Employment Opportunities

 

This is a new feature by Crime Lab Report. More information will be provided in an upcoming report.  Please email us with any job vacancies you would like to post.  There is no charge for publicly funded forensic science laboratories. 

INFORMATION & SERVICES

Respond to Crime Lab Report

Subscribe to Crime Lab Report

Our Home Page

Editorial Board

Library

Inside Crime Labs

Media Kit / Advertising

LETTERS TO THE EDITORS


Read comments from our readers

Disclaimer:  Most of Crime Lab Report's readers are professionals in, or associated with, the criminal justice system.  Their opinions may not necessarily reflect those of organizations with whom they are employed or affiliated.

Click here to email our editors 

 

“All readers will find something of interest in Mr. Jarvis’s research and documentation of a critical period in the development of forensic science in North America. Forensic scientists in particular will be intrigued by how much and what was accomplished with such limited resources and techniques.” 

- Doug Lucas, retired Director of the Centre of Forensic Sciences, Toronto and Past President of the American Academy of Forensic Sciences.

“Georgia’s Crime Doctor is a fascinating look into the life of a key figure in American forensic science and the founding of the Georgia Crime Lab. Rich in detail and intriguing case histories, Jay Jarvis’s well-researched book helps to answer a crying need for historical perspectives on the development of forensic science in the United States.”

- Jan Burke, best-selling author and founder of the Crime Lab Project.

“This is a well researched, well written story of a great Georgia public servant who was ahead of his time. Dr. Herman D. Jones pioneered the advances of forensic science not just in Georgia but in this country. Because of the careful research and story-telling talent of Jay Jarvis, Dr. Jones will now be remembered as he should be. Well worth reading.”

- Zell Miller, former U.S. Senator and Georgia Governor.

“Because of Dr. Jones’s teaching, his emphasis on scientific investigation techniques, and the success of his crime lab, investigators in Georgia began to broaden the scope of criminal investigations to include the collection of physical evidence that had previously been deemed useless.”

- Dr. Curtis McClung, retired Chief of Police, Columbus Police Department.

Click here to purchase Georgia's Crime Doctor



We encourage our readers to subscribe to this historic journal, which publishes peer-reviewed literature pertaining to management and policy issues in forensic science.

Click here for information


MANAGING EDITORS

Chief Managing Editor

John M. Collins

Associate Managing Editor
Jay Jarvis


CONTACT INFORMATION

Crime Lab Report
1921 W. Wilson Street
Suite A-252
Batavia, IL 60510

Email:  editors@crimelabreport.com

Phone: (866) 674-9194

Fax: (866) 809-4301


PRESS INQUIRIES

All inquires from the press must be directed to the Chief Managing Editor at (866) 674-9194.



OFFICE HOURS

Crime Lab Report's editors can be reached Monday through Thursday from 5PM to 9PM CT.



PUBLICATION INFORMATION

Crime Lab Report is a monthly publication distributed electronically to subscribers who have opted into our mailing list.  Editorials published by Crime Lab Report are also provided in a PDF format to facilitate easier printing.  There is no charge to subscribe to Crime Lab Report.

 MEDIA & ADVERTISING

Advertising is available at Crime Lab Report.  Please download a copy of our media kit at the Crime Lab Report home page - www.crimelabreport.com.

Please click here to contact CRIME LAB REPORT.  Our office hours are 5PM - 9PM Monday through Thursday (CT).   Toll Free: 866-674-9194

Copyright 2009 by Crime Lab Report.  All rights reserved.  This report contains opinions expressed by CRIME LAB REPORT, which is an independent organization.  These opinions may not necessarily represent those of our sponsors or other organizations affiliated with CRIME LAB REPORT and its editors.  While every effort is made to ensure accuracy and contextual honesty, all opinions should be corroborated with independent research before being construed as factual.  Crime Lab Report will quickly correct and/or retract any information demonstrated to be erroneous.  We welcome opposing viewpoints and will publish responses from our readers, which may be edited for economy and clarity.