Judge gets scientific method better than scientists

In summary: I don't know. I can see some merit to that, since in the court of law one should strive for maximal objectivity, and history can be very subjective. But on the other hand, this outright dismisses a vast body of knowledge as irrelevant.
  • #1
anorlunda
Staff Emeritus
Insights Author
11,308
8,744
https://reason.com/wp-content/uploads/2021/07/b49101a8-ad23-44dc-9500-ecec551c08b8.pdf

This was unexpected. In a 55 page decision from the Superior Court of DC, the judge said the following.
[A]s gatekeeper, the Court cannot allow an expert to testify concerning documents and articles that they have reviewed, unless the expert can establish that they have used some technique or methodology that systematically gathers, organizes and catalogs the documents such that another expert with similar training could follow the same procedure and arrive at the same result...
The methodologies of the expert must be grounded in the scientific method, such that another person with similar expertise could replicate them. See Daubert 509 U.S. at 591. Reviewing a selection of documents, summarizing them, and giving an opinion about their conclusions is not a proper methodology grounded in the scientific method

The scientist litigator, and his expert witnesses said:
When asked about the methodologies that she used in this case, Dr. Oreskes responded: "If you want me to tell you what my method is, it's reading and thinking. We read. We read documents. And we think about them."

It seems to me that the judge gets it, and the scientist(s) did not.

This example could also serve to illustrate the difference between a post in a PF thread and a paper submitted to a peer reviewed journal. Here on PF we strive to educate about science and engineering as known in the peer reviewed literature. If some of our members do new science, they prepare it for the higher standard of peer review, not post it here. The judge did a good job of explaining the difference.
 
  • Like
  • Haha
Likes DaveE, sbrothy, sysprog and 13 others
Physics news on Phys.org
  • #2
I agree that the judge was correct.

You would be amazed, though, at what kind of bogus opinion evidence gets admitted in courts.

For decades, the FBI used comparative bullet lead analysis as evidence that a bullet used in a crime came from the same box of bullets found in the possession of the accused. This began in the 1960's and continued until about 2005 after the NAS declared it to be unreliable. Forensic Analysis Weighing Bullet Lead Evidence. ,

The FBI had to discontinue use of the evidence and thousands of convictions had to be vacated.

Other bogus 'science' includes 'shaken baby syndrome' which has never been established as valid, fire marshalls providing expert opinion as to the cause of fire (the case of Cameron Todd Willingham will make you cringe) and forensic "bite mark" evidence.

Although this judge got it right, many don't. The problem is that once a new 'science' gets accepted by a few courts it takes off and is difficult to stop.

AM
 
  • Wow
Likes Leo Liu
  • #3
anorlunda said:
The scientist litigator, and his expert witnesses said:
It should be noted that Dr. Oreskes is a historian, and what she described looks representative of a historian's modus operandi. They literally read documents and think about them. They don't run experiments, they don't take measurements. There's no results to replicate. Their methods consist of digging up sources, critiquing their trustworthiness, and arguing for a coherent narrative on their basis.
It looks to me like in the judge's opinion no historian can ever provide expert testimony, since the jury should just read the relevant documents themselves.
Which... I don't know. I can see some merit to that, since in the court of law one should strive for maximal objectivity, and history can be very subjective. But on the other hand, this outright dismisses a vast body of knowledge as irrelevant.
 
  • Like
Likes russ_watters
  • #4
Bandersnatch said:
But on the other hand, this outright dismisses a vast body of knowledge as irrelevant.
Here, the judge describes in more detail the criteria for expert witnesses. Do you think that is inadequate?

In determining whether an expert opinion is based on specialized knowledge and has used reliable methodologies, the Court will look to such factors as: (1) “whether the theory or technique … can be (and has been) tested;” (2) “whether it has been subjected to peer review and publication;” (3) “the known or potential rate of error;” (4) “the existence and maintenance of standards controlling the technique’s operation;” and (5) “whether the technique has been accepted by the scientific community.” Daubert, 509 U.S. at 593-94. Determining reliability is a flexible inquiry that focuses “solely on principles and methodology, not on the conclusions that they generate.”

I have never seen historians reviewing historical documents be able to give error bars on their conclusions. But maybe I'm wrong.
 
  • #5
anorlunda said:
Do you think that is inadequate?
No, I think the opposite. I think that it is holding history to standards only empirical sciences can match, therefore excluding historians from ever being able to give expert testimony. It's basically saying the professional expertise of a historian is inadmissible, and can be equally replaced by letting the jury just read the sources themselves.

anorlunda said:
I have never seen historians reviewing historical documents be able to give error bars on their conclusions.
Yes, that's the point.
 
  • Like
Likes russ_watters
  • #7
As a European it's refreshing to see at least some degree of sanity in the US legal system.

Karl Popper would've been proud had he been alive.

EDIT: Or maybe "proud" isn't the right word. At least he accomplished something of lasting value.
 

FAQ: Judge gets scientific method better than scientists

What is the scientific method?

The scientific method is a systematic approach to conducting experiments and acquiring knowledge about the natural world. It involves making observations, formulating a hypothesis, designing and conducting experiments, analyzing data, and drawing conclusions.

How does a judge understand the scientific method better than scientists?

A judge may have a deeper understanding of the scientific method because they are trained to evaluate evidence and arguments objectively. They are also accustomed to applying logical reasoning and critical thinking skills, which are essential in the scientific method.

Can anyone use the scientific method?

Yes, anyone can use the scientific method to investigate a question or phenomenon. It is a universal approach that can be applied in various fields, from biology and chemistry to psychology and sociology.

What are the benefits of using the scientific method?

The scientific method allows for a systematic and unbiased approach to acquiring knowledge. It also promotes reproducibility and transparency, which are essential for building upon existing research and making advancements in science.

Are there any limitations to the scientific method?

While the scientific method is a valuable tool, it does have limitations. It relies heavily on empirical evidence and may not be applicable to all fields of study. It also requires resources and time to conduct experiments, which may not always be available.

Back
Top