Skip to content
Saturday, September 26, 202668 days to the Dice Letter centennialNo physics degree or shared belief required.
GOD PLAYS DICE™The magazine of big questions

EXTRAORDINARY CLAIMS EXPLAINER

What Would Count as Evidence?

A practical way to move from an intriguing report to a conclusion that someone else can test.

A strange observation deserves attention. It also deserves a better question than “Do you believe it?” Ask what was recorded, how it was recorded, and which conclusions the record can support. Evidence is information that bears on a claim. Its strength depends on the quality of the observation and on whether competing explanations have been considered.

Imagine a bright point racing across a video. The video may establish that light reached the camera. It may not establish the point’s size, distance, speed, or origin. A nearby small object and a distant large one can leave surprisingly similar images. To learn more, an investigator would want the original recording, time and location, camera settings, context, and perhaps an independent view. These details are not fussy extras. Without them, a dramatic interpretation can rest on an estimate nobody actually measured.

Instruments need checking too. A thermometer can drift; a camera can produce glare; a sensor can register a pattern created by its own operation. Calibration asks how an instrument responds to known conditions. Metadata tells us when and how it was used. NASA’s independent UAP study emphasized calibrated sensors and the surrounding information because several apparent anomalies can be artifacts of measurement. This lesson applies to any unusual claim, not only reports from the sky.

Next, compare explanations. If one account predicts a particular pattern and another does not, a well-designed observation can distinguish them. Repeated measurements by different teams make a conclusion sturdier. A claim that changes whenever a test fails becomes difficult to evaluate. The National Academies explain that confidence grows when results can be reproduced or replicated and when multiple studies converge. One vivid story can start an investigation; it rarely finishes one.

Not every question permits a repeat performance. We cannot rerun a past supernova or a single historical event. Scientists can still look for independent traces, compare records, and test predictions about what those traces should contain. “Repeatable” is most useful as a way to make methods open to checking, not as a demand that nature perform on command.

Good skepticism has a generous side. It does not require calling a witness dishonest or deciding beforehand that an unexpected result is impossible. It lets the observation stand while keeping the explanation provisional. The strongest evidence gives other people enough information to find the same result, challenge it, or show where an alternative fits better. That is how a compelling question can become shared knowledge.

Sources & further reading

  1. NASA — UAP Independent Study Team Final Report (2023) ↗
  2. National Academies — Decoding Science: How does science know what it knows? ↗
  3. National Academies — Reproducibility collection ↗

#Claim examination#Evidence

KEEP ASKING

For a claim you find intriguing, what original record would you want to inspect first?