Skip to content
BackGOD PLAYS DICE™Big questions, honest answers

THE QUESTION LIBRARY HOW WE KNOW

How can you tell good science from bad science?

Good science shows how a claim was tested and gives other people enough information to challenge it.

THE SHORT ANSWER

Good science makes a clear, testable claim; shows how evidence was gathered and analyzed; reports uncertainty; and lets others check the work. There is no single step-by-step method used by every field. A lab experiment, a telescope survey and a study of ancient rocks need different tools, but each must connect its conclusion to evidence. One paper, a famous name or peer review alone is not enough. Confidence grows when independent checks and different lines of evidence agree.

  • The National Academies say there is no single set of methods used across all of science, and no fixed sequence of steps.
  • Transparent data, methods and uncertainty let others assess what a study actually shows.
  • Independent studies and several lines of evidence increase confidence over time.
  • Peer review is useful scrutiny, but publication alone does not guarantee that a finding will hold up.
Students using a microscope.
About this picture

A microscope is one scientific tool. The right way to investigate a question depends on what is being studied.

Asamoah Daniel Kwame Oware, via Wikimedia Commons · CC0 1.0 (public domain dedication) · Image source ↗

WHERE THE EVIDENCE STANDS

How sure are we?

  • Every scientist follows one fixed scientific method.The National Academies’ 2019 reproducibility report quotes the AAAS: there is “no fixed set of steps that scientists always follow”; its 2025 misinformation report says no single set of methods is used across all domains of science.
  • A clear account of methods, evidence and uncertainty helps others evaluate a result.The National Academies’ 2019 report says clear, specific and complete reporting of materials, methods, results and uncertainty lets other scientists know how to interpret results.
  • Independent confirmation strengthens confidence in a scientific result.The National Academies’ 2019 report says multiple channels of evidence from a variety of studies give a robust way to gain confidence over time; replication and research synthesis are among them.
  • Peer review proves a published claim is correct.The National Academies lists rigorous peer review as one way to reduce avoidable errors, but warns against serious decisions based on any single study; a former BMJ editor reports that reviewers in BMJ tests spotted only about a quarter of inserted major errors.
What the labels mean

WHAT WE DON’T KNOW YET

No checklist can give a final verdict on every new finding. The right test and the meaning of a failed repeat depend on the field, the claim and how much the evidence could have varied by chance.

WHAT WOULD CHANGE THIS ANSWER

A new study with clear methods, stronger measurements and independent confirmation can strengthen or overturn a current judgment. A claim that cannot be tested against observations cannot gain scientific support by repetition alone.

Good science lets you see how someone moved from evidence to a conclusion, and it leaves room for others to check the move. Start with four questions: What exactly is claimed? What was measured or observed? Could something else explain the result? Have independent researchers tested it? A dramatic headline or a respected scientist can draw your attention, but neither answers those questions.

There is no single recipe called “the scientific method” that everyone follows in order. A physicist may run a controlled experiment. An astronomer may compare light from distant objects because she cannot move a star into a lab. A geologist may study layers left by events long past. The National Academies says there is no single set of methods used across all of science. What joins them is careful evidence, reasoning, and testing that other people can examine.

Good work describes how the data were collected, what was left out, how the analysis was done and how uncertain the result is. The conclusion should match the strength of the evidence. One study may show a correlation, meaning two things change together. That alone does not show one caused the other. A careful author tells you what the study can and cannot rule out.

Science also gains strength over time. Another team may repeat the work with new data. Researchers may combine several studies or test the idea in a different way. Sometimes a result fails to hold up. That does not make every first study dishonest or every later study final. It means the evidence is being checked. Peer review can catch some problems before publication, but it is not a certificate of certainty. The most useful habit for a reader is to ask whether the claim remains convincing after someone tries to find a better explanation.

THE LONG ANSWER

THE LONG ANSWER · ABOUT 7 MINUTES

You’ve read your 3 free long answers this month.

The short answer, how sure we are, what we don’t know, what would change our mind and every source stay free on every page, for everyone.

All Access members read the long answer: the evidence piece by piece, the strongest objections, and how to check it yourself.

Join All Access · $1 a week Or $6 a month

Billed $52 once a year. Cancel anytime in your account.

Until December 4, 11:59 pm Pacific: the Founding rate is $39 a year, and it stays $39 while you stay a member.

Create a free account: 6 long answers a month, email only.

Paying never buys a different answer. Our Paywall Promise

Words worth knowing (5)
Hypothesis
A proposed explanation that can be tested against observations.
Uncertainty
The range of possible values or explanations left by limits in a measurement or study.
Replication
A new study aimed at the same question using new data, to see whether a result holds up.
Reproducibility
In the National Academies' usage, getting consistent computational results using the original data and methods.
Peer review
Assessment of research by other specialists, often before journal publication.

Sources & further reading

(7) · Checked Sep 29, 2026
  1. Reproducibility and Replicability in Science: Scientific Methods and Knowledge ↗National Academies of Sciences, Engineering, and MedicineQuotes the AAAS: “no fixed set of steps that scientists always follow”; shared features of science (evidence, logic and reasoning, communication); complete reporting of methods, results and uncertainty; Conclusion 2-1 on reporting uncertainty.
  2. Reproducibility and Replicability in Science: Summary ↗National Academies of Sciences, Engineering, and MedicineDefines reproducibility and replicability (terms used differently across fields); a single failed replication does not conclusively refute an original claim; rigorous peer review among practices that reduce avoidable non-replicability; multiple channels of evidence; Recommendation 7-3 on single studies.
  3. Reproducibility and Replicability in Science: Confidence in Science ↗National Academies of Sciences, Engineering, and MedicineRobustness comes from a web of knowledge and multiple lines of inquiry, not one replication; research synthesis and meta-analysis; Conclusion 7-2.
  4. Understanding and Addressing Misinformation About Science (2025) ↗National Academies of Sciences, Engineering, and MedicineNo single set of methods used across all domains of science; uncertainty and refinement as principles; debate and dissent built into science; weight of evidence depends on the question.
  5. Decoding Science: How does science know what it knows? ↗National Academies PressPublic guide: wonder, test, confirm; build confidence when many studies agree; when studies disagree, find out why.
  6. Peer review: a flawed process at the heart of science and journals ↗Journal of the Royal Society of Medicine (2006), Richard SmithEssay by a former BMJ editor: reviews that request raw data and repeat analyses are “vanishingly rare”; in BMJ studies with inserted major errors, most reviewers spotted about a quarter. A critical view, balanced here by the National Academies’ account of peer review’s role.
  7. Evaluating Health Information (updated February 26, 2024) ↗NIH National Library of Medicine · MedlinePlusOwnership, expertise, purpose, funding, review, references, dates and cross-checks. Application beyond health is editorial advice. Reviewed October 5, 2026.

See a mistake? Report a problem. Corrections are made openly.

The Architect AI companion · All Access

Your next question can go further.

Included with All Access →Up to 5 questions a day while available.

Put God Plays Dice on your Home Screen

On iPhone: tap Share (on iOS 26, tap ••• first), then Add to Home Screen, then Add.

On Android: In Chrome, you can also open the ⋮ menu and choose Add to Home screen or Install.

The Home Screen version keeps its own memory on iPhone, so your nights and saved answers start fresh there.

Search the Question Library

149 answers to read · 0 questions awaiting answers Your search runs on your device.

Answers about death, grief and crisis are always free, in full. If a question is personal right now →