Reproducibility and replicability

Learn about the meaning of reproducible, replicable, robust and generalisable research

Prerequisites

• Research questions and hypotheses

1 Definitions

The terms reproducible and replicable are often used interchangeably but The Turning Way has proposed a semantic scheme which introduces two more terms: robust and generalisable.

Check out the section Table of Definitions for Reproducibility from The Turing Way book, which defines the four terms.

Quiz 1

When is research not reproducible?

a. When the results do not match the researcher's expectations. b. When the the same data and code as in the original study do not produce the published results. c. When research conducted by a different research team with new data does not produce the results as published in the original study.

Hint

Research is reproducible when you can produce the same results using the original data and code/methods.

Research is replicable when you can produce the same results using new data and the original code/methods.

See https://the-turing-way.netlify.app/reproducible-research/overview/overview-definitions.html#table-of-definitions-for-reproducibility.