Skip to content

Replication Review

Students inspect a public research artifact or implementation and answer:

  1. Can the published result be rebuilt?
  2. Are exact subject-system versions available?
  3. Are preprocessing and exclusion rules explicit?
  4. Are random seeds and configurations recorded?
  5. Can reported tables/plots be regenerated?
  6. Which result is most sensitive to an undocumented choice?
  7. What minimum patch would improve reproducibility?

A replication review is a technical audit, not a complaint that software is difficult to run.