Advertisement
NO ACCESS
Special Issue Perspective

Reproducible Research in Computational Science

Science
2 Dec 2011
Vol 334, Issue 6060
pp. 1226-1227

Abstract

Computational science has led to exciting new developments, but the nature of the work has exposed limitations in our ability to evaluate published findings. Reproducibility has the potential to serve as a minimum standard for judging scientific claims when full independent replication of a study is not possible.

Get full access to this article

View all available purchase options and get full access to this article.

Already a subscriber or AAAS Member? Log In

References

1
Hanson B., Sugden A., Alberts B., Making data maximally available. Science 331, 649 (2011).
2
Peng R. D., Dominici F., Zeger S. L., Reproducible epidemiologic research. Am. J. Epidemiol. 163, 783 (2006).
3
J. P. Madrid, D. Macchetto, Bull. AAS, http://arxiv.org/abs/0901.4552 (2009).
4
Schwab M., Karrenbach N., Claerbout J., Making scientific computations reproducible. Comput. Sci. Eng. 2, 61 (2000).
5
Laine C., Goodman S. N., Griswold M. E., Sox H. C., Reproducible research: Moving toward research the public can really trust. Ann. Intern. Med. 146, 450 (2007).
6
King G., Replication, Replication. PS: Polit. Sci. Polit. 28, 444 (1995).
7
R. Gentleman, Stat. Appl. Genet. Mol. Biol. 4, article 2 (2005).
8
Yale Law School Roundtable on Data and Code Sharing, Comput. Sci. Eng. 12, 8 (2010).
9
Ioannidis J. P. A., et al., Repeatability of published microarray gene expression analyses. Nat. Genet. 41, 149 (2009).
10
Mesirov J. P., Computer science. Accessible reproducible research. Science 327, 415 (2010).
11
Peng R. D., Reproducible research and biostatistics. Biostatistics 10, 405 (2009).
12
McCullough B. D., McGeary K. A., Harrison T. D., Do economics journal archives promote replicable research? Can. J. Econ. 41, 1406 (2008).
13
Barnes N., Publish your computer code: It is good enough. Nature 467, 753 (2010).

Information & Authors

Information

Published In

View large Science cover image
Science
Volume 334 | Issue 6060
2 December 2011

Submission history

Published in print: 2 December 2011

Permissions

Request permissions for this article.

Authors

Affiliations

Roger D. Peng
Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore MD 21205, USA.

Notes

To whom correspondence should be addressed. E-mail: [email protected]

Metrics & Citations

Metrics

Article Usage
Altmetrics

Citations

Export citation

Select the format you want to export the citation of this publication.

Cited by

  1. Scientific Community-Driven Ecosystem as a Supporter to Co-Create and Co-Evolute Science, Emerging Ecosystem-Centric Business Models for Sustainable Value Creation, (53-66), (2022).https://doi.org/10.4018/978-1-7998-4843-1.ch003
    Crossref
  2. Automated evolutionary approach for the design of composite machine learning pipelines, Future Generation Computer Systems, 127, (109-125), (2022).https://doi.org/10.1016/j.future.2021.08.022
    Crossref
  3. A Beginner's Guide to Conducting Reproducible Research, The Bulletin of the Ecological Society of America, 102, 2, (2021).https://doi.org/10.1002/bes2.1801
    Crossref
  4. Versioning Data Is About More than Revisions: A Conceptual Framework and Proposed Principles, Data Science Journal, 20, (2021).https://doi.org/10.5334/dsj-2021-012
    Crossref
  5. Ensembler: A Simple Package for Fast Prototyping and Teaching Molecular Simulations, Journal of Chemical Information and Modeling, 61, 2, (560-564), (2021).https://doi.org/10.1021/acs.jcim.0c01283
    Crossref
  6. Epistemic issues in computational reproducibility: software as the elephant in the room, European Journal for Philosophy of Science, 11, 2, (2021).https://doi.org/10.1007/s13194-021-00362-9
    Crossref
  7. Socio-technical scales in socio-environmental modeling: Managing a system-of-systems modeling approach, Environmental Modelling & Software, 135, (104885), (2021).https://doi.org/10.1016/j.envsoft.2020.104885
    Crossref
  8. A concrete example of construct construction in natural language, Organizational Behavior and Human Decision Processes, 162, (81-94), (2021).https://doi.org/10.1016/j.obhdp.2020.10.008
    Crossref
  9. Reproducible Research: A Retrospective, Annual Review of Public Health, 42, 1, (79-93), (2021).https://doi.org/10.1146/annurev-publhealth-012420-105110
    Crossref
  10. The 4th Paradigm in Multiscale Data Representation: Modernizing the National Geospatial Data Infrastructure, Handbook of Big Geospatial Data, (589-618), (2021).https://doi.org/10.1007/978-3-030-55462-0
    Crossref
  11. See more
Loading...

View Options

Check Access

Log in to view the full text

AAAS ID LOGIN

AAAS login provides access to Science for AAAS Members, and access to other journals in the Science family to users who have purchased individual subscriptions.

Log in via OpenAthens.
Log in via Shibboleth.
More options

Purchase digital access to this article

Download and print this article for your personal scholarly, research, and educational use.

Purchase this issue in print

Buy a single issue of Science for just $15 USD.

View options

PDF format

Download this article as a PDF file

Download PDF

Media

Figures

Multimedia

Tables

Share

Share

Share article link

Share on social media