Computational Reproducibility: What’s Next for RDA?
Submitted by Limor Peer
The objective of this BoF is to provide a forum for discussing and soliciting membership input about computational reproducibility and RDA. We will address the following questions:
-
What has been RDA’s contribution to work on computational reproducibility?
-
Is there a need for coordinating efforts around computational reproducibility at RDA? Where should be the scope and focus of these efforts going forward? Should the RDA Reproducibility IG be restarted?
-
How do efforts outside RDA inform us? Are there fruitful paths for collaboration?
Collaborative session notes: https://docs.google.com/document/d/13dKJss65qJjZ6x4Piv3N2ToyaB0CbJzytH1m...
-
Reproducibility efforts at RDA -- Mandy Gooch, Tom Honeyman, Limor Peer (10 mins)
-
Invited speakers: (40-50 mins)
-
Association of Computing Machinery (ACM), EIG on Reproducibility (Philippe Bonnet)
-
Reproducibility Networks, ReScience journals (Etienne Roesch)
-
Turing Way (Patricia Herterich)
-
Open Science communities (Alexandra Sarafoglou)
-
PLOS (Lauren Cadwallader)
-
cascad (Christophe Pérignon)
-
-
Discussion (30-40 mins)
RDA has a historical Interest Group on Reproducibility that was active primarily between 2014-2016 and led by Bernard Schutz and Victoria Stodden. The charge of the group is “to advance and enable reproducibility in research based on or producing datasets. Our goals are to provide community based recommendations and infrastructure solutions, doing so in coordination with the other RDA Working and Interest Groups where appropriate.” The group primarily focused on efforts around the computational infrastructure necessary for reproducible research. In recent years, several efforts at RDA addressed various aspects of reproducibility, including curation (CURE-FAIR WG), software (FAIR4RS WG, Software Source Code IG), infrastructure (Preservation e-Infrastructure IG), discipline-specific requirements (Reproducible Health Data Services WG), and more. These groups have produced recommendations and other outputs and helped shape the conversation about, and the practice of, reproducibility. At the same time, a good number of efforts to advance reproducibility – in terms of technology, infrastructure, policies, guidelines, and education – are taking place outside RDA.
- Historical Reproducibility IG https://www.rd-alliance.org/groups/reproducibility-ig.html
- 10 Things for Curating Reproducible and FAIR Research https://doi.org/10.15497/RDA00074
- Introducing 10 Things for Curating Reproducible and FAIR Research, RDA Webinar https://www.rd-alliance.org/cure-fair-wg-sept-2022-output-webinar
- Introducing the FAIR Principles for Research Software https://www.nature.com/articles/s41597-022-01710-x
- 1091 reads