status: Recognised & Endorsed
Chair (s): Limor Peer, Lauren Cadwallader, Tom Honeyman, Mandy Gooch
Group Email: [group_email]
Secretariat Liaison: [field_secretariat_liaison]
Overview
This interest group seeks to advance and enable reproducibility in research based on or producing datasets that require code. Our goals are to build bridges with the many RDA external efforts addressing reproducibility, doing so in coordination with the other RDA Working and Interest Groups where appropriate. Our efforts may also produce Working Groups that can develop recommendations and solutions.
This Group follows the broad definition of reproducibility stated by Turing Way in order to provide an inclusive framework for discussions.
Charter
The charter describes what this interest group is seeking to do and how you can be involved. Below is a summary of key details.
Objectives
- Provide a forum for a holistic discussion of RDA developments around data and code relating to Reproducibility, in the areas covered by the topics below.
- Identify and discuss the development and adoption of relevant tools, workflows, and computational infrastructure.
- Develop a research agenda aimed to increase the reliability of the scientific record and reduce irreproducibility and informed by current advances, challenges, and prominent areas of interest relating to reproducibility, for example, FAIR principles, open science, data integrity, research assessment, metascience, and artificial intelligence.
Topics for discussion include:
- the identification and adoption of community-determined definitions on ‘reproducibility’, including its value, limitations, and applicability within various research domains
- the persistent linking and availability of data and code (via repositories or other mechanisms) used in the generation of published research results, with the publication itself
- the development, encouragement, and adoption of metadata standards for data and code, especially for those linked to publications
- the development, encouragement, and adoption of data and code publication, authorship, and citation practices, especially for those linked to publications
Involvement
The Reproducibility Interest Group is open to all RDA members to participate. Participation is possible in three ways:
- participation in plenary sessions once or twice a year
- participation in the organisation of future sessions, or activities arising from specific sessions
- coordination, planning and implementing or overseeing the above (otherwise known as co-chairing)
We welcome input and participation on technical, practical and social aspects of reproducibility. We are open to joint sessions with existing RDA groups and RDA-external groups interested in reaching the members of the RDA with an interest in reproducibility.
Please contact one of the co-chairs to let us know if you're interested.
Future Activities
We intend to hold open organising meetings in the lead up to and organisation of plenary sessions. These will be shown on the events tab.
Plenary 21 (2023)
Introducing the reestablished Reproducibility IG
Past Activities:
Plenary 20 (2023)
Computational Reproducibility: What's Next for RDA? (recording)
Past Phase of the Reproducibility Interest Group
The Reproducibility Interest Group ran from Dec 2014 to Aug 2019 before closing for several years. The full aims of the group were laid out in the case statement.
Plenary 8:
- Knowledge Preservation Tools for Researchers: You have to preserve your data before you can share it!
- Reproducibility of Data-Enabled Research: Update and Progress
- Tools Convergence: Integrating Data Management Plan and Preservation Tools
Plenary 6:
Plenary 5:
- Joint session: IG Research Data Provenance & IG Reproducibility
- Joint Session: IG Big Data Analytics & IG Reproducibility
Plenary 4:
- IG Reproducibility (no link)
Co-Chairs
We are open to regular rotation of the co-chairing of the group. We particularly welcome co-chairing from members of RDA-external groups interested in the proposal and planning of plenary sessions with a focus on new audiences, needs or interests not previously covered by plenary sessions by this group.
Please contact one of the current co-chairs to let us know if you're interested, after you have read about the roles and responsibilities of RDA co-chairs.
Current (2023-)
Past (2014-2019)
Posts
Reproducibility IG - notes on RDA P21 session
by Limor Peer
Dear colleagues, Thank you to everyone who attended the session at RDA P21 on Introducing the reestablished Reproducibility IG in Salzburg and online! There is energy and enthusiasm on the topic of reproducibility and we will be reaching out with next steps in the coming weeks. In the meantime, please don't hesitate to contact any of us with questions and suggestions.0 | Add new comment
RDA Plenary 21: Introducing the reestablished Reproducibility IG
by Limor Peer
Dear members of the Reproducibility IG, We are looking forward to seeing you at RDA P21 for the session, "Introducing the reestablished Reproducibility IG" on Thursday, October 26 at UTC 07:00 - 08:30 at Doppler Hall and virtually.0 | Add new comment
Re-established Reproducibility Interest Group -- endorsed by RDA Council
by Limor Peer
We are pleased to announce that the Reproducibility Interest Group was endorsed by the RDA Council in July 2023!0 | Add new comment
Strategies for Machine Learning Reproducibility webinar
(resending with corrected links) On August 22nd, 2023, at 8am PT (1500 UTC), FARR will kick off their AI reproducibility webinar series with a focus on ML reproducibility. The event titled, Strategies for Machine Learning Reproducibility, will be presented by Dr. Odd Erik Gundersen and Kevin Coakley. Major takeaways will include valuable insights and practical ideas to help achieve reproducibility in ML and a solid understanding of common pitfalls that can undermine the reproducibility of research. Register for this event here !0 | Add new comment
Strategies for Machine Learning Reproducibility webinar
On August 22nd, 2023, at 8am PT (1500 UTC), FARR will kick off their AI reproducibility webinar series with a focus on ML reproducibility. The event titled, Strategies for Machine Learning Reproducibility, will be presented by Dr. Odd Erik Gundersen and Kevin Coakley. Major takeaways will include valuable insights and practical ideas to help achieve reproducibility in ML and a solid understanding of common pitfalls that can undermine the reproducibility of research. Register for this event here !0 | Add new comment
Strategies for Machine Learning Reproducibility webinar
On August 22nd, 2023, at 8am PT (1500 UTC), FARR will kick off their AI reproducibility webinar series with a focus on ML reproducibility. The event titled, Strategies for Machine Learning Reproducibility, will be presented by Dr. Odd Erik Gundersen and Kevin Coakley. Major takeaways will include valuable insights and practical ideas to help achieve reproducibility in ML and a solid understanding of common pitfalls that can undermine the reproducibility of research. Register for this event here !0 | Add new comment
RDA P21 @ IDW 2023 - Notification of Acceptance
Dear Chairs of the Reproducibility IG Your RDA P21 session application titled Introducing the reestablished Reproducibility IG has been approved. Please consider this your official notification of acceptance. Key dates to keep in mind: * Draft programme to be published on Friday, 28 July * Any requests for changes must be made by Monday, 21 August to ***@***.***-foundation.org * P21 programme will be deemed final by Tuesday, 22 August0 | Add new comment
Reminder: Community review of the new charter for the Reproducibility IG
by Limor Peer
Dear members of the historical Reproducibility IG, This is a friendly reminder that,0 | Add new comment
Reproducibility IG Mailing List Update & New Charter Open For Community Feedback
by Mandy Gooch
Dear Members of the Historical Reproducibility Interest Group,0 | Add new comment
Birds of Feather session on Computational Reproducibility at Plenary 20
by Tom Honeyman
Hi All, I'm writing to let you know about an upcoming birds of a feather session on Computational Reproducibility at the next plenary, which I hope you can attend.0 | Add new comment