What are you looking for?
Birds of a Feather (BoF) Session January 24, 2025

Metadata for Reproducibility

Plenary: RDA 24th Plenary Meeting – Fully Virtual

Submitted by

Meeting objectives

Collaborative session notes:
https://docs.google.com/document/d/1HoisAStxeLcsHDJwxa3uHzafPyQgZGom/edit#heading=h.jsalll5wuxw

This is a Birds of a Feather (BoF) session organized jointly by the Reproducibility IG and the Metadata IG.

The reproducibility of research results, and most especially computational reproducibility, relies on having sufficiently detailed information about the workflow used. This BoF will discuss the most important information to collect, and explore possibilities for collecting it in a way that is convenient for researchers, while allowing it to be recorded in a structured and actionable manner.

Specific goals for the discussion include:

  • gauging the interest in joint work on this topic;
  • understanding how the work of the Metadata and Reproducibility IGs informs this topic;
  • identifying other current work relevant to this topic;
  • identifying outputs that a joint WG could develop that would promote the collection and use of metadata for reproducibility.

Meeting presenters

Claire Austin, Alex Ball, Lauren Cadwallader, Mandy Gooch, Milan Ojsteršek, Limor Peer, Stephen Richard

Meeting agenda

  • 0:00–0:05. Welcome and introductions
  • 0:05–0:15. Brief overview of the Metadata and Reproducibility IGs
  • 0:15–0:30. Problem statement
    • What is reproducibility metadata?
    • What should it be?
    • Why is it important?
    • How is it different from other metadata?
  • 0:30–1:15. Group discussion – key questions include:
    • There’s a wide reliance on narrative for recording methodology, because research can be messy and anyone can write a narrative. Is it possible to introduce a structure that (a) is flexible enough to cope with the full variety of methodologies, (b) feels intuitive to write, (c) provides benefit to the primary researchers, as well as enabling reproducibility?
    • As a parallel to a machine-actionable Data Management Plan (maDMP) (see RDA Standard for maDMPs), becoming a record of how a dataset was managed: could a framework for planning a methodology/computational workflow evolve into a record of that methodology/workflow?
    • What metadata do we want to capture about the computation itself as distinct from the research methodology;
    • How can various frameworks for research planning popularized by open science and increasingly in use (e.g., pre-registration) be leveraged as metadata.
    • Is there interest in a new RDA Reproducibility Definition and Checklist” WG?
  • 1:15–1:30. Wrap up and next steps

Have you presented a session on the same topic at any previous plenaries?

No

Estimate of the required venue room capacity

Up to 30

Applicable Pathways

Training, Stewardship, and Data Management Planning
Semantics, Ontology, Standardisation

Avoid conflict with the following groups

Please indicate at least (3) three breakout slots that would suit your meeting.

Breakout 4. Tuesday, 8 April, 14:00-15:30 UTC
Breakout 7. Wednesday, 9 April, 14:00-15:30 UTC
Breakout 10. Thursday, 10 April, 14:00-15:30 UTC