What are you looking for?
Group Session January 24, 2025

Evaluation of Research – Current and future activities

Plenary: RDA 24th Plenary Meeting – Fully Virtual

Submitted by

Meeting objectives

Collaborative session notes:
https://docs.google.com/document/d/1hNz63wtZ-ty6H0gAisTt3kkbDDnrADDT/edit#heading=h.2vw52x56jli

The Evaluation of Research IG activities since P23 have been based on the discussion during the IG meeting at this Plenary. They include in particular:

  • Working on a registry of relevant initiatives – the IG set up a Task Force for this purpose
  • Pursuing the liaison with CoARA, its national chapters and its Working Group
  • Assessing the possible RDA role on disciplinary perspectives in the evaluation of research – the IG will organise a pre-plenary meeting on March 25th to discuss how to tackle the subject
  • Updating the IG Output RDA Value for Evaluation of Research if necessary

This meeting will be a working meeting, with the main aims to gather the participant’s perspective on the outcome of the IG activities to date and to identify the IG goals for P25.

 

Meeting presenters

Amy Nurnberger, Emma Crott, Francoise Genova, CoARA representative

Meeting agenda

Part 1 (10 minutes) Welcome

Short review of the Group aims and activities

Part 2 (30 minutes) Liaison with CoARA

  • CoARA status and activities – presenter defined in collaboration with Erzsébet Toth Czifra, CoARA Program Manager (15 min)
  • Q/A, next steps in IG/CoARA liaison  (15 min)

Part 3 (40 min) Discussion of the Group current and foreseen activities

  • Registry of relevant initiatives (15 min)
  • How to tackle the disciplinary aspects of evaluation – Discussion of the outcome of the pre-plenary meeting (15 min)
  • Update of the RDA Value for the Evaluation of Research Output (10 min)

Part 3 (10 minutes) Next steps

  • Confirm commitments to next steps
  • Identify and align around goals for P25

Target audience

The evolution of research evaluation is potentially of interest for the whole RDA community, as shown by the attendance at the pre-IG BoFs and IG meetings and the number of RDA Groups that agreed to designate one of their co-chairs to ensure liaison with this IG. It is also of high interest for the Funders represented in the RDA and the organisational and regional members.

Attendees can prepare by:

  • Reflecting on their constructive experiences with research and its evaluation outside article/monograph publications,
  • Identifying relevant initiatives and liaisons which would be useful to establish and documents useful to share
  • Consulting the notes taken during the pre-plenary meeting
  • Reviewing the “RDA Value for Evaluation of Research” document.

Group Activities and Scope

The evolution of the evaluation of research from being mostly bibliographic index-based is now recognized to be indispensable to enable Open Science. In the same way that Open Science promotes the open sharing of FAIR data and other research outputs, evaluators must also value and consider these outputs as part of the wider research evaluation framework. The RDA is an appropriate forum for addressing the evolving requirements of research evaluation as they relate to Open Science practices. RDA’s reach across the international community, including research organisations and funders, can help to facilitate and align a global discussion of research evaluation, drawing on data experts from a range of domains.

The Interest Group “Evaluation of Research” organises the discussion on the subject in the RDA, in particular as it relates to data, and also in relation to RDA activities on research software.

Additional links to informative material

Short Group Status

The Evaluation of Research IG was approved by RDA Council in June 2023, after two successful BoF meetings. The IG held meetings at all Plenaries since then. Its first output, “RDA Role in the Evaluation of Research Landscape” was endorsed in August 2024. Its current activities are listed above and will be discussed during the meeting.

Applicable Pathways

FAIR, CARE, TRUST - Adoption, Implementation, and Deployment
Data Infrastructures and Environments - Discipline Focused

Please indicate at least (3) three breakout slots that would suit your meeting.

Breakout 4. Tuesday, 8 April, 14:00-15:30 UTC
Breakout 7. Wednesday, 9 April, 14:00-15:30 UTC
Breakout 10. Thursday, 10 April, 14:00-15:30 UTC