What are you looking for?
Group Session July 2, 2024

Evaluation of Research: Leveraging liaisons

Plenary: RDA 23rd Plenary Meeting – San José, Costa Rica

Submitted by

Meeting objectives

Following the publication of its first output, “RDA role in the Evaluation of Research Landscape,” the Evaluation of Research IG aims at consolidating and leveraging the liaison it has been establishing with relevant RDA Groups and initiatives outside the RDA. The main aim of the meeting will in particular be to consolidate the liaison between the RDA and the Coalition for Advancement of Research Assessment (CoARA). CoARA is an international organisation created in 2022. Its vision is that “the assessment of research, researchers and research organisations recognises the diverse outputs, practices and activities that maximise the quality and impact of research.” As agreed during its P22 session, the IG is currently mapping the CoARA WGs with the relevant RDA Groups. CoARA and RDA Groups will be invited to briefly present their activities, with the aim to identify possible synergies and activities to be performed by the Evaluation of Research IG to facilitate them, including the possible role of CoARA National Chapters.

Meeting presenters

Emma Crott|Francoise Genova|Devika Madalli|Amy Nurnberger

Meeting agenda

Part 1 (15 min): Welcome
– Short review of Group’s aims and activities

Part 2 (60 min): Discussion of the Group current and foreseen activities
– Based on the current work on mapping of CoARA WGs with RDA Groups, representatives of these groups will be invited to present short contributions on their activities and possible practical synergies. The speakers will be informed beforehand about the mapping to be able to prepare their contributions to the meeting. A representative of a CoARA National Chapter will be invited to participate to discuss the possible role of the National Chapters. (30 minutes)
– Propose and solicit feedback from the participants, including those participating remotely (15 minutes)
– Discuss proposals for other areas of activity (15 min)

Part 3 (15 min): Next steps
– Confirm commitments to next steps (10 min)
– Identify and align around goals for P24 (5 min)

The collaborative note document will be organised so as to gather written comments and contributions in addition to the discussion.

Target audience

The evolution of research evaluation is potentially of interest for the whole RDA community, as shown by the attendance at the Plenary BoFs and IG meeting and the number of RDA Groups that agreed to designate one of their co-chairs to ensure liaison with this IG. It is also of high interest for the Funders represented in the RDA and the member organisations.

Attendees can prepare by:
– Reflecting on their constructive experiences with research and its evaluation outside article/monograph publications
– Reviewing the “RDA role in Evaluation of Research Landscape” document, which will be be submitted for comments early July
– Reviewing the draft mapping of CoARA WGs and RDA Groups, which will be linked to the meeting web page before the meeting
– Reviewing notes and presentations from the IG P22 meeting
– Identifying relevant liaisons which would be useful to establish and documents useful to share

Group Activities and Scope

The evolution of the evaluation of research from being mostly bibliographic index-based is now recognized to be indispensable to enable Open Science. In the same way that Open Science promotes the open sharing of FAIR data and other research outputs, evaluators must also value and consider these outputs as part of the wider research evaluation framework. The RDA is an appropriate forum for addressing the evolving requirements of research evaluation as they relate to Open Science practices. RDA’s reach across the international community, including research organisations and funders, can help to facilitate and align a global discussion of research evaluation, drawing on data experts from a range of domains.

The Interest Group “Evaluation of Research” organises the discussion on the subject in the RDA, in particular as it relates to data, and also in relation to RDA activities on research software.

Additional links to informative material

IG P22 meeting, web page: https://www.rd-alliance.org/plenaries/rda-in-the-evaluation-of-research-landscape/|IIG P22 meeting, notes and presentations: https://docs.google.com/document/d/1Ak75MxZe6xQSXMV3gZCgnIJpZwK4mDAnek7VJKmh04I/edit?usp=drive_link|CoARA: https://coara.eu|CoARA Working Groups: https://coara.eu/coalition/working-groups/|CoARA National Chapters: https://coara.eu/coalition/national-chapters/|

Short Group Status

The Evaluation of Research IG was approved by RDA Council in June 2023 and held meetings at P21 and P22, after two successful BoFs. Since the P22 meeting, it finalised its first output, “RDA Role in the Evaluation of Research Landscape”, and submitted it to the RDA community for comments. As discussed during the P22 session, the IG is currently working on the mapping of CoARA WGs with RDA Groups.

Estimate of the required venue room capacity

Under 50 seats

Applicable Pathways

Data Infrastructures and Environments - Generalist
Data Lifecycles - Versioning, Provenance, Citation, and Reward
Other (Policies)

Please indicate at least (3) three breakout slots that would suit your meeting.

Breakout 1. Tuesday, 12 November, 16:00-17:30 UTC
Breakout 3. Wednesday, 13 November, 14:00-15:30 UTC
Breakout 4. Wednesday, 13 November, 16:00-17:30 UTC
Breakout 6. Thursday, 14 November, 16:00-17:30 UTC