What are you looking for?
Back to Plenary Participation
Group Session June 1, 2023

Evaluation of Research : Kick-off Plenary Meeting – Community perspectives

Plenary: RDA 21st Plenary Meeting [part of International Data Week 2023], Salzburg, Austria

Submitted by
Francoise Genova
Recording

Meeting objectives

 

The Evaluation of Research IG was submitted to RDA in May 2023. The meeting will hopefully be its first meeting during an RDA Plenary as an Interest Group, after two successful BoF meetings at P19 and P20. The meeting objectives are:

  • to discuss the activities foreseen for the IG with the RDA community and get participants’ feedback;

  • to identify people interested to get involved in specific activities;

  • to present the first results of the landscape analysis aimed at identifying RDA activities relevant to the subject, the first topic that will be addressed by the IG, and gather comments from the participants.

 

The meeting will enable us to achieve this together through sharing perspectives on the importance of diverse approaches to research and its evaluation, respecting cultural, national, and disciplinary needs and requirements via discussion and contributions to current and planned activities of this group. 

 

 

Meeting presenters

The meeting presenters are: IG co-chairs: Emma Crott, Francoise Genova, Devika Madalli and Amy Nurnberger, and leaders of current efforts

Meeting agenda

Collaborative meeting notes: https://bit.ly/EoRp21

Part 1 (10 min): Welcome

  • Short review of Group’s aims and activities: Transition from BoF to IG

 

Part 2 (60 min): Discussion of the Group current and foreseen activities

  • First steps toward a preliminary landscape analysis and discussion (30 min)

  • Discussion and determination of next activities (30 min)

 

Part 3 (15 min): Next steps

  • Confirm commitments to next steps

  • Identify and align around goals for P22

 

The collaborative note document will be available and organised so as to gather written comments and contributions in addition to the discussion.

 

Target audience

 

The evolution of research evaluation is potentially of interest for the whole RDA community, as shown by the attendance at the P20 BoF and the number of RDA Groups that agreed to designate one of their co-chairs to ensure liaison with this IG. It is also of high interest for the Funders represented in the RDA and the member organisations.

 

In May 2023, the following RDA Groups designated a liaison with the IG:

External initiatives with which the IG has established liaison (they are represented in the IG Stakeholder Forum):

 

Attendees can prepare by:

  • Reflecting on their experiences with research and its evaluation

  • Reviewing EoR-IG web page and case statement 

  • Reviewing notes and presentations from past meetings: P19 BoF, P20 BoF

  • Identifying relevant liaisons which would be useful to establish and documents useful to share

 

Additional links to informative material

Additional links will be added before the meeting taking into account IG activities until then.

Short Group Status

 

The evolution of the evaluation of research from being mostly bibliographic index-based is now recognized to be indispensable to enable Open Science. In the same way that Open Science promotes the open sharing of FAIR data and other research outputs, evaluators must also value and consider these outputs as part of the wider research evaluation framework. The RDA is an appropriate forum for addressing the evolving requirements of research evaluation as they relate to Open Science practices. RDA’s reach across the international community, including research organisations and funders, can help to facilitate and align a global discussion of research evaluation, drawing on data experts from a range of domains. 

The Interest Group “Evaluation of Research” organises the discussion on the subject in the RDA, in particular as it relates to data, and also in relation to RDA activities on research software. The initial topics for discussion identified for the IG are the following:

  • Mapping of the RDA activities relevant to research evaluation/assessment;

  • Gathering of links to relevant information, identifying relevant initiatives and determining how to engage with the initiatives and organisations that are most important to the group’s objectives and outcomes, in particular CoARA;

  • Liaison with the developments linked to CoARA and other initiatives identified as relevant and important;

  • Liaison with the relevant RDA Bodies, Interest Groups (IG) and Working Groups (WG);

  • Identifying additional topics and other initiatives with which to establish connection;

  • Act as an incubator for relevant RDA activities to be developed, in particular new WGs.

 

Applicable Pathways

Data Lifecycles - Versioning, Provenance, Citation, and Reward
Other (Policies)

Avoid conflict with the following groups

RDA for the Sustainable Development Goals IG
Global Open Research Commons IG