Collaborative session notes https://docs.google.com/document/d/1Ak75MxZe6xQSXMV3gZCgnIJpZwK4mDAnek7VJKmh04I/edit?usp=drive_link
Group(s) submitting the application: Evaluation of Research IG
Meeting objectives
The Evaluation of Research IG was endorsed by RDA Council in June 2023. It held its first meeting in Salzburg during Plenary 21, after two successful BoF meetings at P19 and P20. The meeting objectives are:
- to get participants’ feedback on the first IG output, “RDA role in the Evaluation of Research Landscape”, which will be submitted for RfC after the Plenary;
- to discuss current and further IG activities, in particular the outcome of an IG meeting to be held before the Plenary, the decision to map the Working Groups of the Coalition for the Advancement of Research Assessment (CoARA) with RDA activities.
The meeting will enable the IG to finalise the “RDA role in the Evaluation of Research Landscape” output and shape future activities, taking into account diverse approaches to research and its evaluation; respecting cultural, national, and disciplinary needs; and the requirements of the RDA community.
Meeting agenda:
- Part 1 (15 min): Welcome
- Short review of Group’s aims and activities: Initial IG activities
- IG pre-plenary meeting (29 April 2024) Meeting notes
- Short review of Group’s aims and activities: Initial IG activities
- Part 2 (60 min): Discussion of the Group current and foreseen activities
- Presentation of the “RDA role in the Evaluation of Research Landscape” document (15 20 min)
- Solicit feedback (10 min)
- Propose and solicit feedback for the mapping of CoARA Working Groups with RDA activities (20 min)
- Discuss proposals for other areas of activity (15 min)
- Part 3 (15 min): Next steps
- Confirm commitments to next steps (10 min)
- Identify and align around goals for P23 (5 min)
- The collaborative note document is organised so as to gather written comments and contributions in addition to the discussion.
Target Audience:
The evolution of research evaluation is potentially of interest for the whole RDA community, as shown by the attendance at the Plenary BoFs and IG meeting and the number of RDA Groups that agreed to designate one of their co-chairs to ensure liaison with this IG. It is also of high interest for the Funders represented in the RDA and the member organisations. The liaison with the RDA Groups and external initiatives relevant to Evaluation of Research is managed through the IG Stakeholder Forum.
Attendees can prepare by:
- Reflecting on their constructive experiences with research and its evaluation outside article/monograph publications
- Reviewing the “RDA role in Evaluation of Research Landscape” document, which is available at https://docs.google.com/document/d/1VyyJ7lSnxOfhqtgZa7OIWxS_SbdV1sRFEMTfSZtaE5g/edit?usp=sharing
- Reviewing notes and presentations from past meetings: P19 BoF, P20 BoF, P21
- Identifying relevant liaisons which would be useful to establish and documents useful to share
Group chair serving as contact person: Francoise Genova
Brief introduction describing the activities and scope of the group:
The evolution of the evaluation of research from being mostly bibliographic index-based is now recognized to be indispensable to enable Open Science. In the same way that Open Science promotes the open sharing of FAIR data and other research outputs, evaluators must also value and consider these outputs as part of the wider research evaluation framework. The RDA is an appropriate forum for addressing the evolving requirements of research evaluation as they relate to Open Science practices. RDA’s reach across the international community, including research organisations and funders, can help to facilitate and align a global discussion of research evaluation, drawing on data experts from a range of domains.
The Interest Group “Evaluation of Research” organises the discussion on the subject in the RDA, in particular as it relates to data, and also in relation to RDA activities on research software. The initial topics for discussion identified for the IG are the following:
- Mapping of the RDA activities relevant to research evaluation/assessment;
- Gathering of links to relevant information, identifying relevant initiatives and determining how to engage with the initiatives and organisations that are most important to the group’s objectives and outcomes, in particular CoARA;
- Liaison with the developments linked to CoARA and other initiatives identified as relevant and important;
- Liaison with the relevant RDA Bodies, Interest Groups (IG) and Working Groups (WG);
- Identifying additional topics and other initiatives with which to establish connection;
- Act as an incubator for relevant RDA activities to be developed, in particular new WGs.
Short Group Status:
The Evaluation of Research IG was approved by RDA Council in June 2023 and held its first meeting at P21, after two successful BoFs. At the time of the P22 meeting, it will be finalising its first output.
Type of Meeting: Working meeting
Additional links to informative material:
- IG web page
- P19 BoF web page/notes/presentations
- P20 BoF web page/ notes/presentations
- P21 session web page/notes/presentations