Evaluation of Research

You are here

25 Feb 2022

Evaluation of Research

Submitted by Francoise Genova


Meeting objectives: 

 

The evolution of the evaluation of research from being mostly bibliographic index-based is now recognized to be indispensable to enable Open Science. In the same way that Open Science promotes the open sharing of FAIR data and other research outputs, evaluators must also value and consider these outputs as part of the wider research evaluation framework.  The RDA is an appropriate forum for addressing the evolving requirements of research evaluation as they relate to Open Science practices, and in particular to addressing challenges around the evaluation of datasets as valuable assets in their own right and the recognition of participation in the definition and maintenance of disciplinary or generic data sharing frameworks and of data services, as well as more generally of team work. RDA’s reach across the international community, including research organisations and funders, can help to facilitate and align a global discussion of research evaluation, drawing on data experts from a range of domains.

 

The BoF objectives are

  • To hold a first discussion about the subject in the RDA;

  • To assess whether there is an interest in the RDA community to develop activities in the domain;

  • To identify useful activities which could be tackled by the RDA in the domain, such as a concrete list of existing initiatives on the subject, and create a realistic working plan on how RDA could contribute on the evaluation aspects, particularly regarding data.

The meeting is co-organised by Francoise Genova (RAB co-chair), Ari Asmi (RAB), Natalie Harrower, Rosie Hicks (RAB), Rebecca Koskela (RAB co-chair), Shelley Stall (OAB co-chair) 

 

Meeting agenda: 

Collaborative session notes: https://docs.google.com/document/d/1VQvDSyrnPnXJg9e5Iowtak_O9tXQIwy1AB93...

 

The meeting agenda will include:

  • Short presentations by different stakeholders. Confirmed speakers

    • Javier Lopez Albacete (European Commission)

    • Serge Bauin, Centre National de la Recherche Scientifique (France)

    • Carlos Montero Corrales (National University of Costa Rica) - Evaluation of results of Veterinary Medicine School of the National University of Costa Rica

    • Claudio Monge Hernandez (Costa Rica) - The challenges of the new scientific evaluation in an open science world: a latin american perspective.

       

  • A short presentation of the outcome of a global questionnaire survey of the scholarly communication attitudes and behaviours of early career researchers (Harbingers), presented by Chérifa Boukacem-Zeghmouri

  • Time reserved for discussion of the possible follow-up RDA activities.

Participants will be invited to gather information about relevant documents and web sites and to post their input in a shared document Evaluation of Research - Stories and Links. The document is available and input can also be provided before and after the BoF session.

 

Type of Meeting: 
Working meeting
Short introduction describing any previous activities: 

 

The necessary evolution of the evaluation of research has been discussed for years now in the international context - one can of course cite DORA), with also activities on how to enable it in regional, national and organisational contexts. It was recently a major topic of the Paris Open Science European Conference (OSEC 2022) organised in the context of the French Presidency of the European Union with a strong European and international participation, including speakers from the European Commission, South America, UNESCO and the United States. The meeting will be an occasion to gather more information from the participants about the activities they are aware of as well as to discuss possible follow-up activities in the RDA.

 

The RDA Data Usage Metrics Working Group produced a recommendation which can be useful in this context.

 

BoF chair serving as contact person: 
Are you willing to host a live second session to accommodate a different time zone? : 
Yes
Meeting presenters: 
Meeting presenters will be identified with the help of the Regional Advisory Board and the Organisational Advisory Board.
How do you prefer to hold the virtual component of your session?: 
Other
Other: 
Live with likely some pre-recorded material
Avoid conflict with the following group (1): 
Avoid conflict with the following group (2): 
Contact for group (email): 
Estimate of the required room capacity (Hybrid plenary): 
50
Driven by RDA Organisational Member: 
No
Which format do you plan on using for your session?: 
Virtual
Applicable Pathways: 
FAIR, CARE, TRUST - Adoption, Implementation, and Deployment
Data Lifecycles - Versioning, Provenance, Citation, and Reward
Please select breakout slot (s) for your (optional) second live session. : 
Breakout 4
Please indicate the breakout slot (s) that would suit your meeting: 
Breakout 1