International Benchmarking the Global Open Research Commons (GORC)

You are here

16 Jul 2021
Group(s) submitting the application: 
Meeting objectives: 

This meeting is a continuation of the regular meetings of the Global Open Research Commons International Benchmarking WG. The GORC Benchmarking WG is conducted under the umbrella, and coordinates with the Global Open Research Commons (GORC) IG as they refine the definition and typology of the Commons and work towards a roadmap for global development. The WG’s goal is to evaluate and recommend a minimal set of international benchmarks for global commons that allow researchers and developers to coordinate services and create roadmaps for international interoperability. 

 

The attendees of the Benchmarking WG at P17 agreed to the general purpose and approach to the work proposed by the WG leads. Subsequent to P17, approximately 29 individuals joined the WG. We held our first regular meeting in June of 2021 to respond to Council’s feedback to the WG Case statement. It was informative feedback and helped us better define the meaning of benchmarks. Moreover, it provided the opportunity to clarify our role in the community, not as evaluators or an organization that seeks to certify commons, but rather as supporting commons developers who are creating interoperable services. 

  

Between the end of July 2021 and P18 we anticipate making decisions about the form of the deliverable for the WG and will be in the process of testing and utilizing the workflow developed for researching, proposing, discussing and capturing benchmarks. In light of this, we propose the Benchmarking WG meeting at P18 essentially be a standard working meeting where members can meet and discuss potential benchmarks. This would allow anyone who is interested but not yet involved in the WG to see the process in action and provide an opportunity for the WG to be transparent about the state of our deliverables.

 

The objective of this meeting will be:

  1. Recap and discuss any proposed refinements to the benchmark submission and approval process 

  2. Review the status of deliverables

  3. Determine next steps

Meeting agenda: 
  • Introduction to meeting and previous work (10 mins) - Mark Leggott

    • Take away messages from P17

  • Review and update: The process for proposing benchmarks, KPIs and implementations; current status of the deliverable

  • Group activity discussion of submitted benchmarks (40 mins) - All

  • Next steps (15 mins) - Karen Payne and Mark Leggott

Target Audience: 

Research funders, infrastructure providers and data services active in delivering Research / Data Commons initiatives

Group chair serving as contact person: 
Brief introduction describing the activities and scope of the group: 

The Global Open Research Commons International Benchmarking WG will examine benchmarks that are useful to national, pan-national and domain specific developers of Commons globally. The benchmarks will fall into one of two classes: internal benchmarks to measure user engagement or content generation, and external benchmarks as indicators of Commons maturity and adherence to best practices. We anticipate using the typology of commons under development by the GORC IG as an organizing principle for the benchmarks. The WG will also capture exemplars of well executed benchmarks or Commons features when available, and use the entire collection as input to the GORC IG Roadmap.

Short Group Status: 

At the time of this writing the WG isn't officially endorsed (mid-July 2021). As a BoF this group submitted an original case statement to the TAB in early January 2021. We then created a second version based on their review and re-submitted April 6, 2021. That version was elevated to Council and based on their feedback we created a third version and are waiting to hear the response. The group’s first regular session took place June 17, 2021. The next scheduled meeting is for July 22, 2021.

Type of Meeting: 
Working meeting
Avoid conflict with the following group (1): 
Avoid conflict with the following group (2): 
Meeting presenters: 
WG/IG chairs plus WG members