From principles to metrics to evaluation, increasing TRUST in data repositories
-
Discussion
-
Collaborative meeting notes: https://docs.google.com/document/d/1lqilrSGrEsCEnJkL71E5VT3Yqz1a_L-2HLmN…
1. Welcome and introduction (5 min) – IG Co-chairs
2. Presentation: TRUST Principles as an aspirational goal for a digital repository
ecosystem (5 min)
3. Presentation: Application of the TRUST principles to repository development (2, 5 min. each)
4. Presentation: Challenges to make TRUST trusted (5 min).
5. Presentation: Metrics, towards make a repository trustworthy: case study from a survey of biomedical repositories (10 min).
6. Presentation: How TRUST principles and repository certification apply to a generalist repository (10 min).
7. Discussion: Engagement groups to promote and implement TRUST Principles within various communities, including but not limited to generalist repositories, technology
and service providers, publishers, professional societies, and repository certification standards (45 min).
8. Next steps and closures (5 min) – IG co-chairAdditional links to informative material
● The TRUST Principles for digital repositories: https://www.nature.com/articles/s41597-020-0486-7/bit.ly/trustprinciples (published May 2020 in Scientific Data)
● The TRUST Principles: An RDA Community Effort: https://www.rd-alliance.org/trust-principles-rda-community-effort-0 (includes list of Endorsers)
● CoreTrustSeal: Specialists, Generalists, and Technical Repository Service Providers: https://www.coretrustseal.org/wp-content/uploads/2020/06/CoreTrustSeal-S…
Generalists-TechServiceProviders_v01_00.docx
● Webinar: Update on Specialists, Generalists, and Technical Repository Service Providers Position Paper: https://www.rd-alliance.org/webinar-update-specialists-generalists-and-t…
sitory-service-providers-position-paper
● TRUST Principles Mini Symposium: https://www.rd-alliance.org/trust-principles-mini-symposium-july-7-2020
● Presentation & notes from VP16: https://www.rd-alliance.org/vp16-breakout-session-towards-building-trust…Are you willing to hold your session at multiple times to accommodate various time zones?
NoAvoid conflict with the following group (1)
Domain Repositories IGAvoid conflict with the following group (3)
Libraries for Research Data IGContact for group (email)
dawei.lin@nih.govGroup chair serving as contact person
Dawei LinMeeting objectives
1. Thinking about what the metrics are for measuring the trustworthiness of a repository, following the TRUST principles. The TRUST principles are an aspirational goal for the repository ecosystem, but with more and more repositories saying that they *meet* the principles, what are the more granular metrics for a (any) repository to self-evaluate how it is doing with respect to the TRUST principles? Moreover, although an external body might ultimately evaluate a repository’s performance through a certification that can be mapped back to the TRUST principles, do general metrics derived from the TRUST principles immediately map to certification standards?2. Exploring whether the following groups might be established up the IG:
a. An ‘Engagement Group’ to help the promotion and implementation of the TRUST principles. This might start with a subgroup of the TRUST Principles authors or endorsers to discuss what is needed, but the IG could facilitate the efforts by including some information in presentations where relevant.b. A Working Group to perform a mapping exercise between the TRUST principles and various certification/repository evaluation schema. An open question is the intended audience of such a mapping.
c. There is growing interest in ensuring that generalist repositories are integrated into the Trustworthy Data Repository ecosystem. However, the three main certification standards (CoreTrustSeal, nestorSeal, and ISO 16363) are built upon the OAIS reference model, which is concerned largely with the notion of the Designated Community, and hence the standards are not optimal for the certification of generalist repositories. We will look at current efforts that may help generalist repositories to be recognized as trustworthy, including the latest development on the CoreTrustSeal position paper, and the Data Curation Network—an interesting model of how generalist repositories can get curatorial expertise.Please indicate the breakout slot (s) that would suit your meeting
Breakout 2, Breakout 4, Breakout 5, Breakout 8, Breakout 9Privacy Policy
1
Log in to reply.