Thanks for that question to the group Lauren,
I wanted to just introduce our group of reproducibility AI-tool makers to
the IG.
https://scicrunch.org/ASWG
We each have a tool or are working towards one that detects/flags some
aspect of reproducibility. Some of these tools are commercial while some
are lab-made and some are more commonly used or have a published paper,
while others don’t. They were all independently created and different
assumptions were made when they were created. We have used 8 of these tools
in a single pipeline to score COVID preprints during the pandemic (
https://www.nature.com/articles/s41591-020-01203-7 ).
The tools (and humans associated) currently participating are as follows (
link
):
Resource NameProper CitationAbbreviationsResource Type
DescriptionKeywords Resource
Relationships
SciScore
Resource
Report
Resource Website
1+
mentions
SciScore (RRID:SCR_016251) web application, software resource, software
application, text-mining software Text-mining software that reviews methods
sections of scientific articles. It provides a numerical score to represent
the “reproducibility” of the article’s research. mine, text, method,
journal, paper, article, research, science, biomedicine, neuroscience,
scicrunch, nif, ASWG is related to: SciCrunch
JetFighter
Resource
Report
Resource Website JetFighter
(RRID:SCR_018498) service resource, web application, software resource,
production service resource, analysis service resource Web tool that
automatically screens bioRxiv preprints for rainbow colormaps, which are
not colorblind safe. Emails authors information on replacing these
colormaps with colorblind safe altern …[more]
bioRxiv
preprint screening, ranbow colormap, colorblind safe, replacing colormap,
improve data, improve picture, ASWG has parent organization: California
Institute of Technology
Barzooka
Resource
Report
Resource Website Barzooka
(RRID:SCR_018508) service resource, algorithm resource, software resource,
production service resource, analysis service resource Software automated
screening tool that detects bar graphs of continuous data in preprints
submitted to bioRxiv. Used for detection of bar graphs for continuous data
in BioRxiv preprints. Bar graph detection, continuous data, preprint,
bioRxiv, bar graph, ASWG
rSPRITE
Resource
Report
Resource Website rSPRITE
(RRID:SCR_018524) web service, software resource, data access protocol,
service resource Web app to generate possible distributions of data
matching given mean, SD, sample size, and range. Used for recovering data
from summary statistics. Implementation of SPRITE in R programming …[more]
data
distribution generation, data matching, recovering data, summary statistics
data, ASWG is related to: Shiny
is related to: RStudio
Trial Registration Number screener
Resource
Report
Resource Website Trial
Registration Number screener (RRID:SCR_019211) TRNscreener data analysis
software, software application, data processing software, software
resource Software
tool as R script to provide function that takes two arguments: path to
folder of plain text files named by their DOI, and output filename. For
each file in folder, it searches for tr …[more]
ClinicalTrials.gov,
plain text files, DOI named, output filename, trial identifiers searches,
regex matching, trial registration numbers, ASWG has parent
organization: Charite
– Universitatsmedizin Berlin; Berlin; Germany
ODDPub
Resource
Report
Resource Website
1+
mentions
ODDPub (RRID:SCR_018385) software resource, algorithm resource Text
mining algorithm to screen biomedical publications to find data sharing
statements. Algorithm that parses set of publications and detects which
publications disseminated Open Data or Ope …[more]
Text
mining, biomedical publication screening, data sharing statement detection,
open data, open code, publication, data, biomedical literature, Berlin
Institute of Health, ASWG is used by: rtransparent
rtransparent
Resource
Report
Resource Website
1+
mentions
rtransparent (RRID:SCR_019276) software resource An R package that
automatically identifies and extracts indicators of transparency (data
availability, code availability, statements of conflicts of interest,
statements of funding, statement …[more]
ASWG uses: ODDPub
uses: R Project for Statistical Computing
Hypothes.is
Resource
Report
Resource Website
1+
mentions
Hypothes.is (RRID:SCR_000430) Hypothes.is software resource Non-profit
organization working towards developing an open platform for the
collaborative evaluation of knowledge. It will combine sentence-level
critique with community peer-review to provid …[more]
annotation,
evaluation, annotation standard, standard specification, peer review, ASWG is
listed by: FORCE11
has plug in: SciBot
Resource Identification Portal
Resource
Report
Resource Website
10+
mentions
Resource Identification Portal (RRID:SCR_004098) RII Portal portal, data
or information resource Portal providing identifiers for Antibodies, Model
Organisms, and Tools (software, databases, services) created in support of
the Resource Identification Initiative, which aims to promote res …[more]
antibody,
organism, service resource, software resource, database, resource,
identifier, citation, biomedical, publication, research resource
identifier, rrid, ASWG uses: Antibody Registry
uses: SciCrunch Registry
uses: Mouse Genome Informatics (MGI)
uses: Zebrafish Information Network (ZFIN)
uses: Rat Genome Database (RGD)
uses: WormBase
uses: FlyBase
recommen …[more]
scite
Resource
Report
Resource Website scite (RRID:SCR_018568) service
resource, software application, software resource, text extraction
software, data or information resource Web tool to classify citation
statements from scientific articles using deep learning. Used for
discovering and evaluating scientific articles via Smart Citations. Classify
citation statement, context, text extraction, deep learning, citation
context, cited claim evidence, ASWG
Seek and Blastn
Resource
Report
Resource Website Seek and Blastn
(RRID:SCR_016625) service resource, software resource, data access
protocol, data analysis service, production service resource, analysis
service resource, web service Web server as semi automated tool that
identifies nucleotide sequences in scientific publications, determines
whether they are correctly identified. Seeks for nucleotide sequences in
pdf file …[more]
Nucleotide
sequence identification, text mining, text analysis, scientific
publication, error identification, ASWG works with: BLASTN
Limitation-Recognizer
Resource
Report
Resource Website
Limitation-Recognizer
(RRID:SCR_018747) data analysis software, software application, data
processing software, software resource Software tool to recognize self
acknowledged limitation sentences in biomedical articles. Automatic
recognition of self acknowledged limitations in clinical research
literature to support eff …[more]
ASWG,
automatic recognition, self acknowledged limitation, clinical research
literature, research transparency, limitation sentence recognition
uses: Stanford
CoreNLP
has parent organization: University of Illinois at Urbana-Champaign;
Illinois; USA
Open Science Chain
Resource
Report
Resource Website
1+
mentions
Open Science Chain (RRID:SCR_018773) OSC software application, software
resource, data or information resource, portal, data processing
software Provides
data integrity using blockchain. Used for protecting integrity and
provenance of research data.Open science chain utilizes distributed ledger
technology (consortium blockchain) to se …[more]
ASWG,
data integrity, research data, authenticity, data integrity protection,
data protection, data verification has parent organization: University of
California at San Diego; California; USA
scidetect
Resource
Report
Resource
Website scidetect (RRID:SCR_020931) software resource, software
application, text-mining software Software tool for detecting automatically
generated academic papers. Discovers text that has been generated with
SCIgen and other fake paper generators like Mathgen and Physgen. Provides
on o …[more]
ASWG,
academic paper detecting, automatically generated, academic papers, scigen
detector version
On Tue, Feb 6, 2024 at 6:58 AM lauren-cambridge via Reproducibility IG <
***@***.***-groups.org> wrote:
