Reproducibility of COVID-19 pre-prints

• DOI: 10.1007/s11192-022-04418-2
• Publication Date: 2022-07-04T16:03:08Z
• Authors: Annie Collins; Rohan Alexander
• Keywords: FOS: Computer and information sciences; 0301 basic medicine; Physics - Physics and Society; FOS: Physical sciences; Computer Science - Digital Libraries; Physics and Society (physics.soc-ph); Statistics - Applications; Article; 3. Good health; Computer Science - Computers and Society; 03 medical and health sciences; Computers and Society (cs.CY); Applications (stat.AP); Digital Libraries (cs.DL)

AbstractTo examine the reproducibility of COVID-19 research, we create a dataset of pre-prints posted to arXiv, bioRxiv, and medRxiv between 28 January 2020 and 30 June 2021 that are related to COVID-19. We extract the text from these pre-prints and parse them looking for keyword markers signaling the availability of the data and code underpinning the pre-print. For the pre-prints that are in our sample, we are unable to find markers of either open data or open code for 75% of those on arXiv, 67% of those on bioRxiv, and 79% of those on medRxiv.