Figures
Abstract
Data sharing is highly advocated in the scientific community, with numerous organizations, funding agencies, and journals promoting transparency and collaboration. However, limited research exists on actual data sharing practices. We conducted a comprehensive analysis of the intent to share individual participant data (IPD) in a total of 313,990 studies encompassing clinical trials and observational studies obtained from ClinicalTrials.gov, spanning the period from 2000 to 2023. Our study found that only 10.3% of principal investigators (PIs) expressed intent to share IPD. Clinical trials were more likely to share data than observational studies (odds ratio, OR = 1.98, 95% CI: 1.92–2.04). Large sample size studies were 1.69 times more likely to share data than small ones (95% CI: 1.65–1.73). Studies registered after 2018 were 1.6 times more likely to share data (95% CI: 1.57–1.64) than before 2019. NIH and other US Federal agency-funded studies had 1.49 times higher odds of sharing data (95% CI: 1.43–1.55) than other funders. USA-based studies were 1.53 times more likely to share data (95% CI: 1.49–1.57) than out of USA. Biological trials were 1.58 times more likely to share data than drug and other trials (95% CI: 1.51–1.66). Phase III trials had the highest odds, 2.47 times, of sharing data (95% CI: 2.38–2.56) than non-Phase III trials.
Citation: Chen H, Zhao Y, Cao B, Petersen DJ, Valente MJ, Cen W (2024) Breaking the silence of sharing data in medical research. PLoS ONE 19(5): e0301917. https://doi.org/10.1371/journal.pone.0301917
Editor: Shinya Tsuzuki, National Center for Global Health and Medicine, JAPAN
Received: October 19, 2023; Accepted: March 25, 2024; Published: May 29, 2024
Copyright: © 2024 Chen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Individual Participant Data (IPD) refers to the detailed data collected on individual participants in a research study, such as their demographic information, medical history, treatment interventions, and outcomes. Unlike aggregated data, which summarizes the results at a group-level, IPD allows for more in-depth analyses and individual-level investigations [1].The term IPD sharing refers to the practice of making study data at the individual-level available to researchers who were not part of the original study team. In January 2016, the International Committee of Medical Journal Editors (ICMJE) published a proposal stating that, as a condition of consideration for publication, authors of clinical trials should be required to share deidentified IPD underlying the results presented in their manuscripts within six months of publication. On July 1, 2018, the ICMJE implemented a new policy requiring manuscripts reporting the results of clinical trials to include a data sharing statement. This policy aimed to encourage authors to explicitly address data sharing in their publications [2, 3]. In December 2015, ClinicalTrials.gov added 2 optional registration fields for disclosing trialists’ intentions about IPD sharing: 1) plan to share IPD? and 2) available IPD/information type [4]. ClinicalTrials.gov added additional subfields with greater structure in late June 2017 to facilitate more complete disclosure of IPD-sharing plans as required by the ICMJE [4]. From January 1, 2019, the ICMJE extended its data sharing policy to include a requirement for clinical trials enrolling participants. The policy mandated that trials registering participants must include a data sharing plan in their trial registration [3]. Further, on January 25th, 2023, the National Institutes of Health (NIH) issued a new Data Management and Sharing Policy (DMS) which applies to all research funded or conducted by the NIH that results in the generation of scientific data. The DMS policy requires a DMS plan outlining how scientific data will be shared and compliance achieved [5]. These milestones reflect a growing recognition of and emphasis on the importance of sharing IPD in scientific research. However, despite the increased emphasis on the importance of sharing IPD in scientific research and clear directives to do so, the practice of data sharing from registered clinical trials has not increased commensurate with this goal.
Sharing IPD has several advantages including [1, 3, 4, 6–8]: 1) Sharing IPD allows researchers and the wider scientific community to access, analyze and scrutinize the original data behind research findings. 2) Shared IPD can be used to explore additional research questions beyond those initially investigated in the original studies. 3) IPD sharing facilitates meta-analyses and systematic reviews by providing access to individual-level data across multiple studies. 4) Sharing IPD encourages collaboration among researchers, institutions, and data custodians. 5) IPD pooling from multiple studies can lead to larger sample sizes and increased statistical power, allowing for more robust analyses, and better precision in estimating treatment effects. 6) Shared IPD can contribute to a broader evidence base, allowing healthcare providers and policymakers to make more informed decisions, ultimately leading to improved patient care and better public health outcomes. 7) Sharing IPD aligns with ethical principles of maximizing the value of data collected from research participants. Mello et al [9] reported that few clinical trial participants had strong concerns about the risks associated with data sharing. In fact, most participants expressed their willingness to have their data shared for a variety of uses.
The scientific community is supportive of the practice of data sharing. Many organizations, funding agencies, and journals have recognized the importance of data sharing and have implemented policies and initiatives to promote transparency and collaboration. Numerous papers have addressed and advocated for the sharing of IPD for scientific research [1, 4, 6–18] though data on actual data sharing is limited. There is a lack of comprehensive data regarding the current state of IPD sharing, highlighting the need for further investigation in this area. We conducted a comprehensive analysis of 313,990 studies, including both clinical trials and observational studies, obtained from ClinicalTrials.gov. The study spanned a period from 2000 to 2023.
Methods
ClinicalTrials.gov managed by the US NIH National Library of Medicine (NLM), is currently the largest clinical trial registry globally. Since its launch in 2000, it now encompasses more than 450,000 registered studies, including both interventional and observational studies, conducted across 220 countries [2]. To gather data, we conducted a comprehensive search on ClinicalTrials.gov [2], encompassing all studies registered prior to June 13, 2023, utilizing the Clinical Trials Transformation Initiative (CTTI) Aggregate Analysis of Clinical Trials (AACT). The CTTI AACT website (https://aact.ctti-clinicaltrials.org/snapshots) archives a static copy of the ClinicalTrials.gov database on the first day of each month. We retrieved and downloaded a total of 450,564 studies. The intention regarding IPD sharing is determined by the responses to the question: "Do you plan to share individual participant data (IPD)?" The possible answers to this question include "yes”, “no”, “undecided," or "no response" (answer not provided). ClinicalTrials.gov introduced this IPD question in December 2015 [4], therefore we utilized the IPD variable information for all studies registered or completed after December 2015. All studies that were registered or completed before December 2015 had the opportunity to retrospectively answer this IPD question. Therefore, for studies registered or completed before December 2015 or missing date of registration we only included those of which provided answers of “yes”, “no”, or “undecided” to the IPD sharing question retrospectively and excluded the studies that did not provide a response (answer not provided).
We use the following equation to calculate the rate of agreed to share data rate (R) for studies both registered and completed before December 2015 or missing date of registration: R = n1(yes) / N(total) where N(total) = n1(yes) + n2(no) + n3(undecided). The following equation was used to calculate the R for studies 1) registered after December 2015, and 2) registered before December 2015 and completed after December 2015: R = n1(yes) / N(total) where N(total) = n1(yes) + n2(no) + n3(undecided) + n4(no response).
For each study, we collected various information including details about funders, years, locations, enrollment (sample size), classification as a clinical trial or an observational study. We categorized them as follows: "NIH/US Fed": If the study listed at least one NIH institute or center, or any other US Federal agency, as the sponsor. "Industry": If the study was not classified as NIH/US Fed, but listed at least one company as the lead sponsor or collaborator. "All others": If the study was funded by individuals, universities, community-based organizations, or foundations. For clinical trials specifically, we obtained additional information such as the phase of the trial (ranging from phase I to phase IV), the primary purpose of the treatment, and details about the interventions used. The classification of clinical trial phases from phase I to phase IV was based on Food and Drug Administration (FDA) guidelines and definitions provided in the ClinicalTrials.gov glossary of common site terms.
To analyze the data, we calculated the overall rates and sample sizes for the four response options (yes, no, undecided, or no response) to the IPD sharing question. We also examined these rates within various subgroups, including clinical trials vs. observational studies, funders, years, interventions, and phases. To determine significant differences in rates, we employed chi-square tests. Additionally, we conducted trend tests to assess rate changes over time. Furthermore, logistic regression models were utilized to examine associations between the agreement to share IPD and relevant factors. These models allowed us to assess the relationships between "agreed to share IPD" and various factors of interest. Odds ratios were estimated from logistic regression models.
Results
313,990 studies registered from ClinicalTrials.gov
We conducted a comprehensive analysis of the intent to share IPD in a total of 313,990 studies encompassing clinical trials and observational studies obtained from ClinicalTrials.gov, with the majority of the studies spanning the period from 2000 to 2023. There were 12,626 studies that initially registered and completed prior to December 2015, when specifying a data sharing plan was not possible, that retrospectively answered ‘Yes’, ‘No’ or ‘Undecided’ to the question about an IPD data sharing plan. A total of 3,622 (28.7%) studies answered ‘Yes’, 7,451 (59.0%) answered ‘No’ and 1,553 (12.3%) answered ‘Undecided’. A total of 32,210 PIs (10.3%) indicated their intention to share IPD. Of the analyzed studies, 237,147 (75.5%) were classified as clinical trials, while 76,835 (24.5%) were categorized as observational studies. Among the clinical trials, a total of 27,232 PIs (11.5%) indicated their intention to share IPD. In the case of observational studies, 4,978 PIs (6.5%) expressed a positive inclination to share IPD. Regarding sponsorship, the rates of PIs indicating an intent to share IPD were 17% for studies sponsored by the NIH/other US Federal agencies, and 15% for studies sponsored by industry, and 8% for studies sponsored by Other. Regarding location, 14% of PIs in the United States (US) indicated an intent to share data compared to 8.3% for studies conducted outside the US. Additionally, we investigated the rates of "yes" responses based on the registered years of the studies. The rates varied, with a range of 7.7% to 14% for studies registered between 2016 and 2023. In the context of clinical trials, we observed differing rates of "yes" responses based on the trial characteristics (see Table 1 and Fig 1).
Overall, these findings provide a comprehensive overview of the extent of intent to share IPD across a vast number of studies, highlighting variations based on study characteristics and other influencing factors.
Factors related to sharing IPD
Table 2 illustrates the relationship between these factors and the willingness to share IPD. The following factors were found to be significantly associated with the likelihood of sharing data: study types, sample sizes, funders, registration years, locations, interventions, and trial phases. Clinical trials had significantly higher odds of sharing data compared to observational studies, with an odds ratio (OR) of 1.98 (95% confidence interval [CI]: 1.92–2.04). This indicates that the odds of sharing data in clinical trials were about twice as high as in observational studies. Studies with large sample sizes had 1.69 times higher odds of sharing data compared to those with small sample sizes (OR = 1.69, 95% CI: 1.65–1.73). Similarly, studies registered after 2018 had 1.6 times higher odds of sharing data compared to studies registered before 2019 (OR = 1.60, 95% CI: 1.57–1.64). Furthermore, studies funded by the NIH and other US Federal agencies had 1.49 times higher odds of sharing data compared to studies funded by other sources (OR = 1.49, 95% CI: 1.43–1.55). Studies conducted in the US had 1.53 times higher odds of sharing data compared to studies conducted outside of the US (OR = 1.53, 95% CI: 1.49–1.57). Additionally, biological trials had 1.58 times higher odds of sharing data compared to drug and other trials (OR = 1.58, 95% CI: 1.51–1.66). Phase III trials had 2.47 times higher odds of sharing data compared to trials in other phases (OR = 2.47, 95% CI: 2.38–2.56).
Discussion
The intention of authors to share data does not always align with their actual data sharing practices, as noted by Watson [19, 20]. Gabelica et al. [21] conducted a comprehensive study involving 1,792 peer-reviewed publications in which authors expressed their willingness to share data upon reasonable request. Surprisingly, 93.1% (n = 1669) of the corresponding authors either declined or did not respond to requests for raw data, and only 6.9% (n = 123) provided the data in a usable format. It seems that data-availability statements are of little value because many of the data sets are never actually made accessible. It is important to acknowledge that the rate of agreement to share data should ideally be higher for publications compared to registrations as authors are required to make a commitment to data sharing to publish research papers.
The U.S. government has made efforts to encourage companies, universities, and other institutions conducting clinical trials to record and report their results in a federal database. However, compliance with this requirement has been inconsistent, even after a 2007 law made it mandatory for registered trials. Many sponsors still choose to ignore the reporting requirement, while federal officials have done little to enforce the law [22, 23]. Given this lack of compliance with reporting trial results, it becomes increasingly challenging to expect these same organizations to willingly share their IPD. In 2022, Sim et al [24]. proposed that the NIH should take a leading role in promoting scientific data sharing, particularly focusing on clinical trial data sharing. NIH’s recent DSM policy (effective January 25th, 2023) marks a big step toward open data practices as NIH is the largest funder of biomedical research in the world.
Given the myriad justifications in support of data sharing, it is time for the scientific community to hold itself accountable and take deliberate steps to rectify this unacceptable situation. Statements of intentions are not enough; PIs, as a condition of registering clinical trials and observational studies should be required to commit to sharing IPD and to describe specifically how and when they intend to do so. Editors should hold authors accountable by requiring them to include the same information in all accepted manuscripts, providing direct access for other scientists to the de-identified IPD reported in the publication. As scientists in the field of health, we have a responsibility to create efficiencies that can accelerate the discovery and sharing of knowledge for the benefit of patients and communities. As a society, we have neither the time nor the money to squander the precious resource of already gathered data in pursuit of improvements in the quality of life for everyone.
While sharing data undoubtedly promotes transparency and collaboration in scientific research, it also raises several important considerations. One such concern is the protection of participant privacy and confidentiality, particularly in sensitive research areas. Additionally, there may be challenges in ensuring the accuracy and integrity of shared data, as well as concerns regarding appropriate attribution and recognition for the original researchers. Addressing these potential concerns is crucial for establishing responsible data sharing practices and fostering trust within the scientific community.
This study has several limitations. First, we lack information regarding the reasons why IPD were not shared, as such data is not available. Second, not all registered studies are completed or carried out to fruition, rendering the initial intention to share IPD less significant. Third, ClinicalTrials.gov introduced the IPD question in December 2015. Studies registered or completed before this date had the opportunity to retrospectively answer the IPD question. Consequently, our analyses only included studies that provided retrospective responses of ’yes’, ’no’, or ’undecided’ to the IPD sharing question, while excluding those that did not respond (answer not provided). This may result in an overestimation of the rate of expressed intent to share IPD.
It is important to note that the IPD question within ClinicalTrials.gov is not a mandatory item. As a result, many trialists choose to provide no response (answer not provided). We recommend that this question be made mandatory. Additionally, we suggest that the IPD question should be modified to offer only two response options (yes or no), removing the "undecided" choice, and requiring a justification for a refusal to share data. These modifications would facilitate clearer reporting and assessment of the intent to share IPD.
References
- 1.
Committee on Strategies for Responsible Sharing of Clinical Trial Data, Board on Health Sciences Policy, Institute of Medicine. Sharing clinical trial data: Maximizing benefits, minimizing risk. Washington (DC): National Academies Press (US); 2015. https://www.ncbi.nlm.nih.gov/books/NBK269030/.
- 2.
U.S. National Library of Medicine, National Institutes of Health. https://clinicaltrials.gov/.
- 3.
ICMJE. 2023. https://www.icmje.org/.
- 4. Bergeris A, Tse T, Zarin DA. Trialists’ intent to share individual participant data as disclosed at ClinicalTrials.gov. JAMA, 2018;319(4):406–8. pmid:29362784
- 5.
National Institutes of Health. Data Management & Sharing Policy Overview. 2023. https://sharing.nih.gov/data-management-and-sharing-policy/about-data-management-and-sharing-policies/data-management-and-sharing-policy-overview.
- 6. Nosek BA, Alter G, Banks GC, et al. Promoting an open research culture. Science 2015;348(6242):1422–5.
- 7. Sabatello M, Martschenko DO, Cho MK, Brothers KB. Data sharing and community-engaged research. Science 2022;378(6616):141–3. pmid:36227983
- 8. Longo DL, Drazen JM. Data Sharing. N Engl J Med 2016;374(3):276–7. pmid:26789876
- 9. Mello MM, Lieou V, Goodman SN. Clinical Trial Participants’ Views of the Risks and Benefits of Data Sharing. N Engl J Med 2018;378(23):2202–11. pmid:29874542
- 10. Krumholz HM, Peterson ED. Open access to clinical trials data. JAMA, 2014;312(10):1002–1003. pmid:25203080
- 11. Taichman DB, Sahni P, Pinborg A. et al., Data sharing statements for clinical trials: A requirement of the international committee of medical journal editors. Annals of internal medicine, 2017, Vol.167 (1), p.63–65. pmid:28586790
- 12. Bauchner H, Fontanarosa PB. The challenges of sharing data in an era of politicized science. JAMA, 2019; 322(23):2290–2291. pmid:31750859
- 13. Drazen JM, Morrissey S, Malina D, Hamel MB, Campion EW. The Importance—and the Complexities—of Data Sharing. N Engl J Med 2016;375(12):1182–3. pmid:27653569
- 14. Packer M. Data sharing in medical research. BMJ 2018; 360: k510 pmid:29444885
- 15. Abbasi K. A commitment to act on data sharing. BMJ 2023;382:p1609.
- 16. Locher C, Goff GL, Louarn Al, et al., Making data sharing the norm in medical research. BMJ 2023;382:p1434. pmid:37433610
- 17. Bauchner H, McDermott M, Butte AJ. Data Sharing Enters a New Era. Annals of internal medicine, 2023;176 (3): p 400–401. pmid:36848652
- 18. Marsolo KA, Weinfurt KP, Staman KL, et al., Moving From Idealism to Realism With Data Sharing. Annals of internal medicine. 2023;176 (3): p 402–403. pmid:36716450
- 19. Watson C. Many researchers say they’ll share data—but don’t. Nature 2022;606(7916):853. pmid:35725829
- 20. Hamilton DG, Hong K, Fraser H, et al., Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. BMJ 2023;382:e075767. pmid:37433624
- 21. Gabelica M, Bojčić R, Puljak L. Many researchers were not compliant with their published data sharing statement: a mixed-methods study. J Clin Epidemiol 2022;150:33–41. pmid:35654271
- 22. Piller Charles. FDA and NIH let clinical trial sponsors keep results secret, investigation shows. Science 2020.
- 23. DeVito NJ, Bacon S, Goldacre B. Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study. Lancet 2020; 395: 361–69. pmid:31958402
- 24. Sim I, Stebbins M, Bierer BE, et al. Time for NIH to lead on data sharing. Science 2020;367(6484):1308–9. pmid:32193313