Lack of transparency in clinical trial conduct, publication bias and selective reporting bias are still important problems in medical research. Through clinical trials registration, it should be possible to take steps towards resolving some of these problems. However, previous evaluations of registered records of clinical trials have shown that registered information is often incomplete and non-meaningful. If these studies are accurate, this negates the possible benefits of registration of clinical trials.
Methods and Findings
A 5% sample of records of clinical trials that were registered between 17 June 2008 and 17 June 2009 was taken from the International Clinical Trials Registry Platform (ICTRP) database and assessed for the presence of contact information, the presence of intervention specifics in drug trials and the quality of primary and secondary outcome reporting. 731 records were included. More than half of the records were registered after recruitment of the first participant. The name of a contact person was available in 94.4% of records from non-industry funded trials and 53.7% of records from industry funded trials. Either an email address or a phone number was present in 76.5% of non-industry funded trial records and in 56.5% of industry funded trial records. Although a drug name or company serial number was almost always provided, other drug intervention specifics were often omitted from registration. Of 3643 reported outcomes, 34.9% were specific measures with a meaningful time frame.
Clinical trials registration has the potential to contribute substantially to improving clinical trial transparency and reducing publication bias and selective reporting. These potential benefits are currently undermined by deficiencies in the provision of information in key areas of registered records.
Citation: Viergever RF, Ghersi D (2011) The Quality of Registration of Clinical Trials. PLoS ONE6(2): e14701. https://doi.org/10.1371/journal.pone.0014701
Editor: Roberta W. Scherer, Johns Hopkins Bloomberg School of Public Health, United States of America
Received: July 26, 2010; Accepted: January 21, 2011; Published: February 24, 2011
Copyright: © 2011 World Health Organization; licensee Public Library of Science (PLoS). This is an Open Access article in the spirit of the Public Library of Science (PLoS) principles for Open Access http://www.plos.org/oa/, without any waiver of WHO‚s privileges and immunities under international law, convention, or agreement. This article should not be reproduced for use in association with the promotion of commercial products, services or any legal entity. There should be no suggestion that WHO endorses any specific organisation or products. The use of the WHO logo is not permitted. This notice should be preserved along with the article‚s original URL.
Funding: No direct funding was received for this study. The authors were personally salaried by their institutions during the period of writing (though no specific salary was set aside or given for the writing of this paper). No funding bodies had any role in the study design, data collection, analysis, decision to publish or preparation of the manuscript.
Competing interests: DG is the Team Leader of the International Clinical Trial Registry Platform (ICTRP) of the World Health Organization. RV has no conflict of interest to report. This does not alter the authors' adherence to all the PLoS ONE policies on sharing data and materials.
Many instances of unethical research conduct by clinical trial sponsors and investigators have come to light over the past decade. The types of misconduct vary and include not obtaining approval from research ethics committees, not obtaining informed consent from trial participants and the fabrication of data –. Despite the ethical obligation to accurately report the results of research in humans , some trial sponsors have deliberately withheld negative outcome information when publishing the findings of clinical trials, and when making the trial findings available to regulatory authorities –. Such behaviour is particularly concerning when the misconduct involves trials recruiting participants in low and middle income countries with deficient oversight mechanisms .
Prospectively registering clinical trials can potentially prevent at least some of this misconduct from occurring, specifically selective reporting, by putting key protocol information about each trial in the public domain, ideally before the first participant is recruited to the study. Five years have now passed since the International Committee of Medical Journal Editors (ICMJE) first published its statement requiring registration as a precondition of publication , and the World Health Assembly approved the establishment of the International Clinical Trials Registry Platform (ICTRP) by the World Health Organization (WHO). Today the ICTRP provides free access via a single web portal to more than 120,000 records of registered trials made available by clinical trial registries around the world . In the intervening years the number of countries and agencies that have created and implemented their own policies on trial registration has increased, including the World Medical Association which now explicitly states in the Declaration of Helsinki that prospective registration is an ethical requirement , –.
Prospective registration can only contribute to the more ethical conduct of clinical trials however, if all of the key information about the trial is registered, and the registered data are meaningful. The ICMJE agrees that quality is important and states that missing or uninformative entries in any of the fields required by the WHO 20-item Trial Registration Data Set is inadequate , . The quality of registered data has been called into question of late, with particular concerns regarding the quality of contact information –, intervention details, , – and the outcomes (and outcome measures) being used , , –. Poor data quality raises doubt on the ability of trial registration to meet the challenge of achieving research transparency, including the ability to adequately address publication bias and selective reporting, and reducing the amount of wasted research –.
The objective of this study was therefore to determine whether registered records of clinical trials contained complete and meaningful data for key items in the WHO Trial Registration Data Set . Given the particular concern regarding the quality of contact information, intervention details, and outcome information, it was agreed that these data items would be the focus of the study.
A random 5% sample of all clinical trial records of trials registered as interventional between 17 June 2008 and 17 June 2009 was taken from the ICTRP database. Records of trials that were registered as observational, records that pertained to US Food and Drug Administration (FDA) lockbox device trials  and records that were duplicate records (due to registration of a trial in more than one register) were not eligible for the sample . For trials with multiple records the record with the earliest registration date was considered eligible. At the time the sample was taken the database included trials registered in nine different registries.
About the data
The ICTRP Search Portal imports the WHO Trial Registration Data Set from registries that meet WHO criteria, including ClinicalTrials.gov. As the format of each data item differs across registries, data is currently imported into the portal as text. The ICTRP publishes a hyperlink to the record in the source registry (i.e. the registry that provided the data) so users can view additional information, if required.
Registry name, trial ID, target sample size, recruitment status, date of registration, date of first enrolment and the public and scientific title for each record were downloaded from the ICTRP database and imported into Excel on 17 June 2009.
During manual searching of records, it became clear that several records of trials that were registered as interventional were in fact records of observational trials, diagnostic accuracy trials or treatment protocols for continuation of treatment after inclusion in a study protocol. These records were excluded from further data extraction.
Descriptive information on study phase, study design, randomization status and inclusion criteria for gender and age of participants was extracted manually from the complete registered record in the source registry. Data on interventions and sponsorship was also extracted manually and was then coded. The system used to code interventions was adapted from the codes used for intervention types on ClinicalTrials.gov . Primary sponsors were coded as being foundation, government, industry, university/hospital, or other. Trials were coded as being industry funded (primary sponsor was industry), partially industry funded (primary sponsor was non-industry, but secondary sponsor or source of monetary or material support was industry) or non-industry funded.
The presence or absence of the following contact details was evaluated: name of a contact person (investigator or other), email address and telephone number. The WHO 20-item Trial Registration Data Set requires registration of separate scientific and public contact details . There was however variation in registration formats for contact details between different registries. Some registries had one field for contact details, others had two separate fields for public and scientific contact details and others multiple contact fields. For records with only one contact field the presence of contact information was extracted from that field. For records with multiple contact fields, if the contact details were present in any of the fields, the information was denoted to be present.
Given the considerable variability in the types of interventions evaluated in trials, comparison of registration quality between different intervention categories is difficult. It was therefore decided to limit the evaluation of the quality of registered intervention data to trials that investigated drugs, biologicals or vaccines, including active comparators. Placebo comparators were not evaluated. For each intervention and active comparator the presence or absence of the following five intervention specifics was collected: name, dose, duration of the intervention, frequency of administration and route of administration. All intervention arms were assessed separately. Name was denoted to be present if a company serial number or a drug name was provided. Only interventions and active comparators mentioned in the intervention field were assessed. Other texts in the record were scanned for additional information on mentioned interventions.
The number of primary and secondary outcomes per record was collected. Each primary and secondary outcome was evaluated for specificity, using a classification system adapted from the system used by Zarin et al in their assessment of quality of outcomes . If a record contained multiple outcomes, all were assessed separately. Outcomes were classified as being a specific measure, a domain, vague, an unexplained abbreviation, or a part of safety monitoring.
Besides assessing the specificity of each outcome, the presence or absence of a time frame was collected for every outcome. Some outcomes assessed the duration of an event, the time to an event or were safety monitoring outcomes. For these outcomes, reporting a time frame is not possible, and the timeframe was therefore denoted as irrelevant. Time frames were denoted to be not meaningful when they did not specify a point in time when the outcome was to be measured.
Only outcomes mentioned in the outcome fields were assessed. Other texts in the record were scanned for additional information on mentioned outcomes.
Before starting data extraction a small pilot project was carried out on 25 random records from the ICTRP database to test the assessment framework. Results of the pilot were discussed by DG and RV and the framework was subsequently adapted.
All records were assessed for eligibility by RV who then extracted and coded the data. During eligibility assessment and data extraction trial records that were not covered by the framework, or where that was ambiguous, were further assessed by DG. Conflicts were resolved by mutual agreement.
A more detailed overview of the rules used in all assessments is provided in supporting information file S1.
Odds ratios and Pearson's chi-squares were calculated to assess the relationship between sources of funding and the presence of contact details. For this purpose, partially industry funded trials and non-industry funded trials were grouped together.
Completeness of registration of intervention specifics was analysed according to funding source and trial phase. A binary outcome variable was used that could be incomplete versus complete registration of the intervention. Complete registration entailed the reporting of drug name, dose, duration, frequency and route. Funding source was categorized as in the analysis of contact details. Trial phase was categorized to be Phase 0 or I versus other (some trials were registered as being Phase I & II; these were categorized as other). Regression analysis with robust estimation of variance for clustered samples was used to assess whether these variables influenced completeness of registration of intervention specifics .
Quality of registration of primary outcomes was analysed according to funding source, sample size category, trial phase and intervention category. A binary outcome variable was used that could be registration of a specific measure with a meaningful time frame present or for which a time frame was irrelevant, versus any other outcome. Funding source was categorized as in the analysis of contact details. Trial phase was categorized as in the analysis of intervention specifics. Sample size was categorized as being <100 participants versus 100 or more participants. Interventions were categorized to being either drug, biological or vaccine versus other interventions. Regression analysis with robust estimation of variance for clustered samples was used to assess whether these variables influenced the quality of registration of primary outcomes .
Statistical analyses were performed using SPSS version 15.0.1 and STATA version 11.1.
There were 754 records in our 5% sample. One record was withdrawn by the registry and could not be assessed. 22 records were excluded from data extraction because the corresponding trials were of an observational or diagnostic accuracy study design or were a treatment protocol for continuation of treatment after inclusion in a study protocol. A total of 731 records were included for data extraction, of which 439 investigated drugs, biologicals or vaccines (Figure 1).
All information that had to be extracted manually from the registered records was collected between 17 June 2009 and 11 August 2009. Baseline data on registry name, primary sponsor category, intervention type, study phase, study design, randomization status and inclusion criteria for gender of participants are presented in Table 1.
Records were additionally checked for the presence of entries in the fields for recruitment status, date of first enrolment and the public and scientific title. The former three were present in all records, the latter was reported in 700 records (95.8%). Furthermore, information was collected on sample size and age of participants. Sample size was reported in 721 records (98.6%). The median target sample size for these records was 68 [IQR 30–200]. Age of participants was reported in 700 records (95.8%). 89 records (12.2%) mentioned inclusion of participants <18 years of age. Finally, registration dates and dates of first enrolment were compared. The majority of records in our sample did not provide a day for the date of first enrolment but only a month and a year, which limited this analysis to comparing the month in which trials were registered to the month in which the first participant was recruited. The registration date was in a later month than the date of first enrolment in 53.4% of records (median: 10 months). This difference was more than one month in 43.6% of records. Registration date and date of first enrolment were in the same month in 20.7% of records. The registration date was in an earlier month than the date of first enrolment in 26.0% of records (median: 2 months).
Quality of registration of contact information
Overall, 81.0% of records reported a name of a contact person (n = 592). 59.4% of records provided an email address (n = 434) and 64.2% of records a telephone number (n = 469). 68.7% of records provided either an email address or a telephone number (Table 2).
Industry funded trials were less likely to mention a name in their registered records than partially industry funded trials or non-industry funded trials (OR = 15.9, 95% CI: 9.9–25.5, p<0.001). Industry funded trials were also less likely to mention an email address in their registered records (OR = 3.6, 95% CI: 2.6–4.9, p<0.001) or to mention a telephone number (OR = 3.1, 95% CI: 2.2–4.2, p<0.001). There were no differences in the presence of contact details between partially industry funded trials and non-industry funded trials (p = 0.28, p = 0.18 and p = 0.13 respectively).
Quality of registration of interventions involving drugs, biological or vaccines
There were 439 records of trials that investigated drugs, biologicals or vaccines. Intervention specifics were recorded for 726 experimental or active comparator arms. A name was reported in 713 arms (98.2%). For dose, duration of the intervention, frequency of administration and route of administration, information was present in 512 (70.5%), 508 (70.0%), 550 (75.8%) and 535 (73.7%) arms respectively. 321 arms (44.2%) were complete in registering intervention specifics.
Multiple logistic regression analysis showed that funding source was not a significant predictor of completeness of registration of intervention specifics (p = 0.39), but that study phase was (p<0.001). Additional univariate analyses were performed, which confirmed that funding source was not a significant predictor of intervention registration quality (p = 0.34) and that trials that were Phase 0 or I were more likely to be complete in reporting intervention specifics than other trials (OR = 2.7, 95% CI: 1.5–4.9, p<0.001).
Quality of registration of outcome measures
The 731 included trial records reported 1271 primary outcomes and 2372 secondary outcomes. 66.2% of records reported one primary outcome, 17.5% reported two, 6.0% reported three and 9.2% reported four or more. The maximum number of primary outcomes reported in one record was 24. Eight records (1.1%) reported no primary outcome at all, and 149 records reported no secondary outcomes (20.4%).
The degree of specificity of reported outcomes was assessed (Table 3). 38.2% of primary outcomes, 33.2% of secondary outcomes and 34.9% of primary and secondary outcomes combined were specific measures, for which a time frame was irrelevant or for which a meaningful time frame was present.
Multiple logistic regression analysis showed that funding source (p = 0.30), target sample size (p = 0.93), intervention category (p = 0.39) and study phase (p = 0.70) were all not significant as predictors for the reporting of specific measures with a meaningful time frame present (or irrelevant). Additional univariate analyses were performed, which confirmed that none of the dependent variables were significant predictors of outcome registration quality (p = 0.24, p = 0.33, p = 0.49 and p = 0.46 respectively).
To be able to fulfil the promise of clinical trials registration, it is of paramount importance that registration is comprehensive, complete and accurate. That is, that all trials in all countries are registered, that meaningful data are registered for every item in the WHO Trial Registration Data Set , and that registered data are correct and up-to-date. This study confirms the findings of similar studies that have shown that the quality of registered trial data is a significant problem and that it needs to be improved.
There should be clearly assigned responsibility to a named Principal Investigator in all registered records of clinical trials to facilitate investigator accountability and transparency . By Principal Investigator (PI) we mean “the individual who is responsible and accountable for conducting the clinical trial” . In 2008 Sekeres et al examined 1388 clinical trial register entries and found that all 440 registered trial records with recruitment status “in progress” that were either non- or partially funded by industry named the scientific leadership of the trial, compared with 49% (111/226) of those funded by industry; findings confirmed by the current study.
There are well-established ethical, scientific and legal obligations associated with being a clinical trial investigator. International research standards such as the International Conference on Harmonization (ICH) Topic E6 require investigators to have appropriate qualifications and experience, to ensure compliance with the trial protocol, to obtain and document informed consent, and to be responsible for the medical care of trial subjects and for the integrity of the research data and results . Although key international standards (ICH E6, Declaration of Helsinki) do not specifically require trials to have named scientific leadership, it seems reasonable to ask for them to be publicly named and accountable for the trials onto which they recruit participants, considering their responsibilities both to the participants they recruit, and to future patients who may benefit from the results of the study . Similarly, it is important that investigators be contactable should the publication of the results of their research be delayed (or not achieved, despite increasing public and legal pressure to do so), to enable the results of studies to be made available to investigators of similar studies and meta-analysts . The PI is also ultimately responsible for registering the trial and hence for the quality of the registered data. Some of the problems identified with the quality of registered data may therefore be solved by having a named PI in the registry record.
Arguably the two most important pieces of information about a clinical trial that need to be registered are the description of the interventions being compared, and the outcomes upon which any conclusion about the safety and effectiveness of the interventions will be made. As demonstrated by this and previous studies, the quality of this information, as it has been registered to date, has been poor , –.
In 2005, nine to ten percent of registered trial records on ClinicalTrials.gov provided an incomplete or nonspecific description of the intervention name , . Although subsequent studies suggest that this has improved to less than two or three percent , , , more information is required about the intervention than the name. There should also be a description that is detailed enough for it to be possible to distinguish between the arms of the study. For trials of drugs, biologicals and vaccines this means information on the dose, frequency, route of administration and duration of treatment , . In the current study less than half of the intervention arms where this information was relevant provided it. That there is room for improvement is confirmed by the fact that records of some trials (Phase 0 and I) describe interventions in greater detail, perhaps due to a greater focus on the specifics of the intervention in these trials.
Similarly, more is required when registering trial outcomes than the name. To be complete the record should contain the name of the outcome, information on the instrument that is being used to measure it (when applicable), and the time points at which it will be measured. Primary outcomes with a specific measure and a meaningful time frame were registered in only 31% of records evaluated by Zarin et al in 2005, and in 38% of records in the current study . Given the critical importance of the primary outcome to the scientific integrity of the study it is of enormous concern that this key information is still not being made public in a way that is meaningful or informative. Since the primary outcome is the one that the study should be designed to evaluate, and hence used to calculate the sample size, it is also concerning that so many trials claim to have multiple primary outcomes with almost one in ten trials claiming four or more. The combined problem of multiple primary outcomes, lack of specification of the instrument being used to measure the outcome, and non-reporting of time frames leaves the door open for fishing expeditions and will not solve the problem of selective reporting bias.
The trial records in this study were registered between June 2008 and June 2009 on any one of the nine registries that provided data to the ICTRP Search Portal, including ClinicalTrials.gov. Although the latter is the most established and clearly the largest registry, 14% of the records in this study were provided by the other registries. As more countries seek to improve the transparency of clinical trial research involving nationals of that country, to be more accountable to the individuals who consent to participate in clinical research, to better oversee and monitor that research, and to make information accessible in the languages spoken by the nationals of each country, it is inevitable that the number of trial registries will increase . Since the start of this study, the number of registries that provide data to the ICTRP has already risen from nine to twelve.
Prospective registration is defined by the ICMJE and WHO as registration of a clinical trial before recruitment of the first participant. Even allowing amnesty for trials registered in compliance with national laws (such as the Food and Drug Administration Amendments Act in the US), more than 40% of the records in our sample were registered one month or more after recruitment of the first participant, with a median time to registration of 10 months for retrospectively registered trials. Data from the Australian New Zealand Clinical Trials Registry (ANZCTR) confirm these findings and show no improvement for 2010 (Personal communication, L. Askie, 29 June 2010). This delay is clearly not acceptable, particularly as many trials could feasibly complete recruitment in such a time frame and could potentially then retrospectively register the trial in a way that could favour a particular result. It is for this reason that some registries refuse to retrospectively register trials. Adoption and enforcement of the ICMJE policy on prospective registration by more journal editors could make an important difference, and some key journals are playing a leading role in this regard . By emphasizing the importance of informative entries and specifically underlining the consequences of omitting information, journal editors could contribute even more to the attainment of high quality registration.
It is important to note that any study of the quality of registered records is not the same as a study of the quality of the design or conduct of clinical trials. It is just as possible that the trials that have not been adequately registered are of high quality as low quality. However, just as the quality of a trial and its results can usually only be assessed against the quality of the publication reporting those results, in the absence of the complete protocol we have no other choice than to judge the quality of a trial's design against the information entered into a trial registry.
It has now been five years since the ICMJE and the World Health Assembly put their crucial support behind the need to prospectively register clinical trials. In the time that has passed the number of registered trials has increased from less than 10,000 to more than 120,000, but a significant proportion of the information that has been registered remains deficient. In an attempt to improve the quality of registered data the WHO ICTRP has introduced a number of measures. One is to improve the explanatory text for the Trial Registration Data Set to make the requirements for registration clearer, particularly for contact, intervention and outcome information . Another is the establishment of International Standards for Clinical Trial Registries, the aim of which is to improve the quality of registered data by establishing a clear minimum requirement for quality control processes performed and data recording practices used by individual clinical trial registries. It is our intention to repeat this study following the introduction of the standards and continue to monitor the quality of registered data. If successful, these measures could improve the meaningfulness and usefulness of registered data, and hence ensure its scientific, ethical and moral integrity.
We wish to thank Ghassan Karam for his help in attaining a random sample of registered records from the ICTRP database. Additionally, we are grateful to Dr Bianca de Stavola from the London School of Hygiene and Tropical Medicine, for her advice regarding methods of statistical analysis for clustered data sets.
Conceived and designed the experiments: RFV DG. Performed the experiments: RFV. Analyzed the data: RFV DG. Wrote the paper: RFV DG.
- 1. Claxton LD (2005) Scientific authorship. Part 1. A window into scientific fraud? Mutat Res 589: 17–30.LD Claxton2005Scientific authorship. Part 1. A window into scientific fraud?Mutat Res5891730
- 2. WEMOS and SOMO centre for research on multinational coorporations (2008) WEMOS and SOMO centre for research on multinational coorporations2008SOMO briefing paper on ethics in clinical trials, #1: Examples of unethical trials. Available: http://somo.nl/html/paginas/pdf/Examples_of_unethical_trials_nov_2006_NL.pdf. Accessed 28 June 2010. SOMO briefing paper on ethics in clinical trials, #1: Examples of unethical trials. Available: http://somo.nl/html/paginas/pdf/Examples_of_unethical_trials_nov_2006_NL.pdf. Accessed 28 June 2010.
- 3. Shafer SL (2009) Retraction notice. Anesth Analg 108: 1351.SL Shafer2009Retraction notice.Anesth Analg1081351
- 4. Ross DB (2007) The FDA and the case of Ketek. N Engl J Med 356: 1601–1604.DB Ross2007The FDA and the case of Ketek.N Engl J Med35616011604
- 5. Willyard C (2007) Pfizer lawsuit spotlights ethics of developing world clinical trials. Nat Med 13: 763.C. Willyard2007Pfizer lawsuit spotlights ethics of developing world clinical trials.Nat Med13763nm0707-763 [pii];10.1038/nm0707-763 [doi]. nm0707-763 [pii];10.1038/nm0707-763 [doi].
- 6. World Medical Association (2008) Declaration of Helsinki. World Medical Association2008Declaration of Helsinki.Available: http://www.wma.net/en/30publications/10policies/b3/index.html. Accessed 28 June 2010. Available: http://www.wma.net/en/30publications/10policies/b3/index.html. Accessed 28 June 2010.
- 7. Horton R (2004) Vioxx, the implosion of Merck, and aftershocks at the FDA. Lancet 364: 1995–1996.R. Horton2004Vioxx, the implosion of Merck, and aftershocks at the FDA.Lancet36419951996
- 8. Juni P, Nartey L, Reichenbach S, Sterchi R, Dieppe PA, et al. (2004) Risk of cardiovascular events and rofecoxib: cumulative meta-analysis. Lancet 364: 2021–2029.P. JuniL. NarteyS. ReichenbachR. SterchiPA Dieppe2004Risk of cardiovascular events and rofecoxib: cumulative meta-analysis.Lancet36420212029
- 9. Tonkin A, Jureidini J (2005) Wishful thinking: antidepressant drugs in childhood depression. Br J Psychiatry 187: 304–305.A. TonkinJ. Jureidini2005Wishful thinking: antidepressant drugs in childhood depression.Br J Psychiatry187304305
- 10. International Committee of Medical Journal (2004) Clinical Trial Registration: A statement from the International Committee of Medical Journal Editors. International Committee of Medical Journal2004Clinical Trial Registration: A statement from the International Committee of Medical Journal Editors.Available: http://www.icmje.org/clin_trial.pdf. Accessed 28 June 2010. Available: http://www.icmje.org/clin_trial.pdf. Accessed 28 June 2010.
- 11. WHO International Clinical Trials Registry Platform (ICTRP). Available: http://www.who.int/ictrp. Accessed 28 June 2010. WHO International Clinical Trials Registry Platform (ICTRP). Available: http://www.who.int/ictrp. Accessed 28 June 2010.
- 12. Li YP, Wu TX, Li J, Zhong ZH, Jia WN, for Joint Statement Working Group (2006) Joint Statement of Establishing Chinese Clinical Trial Registration and Publication System. YP LiTX WuJ. LiZH ZhongWN Jiafor Joint Statement Working Group2006Joint Statement of Establishing Chinese Clinical Trial Registration and Publication System.Available: http://www.chictr.org/Upload/Joint%20Statement.pdf. Accessed 28 June 2010. Available: http://www.chictr.org/Upload/Joint%20Statement.pdf. Accessed 28 June 2010.
- 13. Japanese Ministry of Health, Labour and Welfare (2008) Statement on Japan Primary Registries Network. Japanese Ministry of Health, Labour and Welfare2008Statement on Japan Primary Registries Network.Available: http://www.mhlw.go.jp/topics/2008/10/tp1017-1.html. Accessed 28 June 2010. Available: http://www.mhlw.go.jp/topics/2008/10/tp1017-1.html. Accessed 28 June 2010.
- 14. Dreier G, Hasselblatt H, Antes G, Schumacher M (2009) [The German Clinical Trials Register: reasons, general and technical aspects, international integration]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 52. : 463–468.G. DreierH. HasselblattG. AntesM. Schumacher2009[The German Clinical Trials Register: reasons, general and technical aspects, international integration].Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz5246346810.1007/s00103-009-0833-5 [doi]. 10.1007/s00103-009-0833-5 [doi].
- 15. BIREME/PAHO/WHO (2009) Clinical trials registry advances in Latin America and the Caribbean. Newsletter Virtual Health Library (VHL) 086. BIREME/PAHO/WHO2009Clinical trials registry advances in Latin America and the Caribbean. Newsletter Virtual Health Library (VHL) 086.Available: http://espacio.bvsalud.org/boletim.php?newsletter=20090121&newsLang=en&newsName=Newsletter%20VHL%20086%2021/January/2009&articleId=12181706200814. Accessed 28 June 2010. Available: http://espacio.bvsalud.org/boletim.php?newsletter=20090121&newsLang=en&newsName=Newsletter%20VHL%20086%2021/January/2009&articleId=12181706200814. Accessed 28 June 2010.
- 16. Hooft L, Assendelft WJ, Hoeksema HL, Scholten RJ (2004) A national prospective trial register for randomised controlled trials: ethical and practical necessity. Ned Tijdschr Geneeskd 148: 1866–1869.L. HooftWJ AssendelftHL HoeksemaRJ Scholten2004A national prospective trial register for randomised controlled trials: ethical and practical necessity.Ned Tijdschr Geneeskd14818661869
- 17. Krleza-Jeric K, Chan AW, Dickersin K, Sim I, Grimshaw J, et al. (2005) Principles for international registration of protocol information and results from human trials of health related interventions: Ottawa statement (part 1). BMJ 330: K. Krleza-JericAW ChanK. DickersinI. SimJ. Grimshaw2005Principles for international registration of protocol information and results from human trials of health related interventions: Ottawa statement (part 1).BMJ330956-958. 330/7497/956 [pii];10.1136/bmj.330.7497.956 [doi]. 956-958. 330/7497/956 [pii];10.1136/bmj.330.7497.956 [doi].
- 18. IFPMA/EFPIA/JPMA/PhRMA (2009) Joint Position on the Disclosure of Clinical Trial Information via Clinical Trial Registries and Databases. IFPMA/EFPIA/JPMA/PhRMA2009Joint Position on the Disclosure of Clinical Trial Information via Clinical Trial Registries and Databases.Available: http://clinicaltrials.ifpma.org/fileadmin/files/pdfs/EN/November_10_2009_Updated_Joint_Position_on_the_Disclosure_of_Clinical_Trial_Information_via_Clinical_Trial_Registries_and_Databases.pdf. Accessed 28 June 2010. Available: http://clinicaltrials.ifpma.org/fileadmin/files/pdfs/EN/November_10_2009_Updated_Joint_Position_on_the_Disclosure_of_Clinical_Trial_Information_via_Clinical_Trial_Registries_and_Databases.pdf. Accessed 28 June 2010.
- 19. Ministerio de Salud de Argentina (2009) Resolucion 102/2009: Créase el Registro de Ensayos Clínicos en Seres Humanos. Ministerio de Salud de Argentina2009Resolucion 102/2009: Créase el Registro de Ensayos Clínicos en Seres Humanos.Available: www.casi.com.ar/boletines/117/docs/r102_2009.doc. Accessed 28 June 2010. Available: www.casi.com.ar/boletines/117/docs/r102_2009.doc. Accessed 28 June 2010.
- 20. Pandey A, Aggarwal A, Maulik M, Seth SD (2009) Clinical trial registration gains momentum in India. Indian J Med Res 130: 85–86.A. PandeyA. AggarwalM. MaulikSD Seth2009Clinical trial registration gains momentum in India.Indian J Med Res1308586
- 21. Ranawaka UK, Goonaratna C (2007) Sri Lanka clinical trials registry. Ceylon Med J 52: 117–119.UK RanawakaC. Goonaratna2007Sri Lanka clinical trials registry.Ceylon Med J52117119
- 22. Solaymani-Dodaran M, Ostovar A, Khalili D, Vasei M (2009) Iranian Registry of Clinical Trials: path and challenges from conception to a World Health Organization primary register. J Evidence-Based Med 2: 32–35.M. Solaymani-DodaranA. OstovarD. KhaliliM. Vasei2009Iranian Registry of Clinical Trials: path and challenges from conception to a World Health Organization primary register.J Evidence-Based Med2323510.1111/j.1756-5391.2009.01002.x. 10.1111/j.1756-5391.2009.01002.x.
- 23. World Association of Medical Editors (2005) The Registration of Clinical Trials. World Association of Medical Editors2005The Registration of Clinical Trials.Available: http://www.wame.org/resources/policies#trialreg. Accessed 28 June 2010. Available: http://www.wame.org/resources/policies#trialreg. Accessed 28 June 2010.
- 24. Baleta A (2010) African trials registry launches child strategy. Lancet 375: 1423.A. Baleta2010African trials registry launches child strategy.Lancet3751423
- 25. WHO Trial Registration Data Set (TRDS). Available: http://www.who.int/ictrp/network/trds/en/index.html. Accessed 28 June 2010. WHO Trial Registration Data Set (TRDS). Available: http://www.who.int/ictrp/network/trds/en/index.html. Accessed 28 June 2010.
- 26. Laine C, Horton R, DeAngelis CD, Drazen JM, Frizelle FA, et al. (2007) Clinical trial registration: looking back and moving ahead. Lancet 369: 1909–1911.C. LaineR. HortonCD DeAngelisJM DrazenFA Frizelle2007Clinical trial registration: looking back and moving ahead.Lancet36919091911
- 27. Liu X, Li Y, Yu X, Feng J, Zhong X, et al. (2009) Assessment of registration quality of trials sponsored by China. J Evidence-Based Med 2: 8–18.X. LiuY. LiX. YuJ. FengX. Zhong2009Assessment of registration quality of trials sponsored by China.J Evidence-Based Med2818
- 28. Scherer M, Trelle S (2008) Opinions on registering trial details: a survey of academic researchers. BMC Health Serv Res 8: 18.M. SchererS. Trelle2008Opinions on registering trial details: a survey of academic researchers.BMC Health Serv Res818
- 29. Sekeres M, Gold JL, Chan AW, Lexchin J, Moher D, et al. (2008) Poor reporting of scientific leadership information in clinical trial registers. PLoS ONE 3: e1610.M. SekeresJL GoldAW ChanJ. LexchinD. Moher2008Poor reporting of scientific leadership information in clinical trial registers.PLoS ONE3e1610
- 30. US Food and Drug Administration (2005) Food and Drug Administration Modernization Act (FDAMA) Section 113: Status Report on Implementation. US Food and Drug Administration2005Food and Drug Administration Modernization Act (FDAMA) Section 113: Status Report on Implementation.Available: http://www.fda.gov/ForConsumers/ByAudience/ForPatientAdvocates/ParticipatinginClinicalTrials/ucm143810.htm. Accessed 28 June 2010. Available: http://www.fda.gov/ForConsumers/ByAudience/ForPatientAdvocates/ParticipatinginClinicalTrials/ucm143810.htm. Accessed 28 June 2010.
- 31. Moja LP, Moschetti I, Nurbhai M, Compagnoni A, Liberati A, et al. (2009) Compliance of clinical trial registries with the World Health Organization minimum data set: a survey. LP MojaI. MoschettiM. NurbhaiA. CompagnoniA. Liberati2009Compliance of clinical trial registries with the World Health Organization minimum data set: a survey.Trials 10: 56. 1745-6215-10-56 [pii];10.1186/1745-6215-10-56 [doi]. Trials 10: 56. 1745-6215-10-56 [pii];10.1186/1745-6215-10-56 [doi].
- 32. Glasziou P, Chalmers I, Altman DG, Bastian H, Boutron I, et al. (2010) Taking healthcare interventions from trial to practice. BMJ 341: c3852.P. GlasziouI. ChalmersDG AltmanH. BastianI. Boutron2010Taking healthcare interventions from trial to practice.BMJ341c3852
- 33. Zarin DA, Tse T, Ide NC (2005) Trial Registration at ClinicalTrials.gov between May and October 2005. N Engl J Med 353: 2779–2787.DA ZarinT. TseNC Ide2005Trial Registration at ClinicalTrials.gov between May and October 2005.N Engl J Med35327792787
- 34. Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM (2009) Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis. PLoS Med 6: e1000144.JS RossGK MulveyEM HinesSE NissenHM Krumholz2009Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis.PLoS Med6e1000144
- 35. Scoggins JF, Patrick DL (2009) The use of patient-reported outcomes instruments in registered clinical trials: evidence from ClinicalTrials.gov. Contemp Clin Trials 30: 289–292.JF ScogginsDL Patrick2009The use of patient-reported outcomes instruments in registered clinical trials: evidence from ClinicalTrials.gov.Contemp Clin Trials30289292
- 36. Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P (2009) Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 302: 977–984.S. MathieuI. BoutronD. MoherDG AltmanP. Ravaud2009Comparison of registered and published primary outcomes in randomized controlled trials.JAMA302977984
- 37. Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, et al. (2008) Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS ONE 3: e3081.K. DwanDG AltmanJA ArnaizJ. BloomAW Chan2008Systematic review of the empirical evidence of study publication bias and outcome reporting bias.PLoS ONE3e3081
- 38. Scherer R, Langenberg P, von Elm E (2007) Full publication of results initially presented in abstracts. Cochrane Database of Systematic Reviews 2007, Issue 2. Art. R. SchererP. LangenbergE. von Elm2007Full publication of results initially presented in abstracts. Cochrane Database of Systematic Reviews 2007, Issue 2. Art.No. : MR000005. DOI: 10.1002/14651858.MR000005.pub3. No. : MR000005. DOI: 10.1002/14651858.MR000005.pub3.
- 39. Chalmers I, Glasziou P (2009) Avoidable waste in the production and reporting of research evidence. Lancet 374: 86–89.I. ChalmersP. Glasziou2009Avoidable waste in the production and reporting of research evidence.Lancet3748689
- 40. US Congress (2007) Food and Drug Administration Amendments Act of 2007. US Congress2007Food and Drug Administration Amendments Act of 2007.Available: http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=110_cong_public_laws&docid=f:publ085.110.pdf. Accessed 28 June 2010. Available: http://frwebgate.access.gpo.gov/cgi-bin/getdoc.cgi?dbname=110_cong_public_laws&docid=f:publ085.110.pdf. Accessed 28 June 2010.
- 41. Linking related records on the ICTRP Search Portal. Linking related records on the ICTRP Search Portal.Available: http://www.who.int/ictrp/unambiguous_identification/bridging/en/index.html. Accessed 28 June 2010. Available: http://www.who.int/ictrp/unambiguous_identification/bridging/en/index.html. Accessed 28 June 2010.
- 42. ClinicalTrials.gov (2010) ClinicalTrials.gov2010Protocol Data Element Definitions (DRAFT). Available: http://prsinfo.clinicaltrials.gov/. Accessed 28 June 2010. Protocol Data Element Definitions (DRAFT). Available: http://prsinfo.clinicaltrials.gov/. Accessed 28 June 2010.
- 43. Rogers WH (1993) sg17: Regression standard errors in clustered samples. Stata Technical Bulletin 13: 19–23.WH Rogers1993sg17: Regression standard errors in clustered samples.Stata Technical Bulletin131923
- 44. (2002) The International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) Topic E 6 (R1): Guideline for Good Clinical Practice (CPMP/ICH/135/95). 2002The International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) Topic E 6 (R1): Guideline for Good Clinical Practice (CPMP/ICH/135/95).Available: http://www.ich.org/LOB/media/MEDIA482.pdf. Accessed 28 June 2010. Available: http://www.ich.org/LOB/media/MEDIA482.pdf. Accessed 28 June 2010.
- 45. Ghersi D, Clarke M, Berlin J, Gulmezoglu A, Kush R, et al. (2008) Reporting the findings of clinical trials: a discussion paper. Bull World Health Organ 86: 492–493.D. GhersiM. ClarkeJ. BerlinA. GulmezogluR. Kush2008Reporting the findings of clinical trials: a discussion paper.Bull World Health Organ86492493
- 46. Feczko J (2006) Clinical trials report card. N Engl J Med 354: 1426–1429.J. Feczko2006Clinical trials report card.N Engl J Med35414261429
- 47. De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, et al. (2005) Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors. CMAJ 172: 1700–1702.CD De AngelisJM DrazenFA FrizelleC. HaugJ. Hoey2005Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors.CMAJ17217001702cmaj.050600 [pii];10.1503/cmaj.050600 [doi]. cmaj.050600 [pii];10.1503/cmaj.050600 [doi].
- 48. Ghersi D, Pang T (2009) From Mexico to Mali: Four years in the history of clinical trial registration. J Evidence-Based Med 2: 1–7.D. GhersiT. Pang2009From Mexico to Mali: Four years in the history of clinical trial registration.J Evidence-Based Med217
- 49. Drazen JM, Zarin DA (2007) Salvation by registration. N Engl J Med 356: 184–185.JM DrazenDA Zarin2007Salvation by registration.N Engl J Med356184185