Skip to main content
Advertisement
  • Loading metrics

Innovative Approaches to Clinical Data Management in Resource Limited Settings Using Open-Source Technologies

  • Raymond Omollo ,

    romollo@dndi.org

    Affiliation Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya

  • Michael Ochieng,

    Affiliation Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya

  • Brian Mutinda,

    Affiliation Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya

  • Truphosa Omollo,

    Affiliation Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya

  • Rhoda Owiti,

    Affiliation Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya

  • Seth Okeyo,

    Affiliation Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya

  • Monique Wasunna,

    Affiliations Drugs for Neglected Diseases initiative Africa, Regional Office, Nairobi, Kenya, Centre for Clinical Research, Kenya Medical Research Institute, Nairobi, Kenya

  • Tansy Edwards

    Affiliation MRC Tropical Epidemiology Group, London School of Hygiene &Tropical Medicine, London, United Kingdom

Introduction

The primary objective of clinical data management (CDM) is to provide high-quality, reliable data for reporting randomized controlled trials (RCTs) in line with good clinical practice (GCP) requirements. For treatment trials of neglected tropical diseases (NTDs) in endemic countries, CDM systems need to be efficient and affordable. Challenges include poor infrastructure, license costs associated with GCP-compliant software, and limited human resources to provide the required expertise. We argue that high-quality CDM for NTDs can be achieved and that challenges can be overcome through the use of readily available open-access tools.

The Drugs for Neglected Diseases initiative (DNDi) [1], [2] sponsors several RCTs of treatments for visceral leishmaniasis (VL) in eastern Africa, working with regional partners through the Leishmaniasis East Africa Platform (LEAP). These trials are conducted according to GCP standards to ensure internal and external validity, with CDM conducted by the authors at the Data Centre (DC) based at DNDi Africa in Nairobi.

Choice of proprietary or open-source tools is dependent largely on budget and user experience, with tools used independently or in combination. We have been working to overcome two main challenges:

  1. Telecommunication, in particular with unstable internet connectivity. An ideal tool for CDM would allow implementation with or without an internet connection (online and offline modes respectively) and be configured for use across multiple remote sites.
  2. Automated query generation and resolution to provide an audit trail ensuring consistency, rigor, and limited risk of human error.

We describe our development of two new tools for CDM: an offline module for OpenClinica users and a query management system (QMS) that allows automation and standardization of query management with multiple-user access.

Use of Open-Source Tools for CDM in Remote Settings

A popular tool for RCTs is OpenClinica [3], a GCP-compliant database package used in our DC since 2009. OpenClinica Community Edition has many advantages for CDM but was only available to use in an online mode. Without a validated offline mode of working with OpenClinica, the system's ability to support multicenter trials is limited to paper data collection and centralized data entry. Offline electronic data capture (EDC) in line with GCP would lead to substantial reductions in time between data entry and database lock [4].

We developed a validated offline module for OpenClinica to meet GCP requirements and to be made freely available to the user community (Figure 1, Table 1). Data synchronization was enabled by developing codes using python scripts (Table S1), coupled with dedicated technical support and user training. As a result, actual entry of data into the system in a remote setting is faster because the delays associated with poor connectivity are eliminated and the time taken for the data to reach the DC is shortened due to the fact that paper case report forms (CRFs) do not require physical transportation, site capacity has been strengthened, and the site staff feel engaged with the project beyond patient management through participation in CDM.

thumbnail
Figure 1. Process flow for the implementation of OpenClinica in offline mode.

https://doi.org/10.1371/journal.pntd.0003134.g001

Our tool builds offline functionality into OpenClinica to be freely available to community users. This differs from the integration tool of Mi-Forms created by the Mi-Corporation [5]. Mi-Forms require installation of new external software.

A New Approach to Query Management

Because of the large volume of data generated in VL trials (>1000 fields per patient), comprehensive cross-checking and query identification in OpenClinica would cause severe operational delays even with strong, stable internet connectivity. We used OpenClinica for entry and basic consistency checks and developed the Query Management System Plus (QMSPlus) (Figure 2 and Table 1). Following data entry validation, the system exports data into a statistical package with a program editor function that can save large amounts of code to run edit checks (for this component, we use STATA [6] based on a historical preference).There are three main modules in QMSPlus: (1) Query Assignment, which produces standardized query reports to be sent to different destinations depending on the nature of the query (site, trial, or data manager); (2) Query Resolution for data correction; and (3) Data Resolver, which produces programs to update the STATA database. These processes are repeated until a satisfactory response is achieved for all queries raised. Modules 1 and 3 are fully automated; module 2 is semiautomated in that data resolution values must be entered manually into the system on an ongoing basis as resolutions are received from the sites.

thumbnail
Figure 2. Process flow for query management within the QMSPlus.

*Another statistical package like R can also be used.

https://doi.org/10.1371/journal.pntd.0003134.g002

QMSPlus is a web-based Java application using PostgreSQL, allowing multiple users access to the database simultaneously. The data output from the QMSPlus (module 3) can also be exported to any other statistical analysis package with a program editor function to therefore be applicable for query management irrespective of preference of analysis software. With further development, QMSPlus could become an open-source tool if open-source statistical software such as the R package (Table 2) is used in place of STATA.

Discussion

We have developed two innovative tools to enhance the productivity and rigor of our CDM systems: the offline mode for OpenClinica and the QMSPlus. We have intentionally utilized open-source tools to demonstrate that high-quality, GCP-compliant CDM is possible in endemic countries. We demonstrate that it is possible to overcome connectivity challenges and move beyond a spreadsheet system of queries with its associated drawbacks such as lack of authentication and audit trail, single-user use, formatting constraints, and maintenance challenges [7]. We estimate that QMSPlus has substantially reduced query management turnaround time by approximately 60%. Previously, 100 queries would take at least a day to transcribe onto the data clarification forms (DCF) before sending to the sites. Now the same volume takes just 2–3 hours to review and electronically send to the sites for resolutions. In the future, it should be possible to replace STATA in the QMSPlus program, which requires purchase of a license, with an alternative open-source package in order for QMSPlus to be made available as an open-access tool.

Since resources are needed for training, open-source software is not necessarily cost-free, but this expense is justifiable when compared to the cost of proprietary tools for noncommercial research [8]. Within the DC, the skill sets available for the implementation of these innovative approaches are primarily in data management, programming, system validation, and statistics, with experience in CDM for clinical trials. Knowledge sharing could lead to jointly created validation instruments and sharing of best practices.

Further adaptations could enable local data capture of information relating to patient case load, response to treatment and safety reporting to Ministries of Health, and for pharmacovigilance studies. Simplified systems could facilitate standardized data collection, reporting of prevalence surveys, and mass treatment coverage, ideally using mobile devices. National control programs will need to capture, collate, and report vast amounts of data on disease prevalence and treatment coverage as scale-up of mass treatment distribution for NTDs gains momentum and monitoring of progress towards elimination goals is required [9].

Conclusion

Through the innovative use of open-source tools, knowledge sharing, and strengthening of research networks, high-quality data management is possible for all those working towards improved control of NTDs [10] while adhering to the principles of GCP.

Supporting Information

Table S1.

Implementing OpenClinica in offline mode.

https://doi.org/10.1371/journal.pntd.0003134.s001

(DOCX)

Acknowledgments

We would like to sincerely acknowledge Simon Brooker for his guidance in developing the article. We thank Simon Bolo, Sally Ellis, Peter Smith, and the LEAP principal investigators (Eltahir Khalil, Ahmed Musa, Asrat Hailu, and Joseph Olobo) for their valuable support and encouragement. Clemens Masesa was the inspiration behind an earlier version of the QMS. Susan Wells reviewed the manuscript.

References

  1. 1. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (1996) ICH Harmonised Tripartate Guideline: Guideline for Good Clinical Practice E6(R1). Available: http://www.fda.gov/downloads/Drugs/Guidances/ucm073122.pdf. Accessed 13 August 2014.
  2. 2. DNDi (2014) Drugs for Neglected Diseases initiative (DNDi) Visceral Leishmanasis Program. Available: www.dndi.org. Accessed 11 August 2014.
  3. 3. OpenClinica LLC, collaborators(2011) OpenClinica version 3.1. Waltham (Massachusetts): OpenClinica.
  4. 4. Walther B, Hossin S, Townend J, Abernethy N, Parker D, et al. (2011) Comparison of Electronic Data Capture (EDC) with the Standard Data Capture Method for Clinical Trial Data. PLoS ONE 6: e25348.
  5. 5. Mi-Corporation (2013 July 3) A look at Integration between Mi-Forms and OpenClinica. Available: http://www.mi-corporation.com/blog/8766/. Accessed 11 August 2014.
  6. 6. Statacorp (2003) Stata Statistical Software: Release 11.2. College Station (Texas): StataCorp LP, editor.
  7. 7. Miralles R, Gicqueau A (2010) Improve your Clinical Data Management With Online Query Management System. In: Proceedings of PharmaSUG conference; 23–26 May 2010;Orlando, Florida, United States. Available: www.clinovo.com/userfiles/PharmaSug-Monitoring-Clinical-Data-Discrepancies-through-SAS-based-Online-Query-Management.pdf. Accessed 11 August 2014.
  8. 8. Fegan GW, Lang TA (2008) Could an Open-Source Clinical Trial Data-Management System Be What We Have All Been Looking For? PLoS Med 5: e6.
  9. 9. World Health Organisation (2012) Accelerating work to overcome the global impact of neglected tropical diseases – A roadmap for implementation. Available: http://www.who.int/neglected_diseases/NTD_RoadMap_2012_Fullversion.pdf. Accessed 11 August 2014.
  10. 10. Lang TA, White NJ, Hien TT, Farrar JJ, Day NP, et al. (2010) Clinical research in resource-limited settings: enhancing research capacity and working together to make trials less complicated. PLoS Negl Trop Dis 4: e619.