Figures
Abstract
Electronic medical records (EMRs) have great potential to improve healthcare processes and outcomes. They are increasingly available in Nigeria, as in many developing countries. The impact of their introduction has not been well studied. We sought to synthesize the evidence from primary studies of the effect of EMRs on data quality, patient-relevant outcomes and patient satisfaction. We identified and examined five original research articles published up to May 2023 in the following medical literature databases: PUBMED/Medline, EMBASE, Web of Science, African Journals Online and Google Scholar. Four studies examined the influence of the introduction of or improvements in the EMR on data collection and documentation. The pooled percentage difference in data quality after introducing or improving the EMR was 142% (95% CI: 82% to 203%, p-value < 0.001). There was limited heterogeneity in the estimates (I2 = 0%, p-heterogeneity = 0.93) and no evidence suggestive of publication bias. The 5th study assessed patient satisfaction with pharmacy services following the introduction of the EMR but neither had a comparison group nor assessed patient satisfaction before EMR was introduced. We conclude that the introduction of EMR in Nigerian healthcare facilities meaningfully increased the quality of the data.
Author summary
Electronic medical records, or EMRs, offer the potential to improve healthcare in many developing nations, including Nigeria. The actual impact of these digital records hasn’t gotten enough attention, despite their growing availability. Our goal in doing this review was to compile and evaluate primary study data on the effects of EMRs on patient satisfaction, patient-related outcomes, and data quality in Nigeria. After searching through medical literature databases, we found five original research publications up to May 2023 that were suitable for our study. The impact of EMR implementation or upgrades on data collection and documentation was examined in four of these studies, while patient satisfaction with pharmacy services following EMR adoption was evaluated in the fifth study. Although the included studies did not quantitatively assess the impact of EMR adoption on patient satisfaction, we were able to conclude from the studies that the introduction of EMR in Nigerian healthcare facilities meaningfully increased the quality of the data
Citation: Olukorode SO, Adedeji OJ, Adetokun A, Abioye AI (2024) Impact of electronic medical records on healthcare delivery in Nigeria: A review. PLOS Digit Health 3(9): e0000420. https://doi.org/10.1371/journal.pdig.0000420
Editor: Jennifer N. Avari Silva, Washington University in Saint Louis, UNITED STATES OF AMERICA
Received: November 26, 2023; Accepted: July 17, 2024; Published: September 13, 2024
Copyright: © 2024 Olukorode et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data are in the manuscript and Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Electronic medical records (EMRs) are extensively used in developed countries but their adoption in developing countries has been slow [1]. According to a survey conducted by the World Health Organization, 114 countries are presently developing national electronic medical record systems due to an increasing awareness that a more robust health information technology (HIT) system is essential for delivering superior healthcare at reduced expenses [2]. The adoption of EMR in these countries has been hindered by implementation, maintenance, and lack of required computer skills among healthcare professionals [3].
The impact of the introduction of the EMRs has not been well studied. Most of the published literature have been perspective papers and reviews [4–6], case studies describing the practical experiences of hospitals setting up EMRs [7–10], primary studies exploring the barriers hindering their adoption [1,11–15] and studies leveraging EMRs for research [16–19]. Several primary studies have however assessed the impact of EMRs on patient-relevant outcomes [8,20–25], but no reviews have synthesized the evidence from them. The magnitude or direction of the impact of EMRs on these outcomes therefore remains unclear.
The main objective of this review is to assess the impact of the introduction and use of EMRs in healthcare facilities in Nigeria on patient-relevant outcomes. We will thus synthesize the evidence from studies of patient waiting time, patient satisfaction and health outcomes.
Methods
The guidelines from the Preferred Reporting Items for Meta-analysis, and Systematic Reviews (PRISMA) guidelines were used in the design, analysis, and reporting of this study [26].
Systematic search
We conducted a systematic search of medical literature databases in May 2023. The search included PubMed/Medline (U.S. National Library of Medicine), Embase (Elsevier), Web of Science and African Journals Online (AJOL). The search was based on a combination of keywords and Medical Subject Heading (MeSH) terms denoting “medical records” and “Nigeria” were used. The search was not restricted by year of publication, study design or by language. Hand-searching of the reference lists of included articles, related review papers, and the first 500 Google Scholar search hits were also reviewed for additional relevant papers.
Selection of studies
Duplicate citations were removed and the title and abstract of identified studies were reviewed by at least two researchers working independently (OO, OA and AA). Discrepancies were resolved by a third author (AIA). The full text of qualifying articles were then reviewed in a similar manner. To be eligible for inclusion, studies had to be published in English Language, have assessed the impact of Electronic medical records, and conducted in Nigeria. Studies were excluded if they were systematic reviews, case reports, and duplicate studies. Rayyan.ai was used to manage study selection [27].
Data extraction
Data were extracted from the eligible studies using a data extraction sheet prepared by investigators. Data on study designs, population characteristics, covariates, study details, measures of association and their corresponding confidence intervals (CI), standard errors or p-values were extracted from the included studies.
Study quality and risk of bias
Included studies were critically appraised for the risk of bias. The risk of bias was assessed using the Cochrane Collaboration’s revised tools for assessing the risk of bias in non-randomized studies [28]. No inclusion or analysis decisions were made based on the risk of bias.
Meta-analysis
The ratio of the percentage in data quality was estimated and standard errors obtained from p-values [29]. Pooled estimates of the log ratio of means for data quality were obtained from random effects meta-analysis based on the restricted maximum likelihood since ≥3 studies reported estimates for the same intervention-outcome relationship [30]. The random effects approach was selected a priori because it accounts for variability in the true intervention effect [31]. The log ratio of means is a metric of the percentage difference and was preferred to the weighted and standardized mean difference measures as it is easily interpretable [32]. Heterogeneity was assessed using the I2 statistic to explore the degree of variability between the studies and explored in meta-regression. I2 was regarded as minimal if 0–40%, moderate if >40–60%, substantial if 60–80% and considerable if >80% [33]. Publication bias was evaluated by visual inspection of funnel plots and the Egger’s test [34]. Meta-analysis was conducted using the Metafor package [35] in RStudio [36] P-values are 2-sided, and significance was set at p-value < 0.05.
Results
Summary of included studies
We found five studies (Fig 1) that specifically analyzed the influence of EMR on healthcare outcomes in Nigerian hospitals. There was one cross-sectional study [23] and four longitudinal studies [20–22,24]. These studies were all conducted in public secondary and tertiary hospitals with the sample population ranging from doctors and nurses to patients. The risk of bias in the studies were low risk for two studies [20,21], some concern for one study [22], and high risk for two studies [23,24]. The search details are shown in Table 1 with the summary of included studies shown in Table 2.
Data quality
Four studies examined the influence of the introduction of [20,21,24] or improvements in [22] the EMR on data collection and documentation, with important implications for public health. The first, a longitudinal study [20], examined the feasibility of using the Child Electronic Growth Monitoring System (CEGROMS) to monitor the growth of infants in the Child Welfare Clinic of Barau Dikko Teaching Hospital, Kaduna, Kaduna State as part of the Kaduna Infant Development (KID) Birth Cohort Study [37] over nine months. The CEGROMS system included data capture forms, electronic tablets, and desktop computer linked to a cloud server. It collected data on child growth parameters such as head circumference, length, and birth weight. Participants were enrolled during birth or immunization visits and followed up during growth monitoring visits.
3,152 infants were assessed in this study. Of these, 89% had complete data and 68% had at least one follow-up visit. Data was more likely to be complete if infants were delivered at a health facility (OR = 19.2; 95% CI: 13.7, 26.9), or were born to tertiary-educated mothers (OR = 3.54; 95% CI: 2.69, 4.67). The odds of completing at least one follow-up visit were also greater for infants of tertiary-educated mothers (OR = 1.33; 95% CI: 1.06, 1.51).
The second study [21] assessed the impact of utilizing electronic and paper-based Standardized Nursing Care Plans (SNCPs) on the quality of nurses’ documentation at a government-owned tertiary health facility. The design of the study was a pre-post quasi-experimental study comparing a new electronic SNCP to the existing paper-based SNCP. Whether hospital wards would use electronic or paper-based SNCP was determined by the hospital management. One adult medical wards using each of paper or electronic SNCPs was purposively selected for inclusion in the study. These wards had 32 nurses on staff and an average monthly admission of 34 patients.
Nursing documents for patients admitted for ≥4 days in these wards were assessed for pre-test (N = 67), and first and second post-tests (N = 68 each), 3 and 6 months later respectively. An instrument for assessing the quality of nursing diagnoses and documentation were used at each time point [38]. Following the introduction of SNCPs, there was a noticeable enhancement in documentation quality within both wards during the post-intervention period. While documentation quality in the electronic ward was good at 0% in the pretest, 72% in the first pretest and 54% in the second pretest, in the paper ward, it was 5% in the pretest, 31% in the first pretest and 32% in the second pretest, indicating a significant difference in the difference in documentation quality in both wards over time. This study underscores the crucial role of providing SNCPs in both electronic and paper formats in order to elevate the standard of nursing documentation.
The third study [24] assessed the impact of an automated Health Information Exchange (HIE) system on the validity and completeness of HIV viral load testing in healthcare facilities across Nigeria. The study design was longitudinal/quasi-experimental. The automated HIE system linked the EMR and the Laboratory Information Management Systems (LIMS) using APIs allowing the exchange of lab testing data. The validity of viral load data was assessed before the HIE was implemented and six months after. Three high-volume PCR labs and 30 treatment facilities were purposively selected for analysis.
The results indicated significant improvements in both data completeness and validity after the implementation of the automated HIE system. 15,226 records of specimens were analyzed at baseline and 18,022 records of specimens were analyzed six months later. Data completeness was defined as the percentage of observations with all the data regarding viral load testing, including the date and time the test was requested, specimen collected, tested, and so on. Data completeness increased significantly from 47% before HIE implementation to 67% six months after implementation (P-value <0.01). Data validity also increased from 90% before implementation to 91% after implementation (P-value <0.01).
The fourth study [22] was a longitudinal quality improvement (QI) study that aimed to use the Plan-Do-Study-Act cycle framework to enhance the accuracy of coding using the International Classification of Diseases, 10th revision (ICD-10) for morbidity/mortality data at general hospitals in Lagos State. The specific objective was to increase the accuracy rate from 78.7% to ≥95% between March 2018 and September 2018. Additionally, the study aimed to determine whether the electronic browsing tool could yield better coding accuracy compared to the traditional manual method. Thus, unlike the previous three studies that evaluated the introduction of EMR, this study studied improvements in the EMR.
The intervention involved introducing electronic diagnostic terminology software [39] and providing training to 52 clinical coders across the 26 general hospitals. The clinical coders were medical records personnel most of whom had a bachelor’s degree or its equivalent and had been in service a median of 7 years. To evaluate the impact of the intervention, an end-of-training coding exercise was conducted to compare accuracy between the old method and the new approach. Accuracy was defined based on the extent of correctly coded diagnoses. Over the period from April 2018 to March 2019, the accuracy rates in the hospitals increased from 76.3% to 96.7%, exceeding the QI goals.
The pooled percentage difference in data quality after introducing or improving the EMR was 123% (95% CI: 70% to 176%, p-value < 0.001) based on three studies of data validity [21,22,24]. The summary of the risk of bias and forest plot are shown in Figs 2 & 3 respectively. There was limited heterogeneity in the estimates (I2 = 0%, p-heterogeneity = 0.74). The funnel plot (Fig 4) was however symmetrical and the p-value for Egger’s test was 0.75. Meta-regression was not done.
Taken together, we conclude that the introduction of quality improvements to EMR enhanced data completeness and validity.
Patient care and satisfaction
One study examined the impact of EMR on patient care and satisfaction [23]. The study had a cross-sectional design and was conducted among 300 patients at the Federal Medical Centre, Keffi, Niger State, with the aim of assessing patients’ satisfaction with EMR implementation at the hospital’s pharmacy. The participants (142 female, 158 male) were selected using a simple random sampling technique in which registered outpatients were the sampling frame. Using a questionnaire designed and validated by the investigators, the participants were asked about their satisfaction with the pharmacy services they accessed following the introduction of the EMR. 33% of the respondents believed that the EMR has improved services in the pharmacy department while 38% believed otherwise; the rest were indifferent. Only 28% were satisfied with the time it took to wait for service. Overall, 46% of the participants were satisfied.
Unfortunately, waiting time was not objectively assessed in this study. The studied parameters were also not evaluated at baseline for comparison. The study did not also include a baseline assessment or a control group for comparison. We are therefore unable to conclude whether the introduction of the EMR improved patient satisfaction or shortened patient waiting times.
Discussion
The evidence with respect to the impact of EMR use in Nigeria is very scanty. We reviewed five primary studies that have examined the use and impact of EMRs in Nigeria. These studies assessed medical record quality and patient satisfaction following the introduction and use of EMR.
The EMR is central to the modernization of healthcare systems worldwide [40]. The transformative potential of EMRs lies in their ability to facilitate information management, streamline clinical workflows, and ultimately enhance patient care [41]. A striking facet that the studies unveil is the catalytic role of EMRs in mitigating errors resulting from incomplete or outdated information. The included studies have been examined in programs deploying EMR to strengthen public health programs [20], medical and nursing care [21,22] and laboratory testing [24]. The direction of our findings was similar–included studies consistently demonstrated that the EMR improved the quality of medical record data in Nigeria. We, thus, found that the introduction of the EMR improved data completeness by 123%.
Developed countries have seized the potential of EMRs to revolutionize healthcare by facilitating seamless data exchange, improving clinical decision-making, and enhancing patient engagement [42]. However, there remain disparities in EMR adoption, particularly in regions such as sub-Saharan Africa. Here, the challenges are manifold, encompassing not only technical hurdles but also socio-economic constraints and the digital divide in computer literacy among healthcare professionals [3]. These challenges are both emblematic of the complex digital landscape and unique to the local conditions of each developing country. For instance, it is incumbent upon any healthcare system to fortify its IT infrastructure to ensure seamless EMR operation. Ongoing training programs are also required to allow healthcare providers (HCPs) to operate the EMR applications with confidence and competence. There are also locally specific challenges such as epileptic power supply [43]. By fortifying IT infrastructure, fostering a culture of continuous learning, and providing robust support mechanisms, healthcare systems can navigate the intricacies of EMR implementation with a healthy amount of confidence.
Patient satisfaction, often deemed the bedrock of healthcare quality, reflects the synergy between medical expertise, operational efficiency, and the overall patient experience [44]. It is usually the result of reduced waiting times, enhanced information accessibility, and streamlined administrative processes. The transformation expected to be fostered by EMRs is not confined to operational efficiency; it extends to the very essence of healthcare—an essence deeply rooted in empathy, compassion, and patient-centricity [45]. HCPs would be afforded the time and tools to engage more closely with patients. The reduced administrative burden would pave the way for meaningful patient interactions, allowing HCPs to actively listen, educate, and engage with patients. It is noteworthy that HCPs in high-income countries believe that the EMR has actually increased administrative burden, though the actual impact on clinician burnout has not been rigorously studied [46]. Unfortunately, the reviewed studies did not rigorously evaluate the effect of introducing the EMR on patient satisfaction. Qualitative studies from Nigeria assessing patient and HCP satisfaction have had mixed outcomes [8,25], with the expectation that efficiency and satisfaction would improve as HCPs gained more familiarity with the EMR technology and the clinical workflow was improved. Studies from the USA, Kuwait and Saudi Arabia have reported improved patient satisfaction following the introduction of EMRs [47,48]. The rollout of EMRs in Nigeria is recent and improvements in patient satisfaction and healthcare quality can be expected as clinicians become more adept in the use of these tools.
This study has noteworthy strengths and limitations. By focusing on a single country, we are able to sharply focus on country-specific issues and potentially propose a national research agenda for digital health. Our meta-analysis of the effect of the introduction of the EMR on data quality could potentially be useful for health systems in the country aiming to assess the value of the EMR. Private facilities were however not included in any of the primary studies, though they account for a substantial proportion of healthcare in Nigeria [49,50]. The timeframe of the studies was also not long enough to evaluate any long-term impacts on data quality.
Going forward, additional research may improve our understanding of the value of the EMR in healthcare delivery. These include studies assessing health professionals’ readiness, impact on patient-relevant clinical outcomes in different clinical settings and a range of diagnoses, patient satisfaction using standard validated tools, objectively measured patient waiting time and quality indicators. It is important for the studies to carefully define the PICOS–participants, interventions, comparators, outcomes and study design [40]. It will also be important to ensure the applicability of collected data for clinical research and programs [51,52].
Conclusion
We systematically reviewed the evidence linking the introduction of EMRs to data quality and patient satisfaction. We found that data quality increased substantially following the introduction of EMRs. We were unable to quantitatively assess the impact on patient satisfaction as there were too few studies and the included study did not have a rigorous design.
References
- 1. Akwaowo CD, Sabi HM, Ekpenyong N, Isiguzo CM, Andem NF, Maduka O, et al. Adoption of electronic medical records in developing countries—A multi-state study of the Nigerian healthcare system. Front Digit Health. 2022;4:239. pmid:36479191
- 2.
World Health Organization. Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth [Internet]. Geneva: World Health Organization; 2016 [cited 2023 May 11]. 156 p. Available from: https://apps.who.int/iris/handle/10665/252529
- 3. Akanbi MO, Ocheke AN, Agaba PA, Daniyam CA, Agaba EI, Okeke EN, et al. Use of Electronic Health Records in sub-Saharan Africa: Progress and challenges. J Med Trop. 2012;14(1):1–6. pmid:25243111
- 4. Boyinbode O, Toriola G. CloudeMR: a cloud based electronic medical record system. Int J Hybrid Inf Technol. 2015;8(4):201–12.
- 5. Funmilola A, Ozichi E. Development of an electronic medical record (EMR) system for a typical Nigerian hospital. Development. 2015;2(6).
- 6. Adedeji T, Fraser H, Scott P. Implementing Electronic Health Records in Primary Care Using the Theory of Change: Nigerian Case Study. JMIR medical informatics. JMIR Med Inform. 2022;11(10(8)):e33491. pmid:35969461
- 7. Awokola BI, Abioye-Kuteyi EA, Otoru OO, Oyegbade OO, Awokola EO, Awokola OA, et al. Practical challenges of setting up an electronic medical record system in a Nigerian tertiary hospital: The Wesley Guild Hospital experience. Middle East J Fam Med. 2012;10(2):37–42.
- 8. Chaplin B, Meloni S, Eisen G, Jolayemi T, Banigbe B, Adeola J, et al. Scale-up of networked HIV treatment in Nigeria: creation of an integrated electronic medical records system. Int J Med Inf. 2015;84(1):58–68. pmid:25301692
- 9. Ogundipe O. Electronic Medical Record Keeping: Eleven Years Experience at Life Support Eye Clinic, Lagos, Nigeria. Niger J Ophthalmol. 2011;19(1):12–8.
- 10. Sawyer-George O, Friday JE. Adoption of Electronic Medical Records in Tertiary Health-Care Centers: A Survey of Federal Medical Centers in South-South Nigeria. Asian J Inf Sci Technol AJIST. 2023;13(1).
- 11. Ayanlade OS. Electronic Medical Record System as a central ICT tool for quality healthcare services: Nigeria as a case study. Afr J Sci Technol Innov Dev. 2018;10(2):147–57.
- 12. Onigbogi OO, Poluyi A, Poluyi C, Onigbogi M. Doctors’ Attitude and Willingness to Use Electronic Medical Records at the Lagos University Teaching Hospital, Lagos, Nigeria. Online J Public Health Inform. 2018;10(2). pmid:30349629
- 13. Adegbore AM, Omowumi AT. Factors Influencing Electronic Medical Record Systems Success in Selected Tertiary Healthcare Facilities in South-West, Nigeria. Inf Impact J Inf Knowl Manag. 2021;12(1):14–32.
- 14. Babale SM, Taiwo HA, Olasinde AA, Joshua I. Knowledge, attitude and perception of healthcare workers on use of electronic medical records in Ahmadu Bello University teaching hospital, Zaria, Kaduna, Kaduna State Northwest Nigeria. J Med Basic Sci Res. 2021;2(1):1–12.
- 15. Afolaranmi TO, Hassan ZI, Dawar BL, Wilson BD, Zakari AI, Bello KK, et al. Knowledge of electronic medical records system among frontline health care workers in Jos University teaching hospital, Plateau State Nigeria. Int J Res Med Sci. 2020;8(11):3837. pmid:34109251
- 16. Njoku PO, Enomina M, Obehighe EE, Mbah IO, Okoro EO, Essen ME, et al. Pattern of non-communicable diseases seen in a tertiary hospital in Keffi, North Central Nigeria. Niger J Cardiol. 2019;16(1):60–5.
- 17. Odafe S, Torpey K, Khamofu H, Oladele E, Adedokun O, Chabikuli O, et al. Integrating cervical cancer screening with HIV care in a district hospital in Abuja, Nigeria. Niger Med J J Niger Med Assoc. 2013;54(3):176.
- 18. Akyala AI, Awayimbo JR, Elayo MI, Olugbade OT, Akabe EA, Akinyoade A. Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) infection among health care workers in Nasarawa State, Nigeria: implications for infection prevention and control measures. Pan Afr Med J. 2020;37(Suppl 1). pmid:33456645
- 19. Abayomi A, Osibogun A, Kanma-Okafor O, Idris J, Bowale A, Wright O, et al. Morbidity and mortality outcomes of COVID-19 patients with and without hypertension in Lagos, Nigeria: a retrospective cohort study. Glob Health Res Policy. 2021;6(1):1–8.
- 20. Kana MA, Ahmed J, Ashiru AY, Jibrin S, Sunday AD, Shehu K, et al. Child electronic growth monitoring system: an innovative and sustainable approach for establishing the Kaduna infant development (KID) study in Nigeria. Paediatr Perinat Epidemiol. 2020;34(5):532–43. pmid:32083347
- 21. Adereti CS, Olaogun AA. Use of Electronic and Paper-based Standardized Nursing Care Plans to Improve Nurses’ Documentation Quality in a Nigerian Teaching Hospital. Int J Nurs Knowl. 2019 Oct;30(4):219–27. pmid:30525306
- 22. Olagundoye O, van Boven K, Daramola O, Njoku K, Omosun A. Improving the accuracy of ICD-10 coding of morbidity/mortality data through the introduction of an electronic diagnostic terminology tool at the general hospitals in Lagos, Nigeria. BMJ Open Qual. 2021;10(1):e000938.
- 23. Hassan A, Sabiu A, Ndom G, Amina Y, Ezekiel G. Patients’ Satisfaction after Electronic Medical Records Implementation in a Tertiary Hospital in North Central Nigeria. Ann Med Health Sci Res Vol. 2018;8(1).
- 24. Aniekwe C, Cuffe K, Audu I, Nalda N, Ibezim B, Nnakwe M, et al. Assessing the effect of electronic health information exchange on the completeness and validity of data for measuring viral load testing turnaround time in Nigeria. Int J Med Inf. 2023;174:105059. pmid:37002987
- 25. Abimbola IG. Assessing Value Added in the Use of Electronic Medical Records in Nigeria. Walden University; 2015.
- 26. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–34. pmid:19631507
- 27. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5:1–10.
- 28. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. bmj. 2016;355. pmid:27733354
- 29.
Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane handbook for systematic reviews of interventions. John Wiley & Sons; 2019.
- 30. Gopalakrishnan S, Ganeshkumar P. Systematic reviews and meta-analysis: understanding the best evidence in primary healthcare. J Fam Med Prim Care. 2013;2(1):9. pmid:24479036
- 31. Kontopantelis E, Reeves D. Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: a simulation study. Stat Methods Med Res. 2012;21(4):409–26. pmid:21148194
- 32. Abioye AI, Bromage S, Fawzi W. Effect of micronutrient supplements on influenza and other respiratory tract infections among adults: a systematic review and meta-analysis. BMJ Glob Health. 2021 Jan;6(1). pmid:33472840
- 33. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011 Oct 18;343:d5928. pmid:22008217
- 34. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997 Sep 13;315(7109):629–34. pmid:9310563
- 35. Viechtbauer W, Viechtbauer MW. Package ‘metafor.’ Compr R Arch Netw Package ‘metafor’ http://cranR-ProjOrgwebpackagesmetaformetaforPdf. 2015;
- 36. Allaire J. RStudio: integrated development environment for R. Boston MA. 2012;770(394):165–71.
- 37. Nature Index [Internet]. 2023 [cited 2023 Aug 29]. Kaduna Infant Development (KID) Birth Cohort Study Project. Available from: https://www.nature.com/nature-index/institution-outputs/Nigeria/Kaduna%20Infant%20Development%20%28KID%29%20Birth%20Cohort%20Study%20Project/648bc90deb58ff99320deb8a
- 38. Müller-Staub M, Lunney M, Lavin MA, Needham I, Odenbreit M, van Achterberg T. Testing the Q-DIO as an instrument to measure the documented quality of nursing diagnoses, interventions, and outcomes. Int J Nurs Terminol Classif Off J NANDA Int. 2008 Mar;19(1):20–7.
- 39.
Becker H, Oskam S, Okkes I, van Boven K, Lamberts H. ICPC2-ICD10 Thesaurus. A diagnostic terminology for semi-automatic double coding in Electronic Patient records. In: ICPC in the Amsterdam transition project. Amsterdam: Academic Medical Center/University of Amsterdam Department of Family Medicine; 2005.
- 40. Pai MM, Ganiga R, Pai RM, Sinha RK. Standard electronic health record (EHR) framework for Indian healthcare system. Health Serv Outcomes Res Methodol. 2021;21(3):339–62.
- 41. Nordo AH, Levaux HP, Becnel LB, Galvez J, Rao P, Stem K, et al. Use of EHRs data for clinical research: historical progress and current applications. Learn Health Syst. 2019;3(1):e10076. pmid:31245598
- 42. Yi M. Major Issues in Adoption of Electronic Health Records. J Digit Inf Manag. 2018 Aug 1;16(4):180.
- 43. Umezurike IS. Exploring the Adoption of Electronic Medical Records in Primary Health Care Centres in Calabar Municipality: The Challenges and Prospects of E-Governance. J Good Gov Sustain Dev Afr. 2021;6(2):70–80.
- 44. Gillum RF. From papyrus to the electronic tablet: a brief history of the clinical medical record with lessons for the digital age. Am J Med. 2013 Oct;126(10):853–7. pmid:24054954
- 45. Mesko B, Győrffy Z. The rise of the empowered physician in the digital health era. J Med Internet Res. 2019;21(3):e12490.
- 46. Moy AJ, Schwartz JM, Chen R, Sadri S, Lucas E, Cato KD, et al. Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review. J Am Med Inform Assoc. 2021;28(5):998–1008. pmid:33434273
- 47. Liu J, Luo L, Zhang R, Huang T. Patient satisfaction with electronic medical/health record: a systematic review. Scand J Caring Sci. 2013;27(4):785–91. pmid:23181421
- 48. Wali R, Alqahtani R, Alharazi S, Bukhari S, Quqandi S. Patient satisfaction with the implementation of electronic medical Records in the Western Region, Saudi Arabia, 2018. BMC Fam Pract. 2020;21(1):1–6.
- 49. Ogunbekun I, Ogunbekun A, Orobaton N. Private health care in Nigeria: walking the tightrope. Health Policy Plan. 1999;14(2):174–81. pmid:10538720
- 50. Makinde OA, Sule A, Ayankogbe O, Boone D. Distribution of health facilities in Nigeria: implications and options for universal health coverage. Int J Health Plann Manage. 2018;33(4):e1179–92. pmid:30091473
- 51. Coorevits P, Sundgren M, Klein GO, Bahr A, Claerhout B, Daniel C, et al. Electronic health records: new opportunities for clinical research. J Intern Med. 2013;274(6):547–60. pmid:23952476
- 52. Kotecha D, Asselbergs FW, Achenbach S, Anker SD, Atar D, Baigent C, et al. CODE-EHR best-practice framework for the use of structured electronic health-care records in clinical research. Lancet Digit Health. 2022;