Research Article
30 Nov 2023: Wiegele S, McKinnon E, van Schaijik B, Enkel S, Noonan K, et al. (2023) The epidemiology of superficial Streptococcal A (impetigo and pharyngitis) infections in Australia: A systematic review. PLOS ONE 18(11): e0288016. https://doi.org/10.1371/journal.pone.0288016 View research article
Abstract
Objective
We have produced a protocol for the comprehensive systematic review of the current literature around superficial group A Streptococcal infections in Australia.
Methods
MEDLINE, Scopus, EMBASE, Web of Science, Global Health, Cochrane, CINAHL databases and the gray literature will be methodically and thoroughly searched for studies relating to the epidemiology of superficial group A Streptococcal infections between the years 1970 and 2019. Data will be extracted to present in the follow up systematic review.
Citation: Wiegele S, McKinnon E, Wyber R, Noonan K (2021) Protocol for the systematic review of the epidemiology of superficial Streptococcal A infections (skin and throat) in Australia. PLoS ONE 16(8): e0255789. https://doi.org/10.1371/journal.pone.0255789
Editor: Dafna Yahav, Rabin Medical Center, Beilinson Hospital, ISRAEL
Received: December 4, 2020; Accepted: July 16, 2021; Published: August 11, 2021
Copyright: © 2021 Wiegele et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data from this study will be made available upon study completion.
Funding: SW $1300 USD (SW) Telethon Kid's Institute, Western Australia https://www.telethonkids.org.au/ The funders had and will not have a role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Streptococcus pyogenes (Group A beta-haemolytic streptococci, GAS) is a human only pathogen which causes a broad range of superficial, invasive and post-infectious conditions. The most common infections are superficial (sGAS), affecting the skin or throat [1, 2].
Skin infection, variously described as impetigo, pyoderma or skin sores, is a common disease of childhood. The median prevalence globally is 12.3%, with a higher prevalence (13–90%) documented in remote Australian Aboriginal and Torres Strait Islander communities [3–11]. Skin sGAS infections are characterized by honey-coloured crusting lesions of the skin and present as either primary disease or as a secondary infection of an underlying skin condition [12]. Impetigo can manifest as single or multiple non-healing ulcers on any part of the body, often precipitated by a disruption to skin integrity [12, 13]. Staphylococcus aureus is the most common causative organism in temperate regions, compared with tropical regions where Streptococcus pyogenes, a group A beta-haemolytic streptococcus, predominates [2, 12, 14]. Current evidence suggests that scabies infestation, tropical climate and crowding increases the prevalence of pyoderma, and that factors including treatment of scabies infestation, good skin health and swimming pool exposure may be protective for impetigo [3, 14–23].
Similarly, throat infection, including pharyngitis and tonsillitis are common infections affecting children and young adults and account for approximately 3% of presentations to general practitioners in Australia [24, 25]. There is limited existing data about these presentations in remote Aboriginal and Torres Strait Islander settings. Pharyngitis is characterised predominately by sore throat and difficulty swallowing. Other symptoms may include tender cervical lymph nodes and fever. On examination an erythematous pharynx may be found or enlarged and erythematous tonsils indicating tonsillitis. Pharyngitis is caused by a range of pathogens, most commonly respiratory viruses, but GAS can be isolated in up to 20% of symptomatic children and 10% of asymptomatic children [26, 27].
sGAS infections disproportionately affect Indigenous, geographically remote and marginalised populations globally [3, 5, 16, 28]. These disparities have been attributed to risk factors including low socioeconomic status, overcrowded housing, resource limited settings and inadequate access to primary health care [3, 28].
sGAS infections have a direct impact on health causing pain and likely reducing education participation. Skin sores are also associated with stigma in some Aboriginal and Torres Strait Islander communities [29]. sGAS infections have potential to progress to more significant local disease, with skin infections leading to cellulitis and throat infection to peri-tonsillar abscess. More serious sequelae may also develop including invasive disease (sepsis, necrotising fasciitis, osteomyelitis, septic arthritis) and toxin mediated response (Streptococcal Toxic Shock Syndrome, Scarlet Fever), which currently account for a significant burden of disease in Australia (5 in 100 000 children annually) [1, 30]. sGAS infections also have the potential to precipitate abnormal an immune response resulting in acute post-streptococcal glomerulonephritis (ASPGN) and acute rheumatic fever (ARF) [14, 31–36].
The consequence of single or multiple episodes of post-streptococcal autoimmune sequelae may be the development of chronic disease: Chronic Kidney Disease (CKD) in ASPGN and Rheumatic Heart Disease (RHD) in ARF [37–39]. ASPGN is a significant cause of CKD, and has an incidence of 13.6–17.0/100 000 person-years in the Northern Territory, increasing to 124.0/100 000 person-years in Aboriginal children [40–42]. RHD prevalence in Australia is 845.2/100 000 people vs 5.2/100 000 people in Indigenous vs non-Indigenous populations, showing a clear disparity in the rate of preventative chronic heart disease in these populations [37]. There is significant morbidity and mortality associated with RHD, particularly for people under the age of 50, as well as the economic burden of ongoing treatment and surgery [37].
The disproportionate disease burden of sGAS infections among Aboriginal and Torres Strait Islander communities in Australia has spurred a range of research initiatives over many years. A smaller number of studies have also addressed sGAS infections in non-Indigenous settings in Australia. Although there is a relatively large body of research from this work no synthesis of these studies has been conducted to provide national and subnational estimates of the burden of disease. This makes it difficult to assess sGAS changes over time and stymies disease control efforts. Therefore, this systematic review aims primarily to assess the incidence and prevalence of sGAS infections in Australia. As secondary outcomes, the incidence and prevalence of sGAS infections in focus populations within Australia will be reviewed including Aboriginal and Torres Strait Islander communities, rural and remote locations, age group and climate type.
Methods
Search strategy and selection criteria
This systematic review is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) protocols statement and the Meta-analysis of Observational Studies in Epidemiology (MOOSE) guideline [43, 44]. No protocol for this systematic review currently exists.
Articles for data extraction will be identified through a search of multiple sources. A systematic search for published studies will be performed by SW, a medical doctor with assistance from researchers and librarians, through MEDLINE, Scopus, EMBASE, Web of Science, Global Health, Cochrane and CINAHL. A grey literature search will be done through Google Scholar top 1000 articles sorted by most relevant, WHO IRIS library database, Trove, Research Data Australia, the Grey Literature Report, and Australian Infection Prevention and Control. A search will also be completed of clinical trial registries including the Cochrane Central Register of Clinical Trials, WHO International Clinical Trials Registry Platform, Australian New Zealand Clinical Trial Registry and ClinicalTrial.gov. A hand search of included articles and related systematic reviews will be performed. All searches will be restricted to papers between the years of 1970 and the end of 2020. A detailed search strategy of electronic databases can be reviewed in S1 Appendix.
The inclusion criteria are: population based study, incidence and/or prevalence data available, Australian population, objective and transferable data on people with: impetigo, pyoderma, pharyngitis, tonsillitis, superficial GAS infection, non-specific sore throat, and a term including numerator and population denominator or a specific summary of incidence and prevalence used to describe this cohort. Studies that were pathogen-specific, other than Streptococcal A, where participants numbered less than 20 and those describing a cohort not including children (defined as 0–16 years) will be excluded.
Data extraction
Data will be extracted by two independent reviewers (SW, SE or BVS) and extracted data entered into a Google Form. Data points will be compared and discrepancies resolved between data extractors or a third party reviewer. Variables for extraction will be subdivided into groups: article details/ timing, location, study design, demographics, environmental/ social factors, skin infection specific variables and throat infection specific variables.
Article details/ timing encompasses data points including title, authors and duration of study. Location information will include state, city and community levels. Data on Australian Statistical Geography Standard (ASGC) region will be entered post-extraction. This system uses data from the Australian Bureau of Statistics (ABS) to classify remoteness based on a combination of population size and access to services, dividing communities into 5 classes: Major City, Inner Regional, Outer Regional, Remote and Very Remote.
Variables in the study design subset of extraction include: type of study, sampling method, qualifications of person collecting data, population type and total number of participants. The demographics of the study population will be collected through data points of population age, number of males and number of Aboriginal and Torres Strait Islander people in the population.
Specific data points for extraction from environmental and social factors include description of possible positive and negative factors contributing to the epidemiology of superficial Streptococcal A infections. Post extraction data entry for climate will be performed using the Koppen Climate Classification System, dividing climate into tropical, temperate, arid or cold [45, 46].
Data on the study’s definition of skin infection will be recorded, as well as epidemiological data including individual infection rate and base population number, presentation rates, total number of presentations and frequency with age. Data specific to impetigo will also be collected including distribution, number and type of lesions, as well as whether a precipitating lesion, concurrent scabies or throat infection were identified. In a similar way, data points on the definition of throat infection and epidemiological data will be extracted.
A full list of data points and any accompanying definitions or simplifications can be found in S2 Appendix.
Outcomes
The main outcome of this systematic review is to define the burden of disease of s-GAS infections in Australia, which primarily include incidence and prevalence data.
Secondary outcomes from the paper include factor specific epidemiological data; defining the burden of disease in sub-populations which include: climate, remote status, Aboriginal and Torres Strait Islander background, presence of social and/or environmental factors and year of study.
Assessment of bias
Bias will be assessed for each study included in the systematic review by two independent reviewers (SW, BVS). The Joanna Briggs Institute critical appraisal checklist for prevalence studies will be applied to each included study to assess for coverage, measurement and classification bias [47]. Any additional statement of bias from the study will be documented. Sensitivity analysis will consider overall quality of each study as well as the definitions for disease. Initial analysis will include all articles.
Statistical analysis and synthesis
Prevalence and incidence data will be extracted and presented for the skin and throat cohorts. Subgroup analysis will explore variation in incidence and prevalence data according to: geography (urban, remote), Aboriginal and Torres Strait Islander background, climate type, age of population, year of study. Within each cohort (skin and throat) descriptive analysis will include environmental/ social contributors to disease, disease characteristics and group A streptococcal isolation.
Pooled prevalence estimates across studies in a similar setting (community-based or health service encounters) will be generated using a random effects model and heterogeneity between studies will be evaluated by means of a χ2 test on Cochran’s Q statistic and quantified with the I2 statistic. A random effects framework is deemed appropriate given studies in this field sample from different populations which have varying characteristics. Metaregression will be undertaken to assess sources of between-study heterogeneity in the pooled prevalence estimates. Publication bias will be assessed with the aid of funnel plots and Begg’s rank correlation test.
Assessment of meta-biases
Bias will be assessed according to the Cochrane handbook [48]. Firstly, a rigorous grey literature and hand search will reduce the risk of publication bias. Time lag bias will be considered, though as this paper is focused around a long-standing disease in Australia and will include a publication range of 49 years, we have assessed the risk of this bias to be small. In an effort to reduce duplication bias, the dataset of each included paper will be carefully scrutinised to detect multiple publications using the same dataset. Obvious duplications in datasets will result in the exclusion of the later paper. In the event of any possible duplications not clearly outlined by the paper, the authors of the papers will be contacted.
Location bias will be addressed by instituting a comprehensive search strategy of seven mainstream databases and six grey literature databases as can be seen in S1 Appendix. The search will be conducted for all languages and journals, with papers not available online obtained in hard-copy format. Although all papers are based in Australia, there may be regional differences in publication rates based on states and territories leading to region specific location bias. The geographical distribution of selected papers will be clearly defined, and detail areas of dense and sparse literature coverage that may contribute to bias. Rigorous bibliographic review will be undertaken of relevant systematic reviews and included articles, when combined with our comprehensive search strategy will not increase the risk of citation bias.
As this study focuses on Australian disease epidemiology, Australia being a predominantly English speaking country, language bias is likely to be low. Regardless of this, the search strategy will not be limited to English studies, reducing the risk of language bias. As this review focuses on papers with descriptive statistics, and the inclusion criteria are results based, papers will be included irrespective of primary outcomes.
Confidence in cumulative evidence
Each paper will be assessed for confidence by two independent reviewers (SW, BVS) using the Joanna Briggs Institute critical appraisal checklist [49]. A final assessment of confidence in the paper will be assessed by the two independent reviewers, assigning quality levels: very poor, poor, fair, fair to good and good, to each paper. The levels of confidence will be reported for each paper included in the systematic review.
Conclusion
A rigorous and well-organised search of the literature will be performed to determine the current evidence on the epidemiology of s-GAS infections in Australia. As outlined above, all efforts will be taken to reduce bias and produce a collection of papers for a reliable and valid meta-analysis of the current data. Ultimately, the results of this paper will guide the allocation of health resources to areas where the development of preventative measures will most greatly reduce the burden of s-GAS infections and post-Streptococcal sequelae.
Supporting information
S2 Appendix. Data extraction points and definitions.
https://doi.org/10.1371/journal.pone.0255789.s002
(DOCX)
S3 Appendix. Joanna Briggs Institute critical appraisal checklist for studies reporting prevalence data.
https://doi.org/10.1371/journal.pone.0255789.s003
(DOCX)
Acknowledgments
The authors would like to acknowledge and thank Ms Stephanie Enkel, Dr Asha Bowen, Mr Jeffrey Cannon (Telethon Kids Institute) and Mr Bede van Schaijik (University of Western Australia) for their assistance in the design of the search strategy for this protocol. Advisory support from the Telethon Kids Institute was provided in the development of this protocol. No funding was received for the development of this protocol.
References
- 1. Cannon JW, Jack S, Wu Y, Zhang J, Baker MG, Geelhoed E, et al. An economic case for a vaccine to prevent group A streptococcus skin infections. Vaccine. 2018;36(46):6968–78. pmid:30340879
- 2. Ralph A, Carapetis J. Group A Streptococcal Diseases and Their Global Burden Host-Pathogen Interactions in Streptococcal Diseases. Curr Top Microbiol. 2013;368:1–27.
- 3. Bowen A, Mahé A, Hay R, Andrews R, Steer A, Carapetis J, et al. The Global Epidemiology of Impetigo: A Systematic Review of the Population Prevalence of Impetigo and Pyoderma. PLoS ONE. 2015;10(8):1–15. pmid:26317533
- 4. Davidson L, Knight J, Bowen AC. Skin infections in Australian Aboriginal children: a narrative review. Med J Aust. 2020;212(5):231–7. pmid:31630410
- 5. Romani L, Steer A, Whitfeld M, Kaldor J. Prevalence of scabies and impetigo worldwide: a systematic review. Lancet Infect Dis. 2015;15(8):960–7. pmid:26088526
- 6. Hendrickx D, Bowen AC, Marsh JA, Carapetis JR, Walker R. Ascertaining infectious disease burden through primary care clinic attendance among young Aboriginal children living in four remote communities in Western Australia. PLOS ONE. 2018;13(9):e0203684. pmid:30222765
- 7. Yeoh DK, Anderson A, Cleland G, Bowen AC. Are scabies and impetigo "normalised"? A cross-sectional comparative study of hospitalised children in northern Australia assessing clinical recognition and treatment of skin infections. PLoS Negl Trop Dis. 2017;11(7):e0005726. pmid:28671945
- 8. McMeniman E, Holden L, Kearns T, Clucas DB, Carapetis JR, Currie BJ, et al. Skin disease in the first two years of life in Aboriginal children in East Arnhem Land. Australas J Dermatol. 2011;52(4):270–3. pmid:22070701
- 9. Carapetis J, Johnston F, Nadjamerrek J, Kairupan J. Skin sores in Aboriginal children. J Paediatr Child Health. 1995;31(6):563. pmid:8924314
- 10. Van Buynder PG, Gaggir JA, Martin D, Pugsley DJ, Mathews JD, Menzies R. Streptococcal infection and renal disease markers in Australian aboriginal children. Med J Aust. 1992;156(8):537–40. pmid:1565046
- 11. Nimmo GR, Tinniswood RD, Nuttall N, Baker GM, McDonald B. Group A streptococcal infection in an aboriginal community. Med J Aust. 1992;157(8):521–2. pmid:1479971
- 12. Hartman-Adams H, Banvard C, Juckett G. Impetigo: Diagnosis and Treatment. Am Fam Physician. 2014;90(4):229–35. pmid:25250996
- 13.
The Australian Healthy Skin Consortium. National healthy skin guideline for the prevention, treatment and public health control of impetigo, scabies, crusted scabies and tinea for Indigenous populations and communities in Australia (1st edition). 2018.
- 14. Steer A, Jenney A, Kado J, Batzloff M, La Vincente S, Waqatakirewa L, et al. High Burden of Impetigo and Scabies in a Tropical Country. PLoS Negl Trop Dis. 2009;3(6):e467. pmid:19547749
- 15.
Howarth T, Kearns T. Strongyloidiasis, Scabies and Impetigo–Household Clustering In A Northern Territory Community. Darwin: Charles Darwin University; Nov 2016.
- 16. Mason DS, Marks M, Sokana O, Solomon AW, Mabey DC, Romani L, et al. The Prevalence of Scabies and Impetigo in the Solomon Islands: A Population-Based Survey.(Report). PLoS Negl Trop Dis. 2016;10(6):e0004803. pmid:27348119
- 17. May P, Tong SYC, Steer A, Currie B, Andrews R, Carapetis J, et al. Treatment, prevention and public health management of impetigo, scabies, crusted scabies and fungal skin infections in endemic populations: a systematic review. Trop Med Int Health. 2019;24(3):280–93. pmid:30582783
- 18. Andrews RM, Kearns T, Connors C, Parker C, Carville K, Currie BJ, et al. A regional initiative to reduce skin infections amongst aboriginal children living in remote communities of the Northern Territory, Australia. PLoS Negl Trop Dis. 2009;3 (11) (no pagination)(e554). pmid:19936297
- 19.
Healthcare Planning and Evaluation (Firm) & Australia. Evaluation of the sustainability and benefits of swimming pools in the Anangu Pitjantjatjara Yankunytjatjara Lands (APY Lands) in South Australia: final report. Canberra A.C.T: Australian Government; 2009.
- 20. Carapetis RJ, Connors JC, Yarmirr JD, Krause JV, Currie JB. Success of a scabies control program in an Australian Aboriginal community. Pediatr Infect Dis J. 1997;16(5):494–9. pmid:9154544
- 21.
Telethon Institute for Child Health Research. The Swimming Pool Study. Telethon Kid’s Institute; 2006.
- 22.
Sullivan B, Rubin T, Scarr J. Swim for life Nauiyu—Aquatic recreation project. In: Sharp M, Franklin R, editor. Australian Water Safety Conference Sydney: Australian Water Safety Council; 2008.
- 23. Tasani M, Tong SY, Andrews RM, Holt DC, Currie BJ, Carapetis JR, et al. The Importance of Scabies Coinfection in the Treatment Considerations for Impetigo. Pediatr Infect Dis J. 2016;35(4):374–8. pmid:26599569
- 24. Dallas A, van Driel M, Morgan S, et al. Antibiotic prescribing for sore throat: a cross-sectional analysis of the ReCEnT study exploring the habits of early-career doctors in family practice. Fam Pract. 2016;33(3):302–8. pmid:26993484
- 25. McCullough A, Pollack AJ, Plejdrup , Hansen M, et al. Antibiotics for acute respiratory infections in general practice: comparison of prescribing rates with guideline recommendations. Med J Aust. 2017;207(2):65–9. pmid:28701117
- 26. Oliver J MWE, Pierse N, et al. Streptococcus pharyngitis and pharyngeal carriage: a meta-analysis. PLoS Negl Trop Dis. 2018;12(e0006335.). pmid:29554121
- 27. Shaikh N LE, Martin JM. Prevalence of streptococcal pharyngitis and streptococcal carriage in children: a meta-analysis. Pediatrics. 2010;126:557–64. pmid:20696723
- 28. Carapetis J. Epidemiology of group A streptococcus in Australia. Microbiol Australia 2009(30):171–6.
- 29. Amgarth-Duff I, Hendrickx D, Bowen A, Carapetis J, Chibawe R, Samson M, et al. Talking skin: attitudes and practices around skin infections, treatment options, and their clinical management in a remote region in Western Australia. Rural and remote health. 2019;19(3):5227. pmid:31540550
- 30. Oliver J, Thielemans E, McMinn A, Baker C, Britton PN, Clark JE, et al. Invasive group A Streptococcus disease in Australian children: 2016 to 2018 –a descriptive cohort study. BMC Public Health. 2019;19(1):1750. pmid:31888568
- 31. Ilyas M TA. Changing epidemiology of acute post-streptococcal glomerulonephritis in Northeast Florida: a comparative study. Kidney Int. 2008;23(7):1101–6. pmid:18373105
- 32. McDonald MI, Towers RJ, Andrews RM, Benger N, Currie BJ, Carapetis JR. Low rates of streptococcal pharyngitis and high rates of pyoderma in Australian aboriginal communities where acute rheumatic fever is hyperendemic. Clin Infect Dis. 2006;43(6):683. pmid:16912939
- 33. O’Sullivan JL, Moreland HN, Webb JR, Upton JA, Wilson JN. Acute Rheumatic Fever After Group A Streptococcus Pyoderma and Group G Streptococcus Pharyngitis. Pediatr Infect Dis J. 2017;36(7):692–4. pmid:28121967
- 34. Bessen D, Carapetis JR, Beall B, Katz R, Hibble M, Currie BJ et al. Contrasting molecular epidemiology of Group A Streptococci causing tropical and nontropical infections of the skin and throat. J Infect Dis. 2000;182(4):1109–16. pmid:10979907
- 35. Williamson D, Smeesters PR, Steer AC, Steemson JD, Ng AC, Proft T et al. M-Protein Analysis of Streptococcus pyogenes isolates associated with acute rheumatic fever in New Zealand. J Clin Microbiol. 2015;53(11):3618–20. pmid:26292296
- 36. Francis J, Gargan C, Remenyi B, et al. A cluster of acute rheumatic fever cases among Aboriginal Australians in a remote community with high baseline incidence. Aust N Z J Public Health. 2019;43(3):288–93. pmid:30994967
- 37.
Australian Institute of Health Welfare. Acute rheumatic fever and rheumatic heart disease in Australia. Canberra: AIHW; 2019.
- 38. Hoy W, White AV, Dowling A, Sharma SK, Bloomfield H, Tipiloura BT, et al. Post-streptococcal glomerulonephritis is a strong risk factor for chronic kidney disease in later life. Kidney Int. 2012;81(10):1026–32. pmid:22297679
- 39. Ramanathan G, Abeyaratne A, Sundaram M, Fernandes DK, Pawar B, Perry GJ, et al. Analysis of clinical presentation, pathological spectra, treatment and outcomes of biopsy-proven acute postinfectious glomerulonephritis in adult indigenous people of the Northern Territory of Australia. Nephrology (Carlton). 2017;22(5):403–11.
- 40. Wong W, Morris MC, Zwi J. Outcome of severe acute post-streptococcal glomerulonephritis in New Zealand children. Pediatric nephrology (Berlin, Germany). 2009;24(5):1021–6. pmid:19096879
- 41. White AV, Hoy WE, McCredie DA. Childhood post-streptococcal glomerulonephritis as a risk factor for chronic renal disease in later life. Med J Aust. 2001;174(10):492–6. pmid:11419767
- 42. Chaturvedi S, Boyd R, Krause V. Acute Post-Streptococcal Glomerulonephritis in the Northern Territory of Australia: A Review of Data from 2009 to 2016 and Comparison with the Literature. Am J Trop Med Hyg. 2018;99(6):1643–8. pmid:30398135
- 43. Shamseer L MD, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, et al, PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols. BMJ. 2015;349(1):7647.
- 44. Stroup DF BJ, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000;283(15):2008–12. pmid:10789670
- 45. Köppen W. Versuch einer Klassifikation der Klimate, vorzugsweise nach ihren Beziehungen zur Pflanzenwelt. Geogr Z. 1900;6:593–611.
- 46. Kottek MG J.; Beck C.; Rudolf B.; Rubel F.. World map of the Köppen-Geiger climate classification updated. Meteorol Z. 2006;15:256–63.
- 47. al. Me. Prevalence Estimates Reviews–Systematic Review Methodology Group (PERSyst). Quality assessment of prevalence studies: a systematic review. J Clin Epidemiol 2020;127:59–68. pmid:32679313
- 48.
Deeks J, Higgins JPT, Altman DG (editors). Chapter 10: Analysing data and undertaking meta-analyses. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019). Cochrane. 2019.
- 49.
Joanna Briggs Institute. The Joanna Briggs Institute critical appraisal tools for use in JBI systematic reviews: checklist for prevalence studies. 2017.