Figures
Abstract
During the course of the 2015–2017 outbreak of Zika virus (ZIKV) in the Americas, the emerging virus was recognized as a congenital infection that could damage the developing brain. As the Latin American ZIKV outbreak advanced, the scientific and public health community questioned if this newly recognized neurotropic flavivirus could affect the developing brain of infants and young children infected after birth. We report here the study design, methods and the challenges and lessons learned from the rapid operationalization of a prospective natural history cohort study aimed at evaluating the potential neurological and neurodevelopmental effects of postnatal ZIKV infection in infants and young children, which had become epidemic in Central America. This study enrolled a cohort of 500 mothers and their infants, along with nearly 400 children 1.5–3.5 years of age who were born during the initial phase of the ZIKV epidemic in a rural area of Guatemala. Our solutions and lessons learned while tackling real-life challenges may serve as a guide to other researchers carrying out studies of emerging infectious diseases of public health priority in resource-constrained settings.
Author summary
During the 2015–17 Zika outbreak in the Americas, many research sites struggled to rapidly establish cohorts to study the neurodevelopmental outcomes of exposed infants and children, due to both logistical difficulties and a lack of appropriately adapted/validated neurodevelopmental tools. During this time period, we conducted a study evaluating the neurodevelopmental outcomes of post-natal ZIKV and dengue virus (DENV) infection among of infants (<3 months at enrollment) and children (1.5–3.5 years at enrollment) at a site in rural, southwest Guatemala. The study, which enrolled a cohort of 500 mother-infant pairs and 400 children, was a collaborative effort that leveraged expertise at multiple institutions to rapidly implement a study protocol in a resource-limited region of Guatemala. In this Methods paper, we describe the study methodology, how we implemented our research protocol in this rural, resource-limited community, and challenges and lessons learned during its operationalization. Specifically, we address how we adapted neurodevelopmental testing tools to the local language and cultural context, trained and managed a research team recruited from the local community, maintained competency and quality control in this workforce, developed critical laboratory infrastructure, and engaged with local community stakeholders. Our approach may serve as a guide to other researchers carrying out future studies focusing on child neurodevelopment as well as clinical evaluation of ZIKV and other emerging infectious diseases of public health priority.
Citation: Paniagua-Avila A, Olson D, Connery A, Calvimontes DM, Bolanos GA, Lamb MM, et al. (2022) Challenges and lessons learned from the rapid operationalization of a prospective cohort to study the natural history and neurodevelopmental outcomes of postnatal Zika virus infection among infants and children in rural Guatemala. PLoS Negl Trop Dis 16(11): e0010480. https://doi.org/10.1371/journal.pntd.0010480
Editor: Pierre Buekens, Tulane University, UNITED STATES
Received: May 13, 2022; Accepted: September 28, 2022; Published: November 16, 2022
Copyright: © 2022 Paniagua-Avila et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This work was supported by a National Institutes of Allergy and Infectious Diseases at the National Institutes of Health contract funding to the Vaccine and Treatment Evaluation Units (VTEUs) at Baylor College of Medicine HHSN272201300015I. Task Order No. HHSN27200013-16-0057.C1D1.0058. DO received funding from the National Institute of Allergy and Infectious Diseases at the National Institutes Task Order No. 1K23AI143967-01. Agro-America and the Center for Global Health at the University of Colorado provided ongoing funding for the Center for Human Development and the Creciendos Sanos Program at FUNSALUD from where the study was implemented and operationalized. REDCap utilization was supported by NIH/NCRR Colorado CTSI Grant Number UL1 RR025780. NIAID provided salary support with this grant to AP, DO, AC, DMC, GB, ML, DB, AR, NR, EB, AC, MG, PA, SH, MM, SB, AC, KA, GB, AH, FM, EA. NIAID staff provided recommendations in the design and analysis of the study.
Competing interests: The authors have declared that no competing interests exist.
Introduction
In 2015, an outbreak of Zika virus (ZIKV) was reported in Brazil and other Latin American countries [1]. Within months, the World Health Organization (WHO) declared the epidemic a Public Health Emergency of International Concern, due to its association with microcephaly and other neurological disorders [1]. ZIKV is now recognized as a congenital infection that can damage the developing brain, resulting in numerous sequalae known as Congenital Zika Syndrome (CZS) [2]. In addition to microcephaly, CZS is associated with eye abnormalities, hearing loss, seizures, and other health conditions [3]. Even in the absence of physical abnormalities, CZS may cause abnormal neurodevelopment, similar to other congenital infections such as rubella and CMV [3,4]. As the ZIKV outbreak advanced, the scientific and public health community asked if this newly recognized neurotropic flavivirus could also affect the developing brain if contracted by infants and young children after birth.
The National Institute of Allergy and Infectious Diseases (NIAID), through the Vaccine and Treatment and Evaluation Unit (VTEU) network supported our proposal to assess the neurological and neurodevelopmental impact of postnatal ZIKV infection in infants and young children. The Center for Human Development (CHD) of the Fundación para la Salud Integral de los Guatemaltecos (FUNSALUD), which had an ongoing maternal-child health program, “Creciendo Sanos,” had ample experience with active surveillance for dengue virus (DENV) infections and was well positioned to carry out this study [5]. The earliest known case of ZIKV infection was reported in this region of Guatemala in April of 2015 [6,7]. Consequently, the University of Colorado (CU), Baylor College of Medicine (BCM) and CHD partnered to design and conduct this prospective natural history cohort study to evaluate the neurological and neurodevelopmental effects of postnatal Zika virus infection.
The first section of this manuscript describes the study methods and study procedures as described in the study protocol and manual of procedures. The second section describes the challenges and lessons learned from the rapid operationalization of a large prospective cohort study in response to the ZIKV epidemic in a rural, resource-limited setting in Guatemala. Our approach to overcoming real-life challenges encountered in a resource-constrained setting may serve as a guide to other researchers carrying out future studies of ZIKV and other emerging infectious diseases of public health priority. Results from the study described in this paper will be published in a future manuscript.
Prospective cohort study methods and procedures
The following section describes the study objectives, study population and study procedures as described in the study protocol and manual of procedures (MOP).
Study objectives
The primary objective of this prospective natural history cohort study was to characterize the acute and post-acute clinical, neurological and neurodevelopmental outcomes of postnatally-acquired, laboratory-confirmed ZIKV infection in newborn infants and their mothers (infant-mother pairs), as well as older children ages 1.5–3.5 years old who may have been postnatally exposed to ZIKV during the 2015–2017 outbreak. The study also aimed to describe the clinical characteristics, viral load and kinetics of humoral immune responses during acute laboratory-confirmed ZIKV infection in infants and young children, including the potential for antibody-dependent enhancement (ADE) during acute ZIKV infection in those previously exposed to or with maternally-derived antibodies against DENV.
Study population
Children and mothers were enrolled from 22 communities, living within a 200 km2 area in the southwest Trifinio (SWT) region of Guatemala, a rural lowland area that borders Chiapas, Mexico and is hyperendemic for vector-borne infections [8] A community needs assessment conducted in 2012 identified high levels of food insecurity, poverty, poor access to healthcare, and high maternal-child morbidity and mortality in this area [5]. In 2013, as a response to the needs assessment, CHD, an academic-private global health partnership (CU and AgroAmerica), began implementing clinical services and community maternal-child programs to register and follow pregnant women and their children under 3 years of age to improve child growth and development [9,10]
Eligibility criteria
Infant-mother pairs (cohorts B and M, respectively) were eligible if the child was 0–2.9 months of age, and the mother was ≥16 years of age. Informed consent was signed by the mother if ≥18 years old. If the mother was 16–17 years of age a grandparent signed the informed consent and the mother provided assent (as per local ethics committee requirements). Older children 1.5–3.5 years of age at enrollment were eligible if they either participated in a prior 2015–2016 dengue acute febrile illness (AFI) surveillance study (cohort A) or were a sibling of an infant enrolled in cohort B (cohort C), and consent for participation in this study was signed by one of the parents.
Methods
Ethics statement
The study was granted approval by the Institutional Review Boards (IRBs) of Baylor College of Medicine (BCM), University of Colorado (CU) Multiple IRB (COMIRB), and the Ministry of Public Health and Social Welfare (MSPAS) of Guatemala in May of 2017. All study participants provided guardian informed consent prior to initiating study activities.
Participant enrollment
Infant-mother pairs were screened and enrolled from the CHD maternal and child health program and from referrals of pregnant women who were close to delivery or had delivered an infant in the previous two months by community health workers. Children 1.5–3.5 years of age who previously participated in the dengue AFI surveillance study were contacted for enrollment in this study.
Baseline and follow-up visits
At baseline, we recorded demographic information, including each child’s date of birth, sex, birth weight (if available), gestational age (reported by mother), household location and household characteristics. We also documented medical history and information about initiation of breastfeeding and history of vaccinations. The child’s length, weight, and head circumference were measured using WHO’s recommended procedures [11].Baseline physical, neurological, neurodevelopmental, ophthalmologic visual acuity, anterior segment and fundoscopy, and hearing otoacoustic emissions (OAE) evaluations were conducted in all infants and children. For mothers, prenatal and delivery history along with past medical history were obtained, as well as measurements of mother’s height and weight. Biological samples (blood, urine, and saliva) were collected from all children, infants and their mothers. Breastmilk was also collected from mothers if available.
Protocol-required household visits at various intervals were conducted by trained study staff at the subjects’ homes or at the study clinic in order to collect health data and to perform anthropometric measurements, clinical and neurological exams, neurodevelopmental tests, and ophthalmologic and hearing evaluations. Blood, urine and breast milk samples were also collected during household visits (Table 1).
ZIKV and DENV case ascertainment
Both ZIKV and DENV infections can be asymptomatic or subclinical in 70–80% of the infected population, or present as an acute illness with or without fever [12,13]. Therefore, we conducted active illness surveillance using a case definition of flavivirus-like illness (FLI) which included two or more of the following signs or symptoms: fever >38.0° C for ≥ 2 days, rash, conjunctivitis (non-purulent/hyperemic), arthralgia, myalgia, or peri-articular edema for ≥ 1 day. Surveillance was conducted by weekly home visits with collection of saliva samples every other week, regardless of the presence of symptoms (Fig 1). Caregivers responded to a standardized questionnaire designed to document the presence of FLI and other Integrated Management of Childhood Illness (IMCI) danger signs [14]. If a child or mother met defined FLI criteria, blood, urine and saliva samples were collected within 72 hours of illness report and a second time at the 2nd, 3rd or 4th week after the first visit to evaluate seroconversion. The timing of the second visit was selected at random for each study subject.
Results
Challenges and lessons learned during the operationalization of the study protocol
After providing an overview of the study procedures, the following section describes the challenges, solutions and lessons learned as our team operationalized the study protocol. To identify challenges and solutions, our team of investigators (EA, FM, DO, MC) and study coordinators (AP, NR, EB, DB) held meetings after completing the enrollment phase to develop a comprehensive list of the most salient challenges faced during the study operationalization, which were summarized and iteratively reviewed by the study team until no other challenges were identified. For each of the challenges, we describe at least one solution that was implemented by our team. To accurately describe such solutions, the first author (AP) revised the manuals of procedures, minutes from team meetings held since the start of the study, administrative documents, and emails that documented key decisions on study operationalization made by the study team. We grouped challenges and solutions into the following categories: neurodevelopmental assessments, human resources, bioethical procedures, community engagement, data collection and quality control (See Table 2). Through a process of team discussions and reflections based on our experience conducting the present study and multiple other studies in Guatemala and other LMICs, we identified overarching lessons learned and recommendations that may guide other researchers and clinicians conducting prospective multi-disciplinary studies in other low-resource settings in response to emerging infections (See Table 3).
Adapting instruments for neurodevelopment assessments
While many options for neurodevelopmental assessment exist in higher-income countries, few tests have been standardized and validated for use in low resource areas, and none for the Guatemalan population and our study population age range [15,16].As this study aimed to evaluate children while the ZIKV epidemic was ongoing, the development of a new neurodevelopmental measure, which can take several years, was deemed impractical [17–19]. The process of the selection, translation, cultural adaptation, and use of neurodevelopmental measures for this study has been previously described in detail [20]. In brief, a multi-disciplinary team composed of psychologists with content, cultural, and local expertise, along with neuropsychologists from the UC, selected the most appropriate test from existing tools, considering the relevance of these developmental domains in the local community and the developmental domains targeted by the study. We selected the Mullen Scales of Early Learning (MSEL) as our primary performance-based developmental assessment measure. We also used two parent report measures: the Pediatric Quality of Life Questionnaire (PedsQL), which is a measure of health-related quality of life available in Mexican Spanish, and the Ages and Stages Questionnaire-Third Edition (ASQ3), a developmental screening tool available in Spanish. The MSEL was translated to Spanish and culturally adapted, while the PedsQL and ASQ3 were culturally adapted. Visual Likert scales were developed to aid parents’ understanding of questions and responses. Questionnaires were administered verbally to all parents to account for differences in levels of literacy and limited familiarity with neurodevelopmental assessments. Psychologists were trained in how to maintain standardization conducting assessments in a variety of settings, including our clinic, a converted bus, satellite clinics, and in the home. Data analysis demonstrated no significant differences in child performance between testing spaces. We conducted assessments of interrater reliability, internal consistency, and construct validity of the adapted and translated version of the MSEL among a subsample of 84 children 0–5 years old, which have been previously reported [21,22]. Our assessments showed strong psychometric properties suggesting that this test may be used validly and reliably within our population of children.
Training and managing human resources
Upon contract approval by NIH in January 2017, and due to the urgency to enroll participants in the study given the ongoing ZIKV epidemic, we proceeded to hire and train a physician who served as the study coordinator, three psychologists who adapted and conducted the neurodevelopmental evaluations, and one physician who conducted physical and neurological evaluations, focusing on personnel with expressed interest in research and public health. Two experienced research coordinators who held graduate degrees in nursing and were already hired by CHD became the field coordinators. We rapidly expanded our team from 4 to 20 study nurses who held graduate and technical-level degrees in nursing) and three new data managers, who were graduates from business administration or accounting due to the scarcity of trained data managers at the study site. Forty community health workers who were mothers recognized as leaders in the community, were financially compensated to serve as the bridge between study nurses and community members, helping to disseminate information about the study, identifying potential participants, sending study visits reminders, and communicating community concerns to the study team. All personnel, including community health workers, were trained in NIH human subjects protection (HSP), Good Clinical Practices (GCP) and principles of clinical research following the NIH regulatory training, the Special Programme for Research and Training in Tropical Diseases (TDR) Global Competency Framework for Clinical Research, and the WHO Ethics in epidemics, emergencies and disasters: Research, surveillance and patient care manual [23,24].
The study manual of procedures (MOP) and various standard operation procedures (SOPs) were developed, reviewed and refined as needed during the study operationalization. Study coordinators developed checklists summarizing visits and key procedures (e.g., enrollment visit, informed consent process, specimen collection and transport, data collection and electronic data entry) to train, supervise and provide feedback to the research staff on an ongoing basis. To ensure the implementation of multiple and complex procedures as required by the study protocol, we created competency-based sub-teams responsible for certain procedure clusters: recruitment and enrollment visits, symptomatic surveillance, FLI visits, and follow-up visits. Each sub-team included 2–6 study nurses and one field coordinator (Fig 1). Weekly and daily specific and measurable goals were established and monitored by each field coordinator to ensure that enrollment, retention and study procedures goals were met.
Psychologists received on-site training from a CU neuropsychologist at the start of the study and then periodically throughout. Weekly videoconferencing, video reviews of assessments, and quality checks then occurred to ensure high quality neurodevelopmental assessments. As the number of study visits and procedures increased, we trained one group of nurses on physical examination and another group to conduct ASQ3 and PedsQL assessments with supervision by physicians and psychologists. This division of labor allowed us to complete procedures in a rapidly growing number of study subjects (Fig 2) within the required visit timeframes, while psychologist and physicians focused on more complex procedures and complicated cases.
A mentorship and training network with PIs, co-PIs and coordinators was established, to promote interest in research and public health among study staff. A strong culture of community service, continued learning and improvement, and team-based work was promoted throughout the study. This shared spirit ensured that study personnel stayed motivated to collaborate among sub-teams, and meet demanding study goals in a challenging environment.
Engaging community members
The community-based nature of this cohort study and the need to include villages in the study that were not familiar with CHD activities, required strong community engagement. During the 5-month preparatory phase, study coordinators and research nurses met with members of the local CABR and leaders of each of the 22 participating communities to explain the purpose and procedures of the study and to obtain feedback for its deployment. CHD established the CABR in 2015 to engage the local communities in all research and programmatic activities. The board is composed of community and religious leaders, teachers, and public health-post nurses who were trained by a consultant from the Colorado Multiple Institutional Review Board (COMIRB) on how to review research studies and advocate for their communities. Research nurses from the participating communities provided their local expertise and helped enhance the study buy-in. Local leaders, midwives and nurses identified and referred potential study participants and maintained communication with families enrolled in the study. Community collaborators were trained on the essentials of GCP and Human Subjects Protection by an anthropologist from CU.
Adapting bioethical procedures to local context
Communities in SWT are characterized by involving community leaders and families in decision making. For this reason, it was important to socialize the study informed consent to communities and families, before individuals’ consenting. Prior to initiating research activities, lead study staff obtained community buy-in by presenting and discussing the study aims, procedures, and potential risks and benefits with community leaders. A simple and culturally-appropriate visual informed consent tool (available on request) was used to explain the study objectives and procedures in Spanish (the local language) to potential participants, highlighting the differences between research and healthcare services to families with low literacy levels and limited or no previous exposure to medical research. Informed participants older than 18 years old provided informed consent prior to study procedures. If participating mothers were 16 to 17 years old, informed consent was obtained from one of their parents and assent was provided by the mother. If the participant providing consent was illiterate, a third party witnessed the consent process and signed the informed consent form, while the participant provided thumbprints. Our approach to community engagement and bioethical procedures facilitated the enrollment of 500 infants along with nearly 400 children 1.5–3.5 years of age with a high percentage of enrolled-to-screened participants and a low percentage of lost to follow-up participants. Results will be published in a future manuscript.
Dissemination of final results (aggregated and individual results to participants) was planned in collaboration with the Community Advisory Board for Research (CABR), community leaders and local public health facilities.
Collecting data and ensuring quality control
The study catchment area covered a large geographic zone, with deteriorated roads and limited transportation. For this reason, reducing participant mobilization and finding alternative sites, other than CHD clinic, to conduct study visits was needed. Visits were therefore conducted at multiple settings, including satellite clinics, a converted bus and participant’s homes. In order to collect large amounts of data in a location with limited access to internet, an electronic, smartphone-based CommCare app (Dimagi, Cambridge, MA, USA) was developed. Study staff collected data online or offline and uploaded it to an electronic server in real-time or as soon as internet was available, at least once daily. Research nurses completed most questionnaires (e.g., sociodemographic, medical history, illness visits, etc.), while trained psychologists and physicians documented neurodevelopmental and medical evaluations into paper-based source documents and later entered in the CommCare mobile application. In addition, information related to clinical visits and hospitalizations since the previous study visit was collected and entered into a secure local electronic REDCap database (Vanderbilt University, TN, USA) if participants consented.
To ensure adherence to GCP standards, a quality control plan was developed with a priority list of indicators for quality assurance. The quality control coordinator reviewed all the informed consent forms and 10–20% of the individual study records, conducting a comparison audit of the paper-based forms and the electronic databases. We aimed for 100% compliance with informed consent indicators. As data were entered in real-time, all completed data collection forms were reviewed daily by study coordinators. In addition, The Emmes Company, LLC, a data management group, updated online process quality reports daily or weekly allowing local data managers to address data issues (e.g., missing or duplicated forms, missing or extreme values, unexpected specimen samples) on an ongoing basis. Site specific report logs were maintained in a secure file sharing Website that provided real-time, site-specific feedback to identify errors and/or omissions in data entry and to facilitate corrections with minimal time delay.
Study coordinators conducted staff refresher trainings every two months as well as monthly field supervision of study staff procedures and data collection, while study investigators conducted random spot-checks of field work and home visits. Feedback through on-the-spot discussion of supervisors’ findings, weekly staff meetings, and monthly written reports to all staff and external collaborators was done with the aim of ensuring high quality performance of study procedures.
During weekly meetings, study progress, challenges and solutions were discussed among leaders from the field team, CU, Baylor University, Emmes, and NIH representatives. In addition, principal investigators conducted monthly on-site supervisions.
Building laboratory capacity for biological sample collection and processing
Trained research nurses collected blood, saliva, urine and breast milk samples at the participants’ households or at the satellite clinics per study protocol (Table 1). Given the high ambient temperature (25–38°C), long transit times and harsh environment at SWT, a strict protocol for ensuring quality collection of samples and maintaining cold chain in the field was developed, allowing for 95% of samples to meet with temperature requirements. Whole blood was collected in EDTA tubes for ZIKV and DENV serologic and molecular testing and processed to obtain plasma for ZIKV serologic and molecular testing, and other congenital infections. Saliva was collected using a CultureSwab Collection and Transport System by brushing the participants’ cheek and soaking it with saliva for at least 20 seconds, and the sample was then mixed with 200 uL of Invitrogen (Thermo Fisher Scientific, Carlsbad, CA) nucleic acid stabilizer buffer. Urine and breast milk samples for ZIKV molecular testing were collected in sterile containers. All samples were transported in temperature-controlled portable coolers and delivered to the study laboratory for storage at 2–8°C until processing. Samples were stored at -80°C from processing until international shipment. Retained blood samples included whole blood and plasma aliquots. Samples were shipped periodically to the NIH sample repository (Fisher Bioservices, Maryland, USA) preserving the cold chain and following international guidelines for shipping biologic materials. Specimen analyses included IgM, IgM, neutralizing antibodies and PCR.
In 2015, the CHD began enhancing its research capacity by building a 500 square foot (sqf) research laboratory and 1500 sqf research operations area for personnel, data management, secure document storage and meetings, with the support of the CU Strategic Initiative for Research. While the CHD has a connection to the power grid and a high-capacity generator, the stability of energy supply was reinforced by two additional generators to safeguard samples stored at the laboratory. During the conduct of this study, a solar-based energy system was installed. The laboratory had the capacity to process and store approximately 10,000 samples or aliquots, stored at -20°C or -80°C.
Discussion
We described the rapid, intensive, and successful operationalization of a unique population-based prospective cohort study in a low-resource setting in rural Guatemala during the emergence of ZIKV in the Americas.
Our team faced multiple challenges due to the fast-paced nature of our work, large amounts of complex study procedures, and a study setting in a large geographic region, with high poverty rates, low literacy levels, and limited access to healthcare. Most importantly, we dealt with the very limited research infrastructure and resources that characterizes countries like Guatemala, and especially rural regions like SWT, where this study was conducted [25]. Despite these challenges, we operationalized the study protocol by translating the study objectives into an implementation plan that outlined the key milestones, activities and inputs, considered the local needs and assets, and included risk management and troubleshooting mechanisms [26]. Our plan focused on the areas of adaptation of neurodevelopmental assessments, human resources, bioethical procedures, community engagement, data collection and quality control, and collection of biological samples. Just as important as the main goals of a study with vulnerable participants is how one goes about achieving such goals. From planning to implementation, our overarching priorities were to develop culturally-appropriate study procedures, to respect and collaborate with community members, and to build sustainable local research capacity, while ensuring that GCP and NIH standards of research were met.
Population-based studies with well-defined denominators, like our study, have the ability to provide incidence rates of emerging infectious diseases, their consequences and other relevant outcomes in low-resource settings. For example, this study can provide information on the incidence of microcephaly and neurodevelopmental outcomes, which are increasingly being documented in low-resource settings [10,27]. In addition, our results will help untangle the possible associations and interactions between microcephaly and neurodevelopmental outcomes and health determinants like poverty, malnutrition, and recurrent illnesses and infections. In parallel to our study, three other studies were launched in the region: the Centers for Disease Control and Prevention conducted a facility-based observational study on the clinical and virological manifestations of postnatal ZIVK (PMID: 29813148) [28], the prospective pregnancy cohort study of Zika in Infants and Pregnancy (ZIP) in six endemic countries (Brazil, Colombia, Guatemala, Nicaragua, Puerto Rico and Peru), which included follow up of thee infants up to one year of age (PMID: 31391005) [29], and a case-control study evaluating the association between prenatal ZIKV and microcephaly at birth in Honduras [30]. In contrast to our study, these projects focused on congenital Zika and recruited participants from healthcare facilities, rather than communities. A recently published systematic review of postnatal symptoms and neurological complications of postnatal ZIVK highlighted the scarcity and quality of published data, calling for prospective studies to improve our understanding of the frequency of signs, symptoms and complications of ZIKV exposure, and to investigate potential effects of ZIKV on neurodevelopment [31].
As an example of developing culturally-appropriate study procedures, the neurodevelopmental assessments were selected from standardized measures in high-income countries, translated to Spanish and adapted to the local culture. Verbal administration of neurodevelopmental questionnaires and visual aids for Likert scales facilitated parental understanding of questions and addressed the local limited literacy levels. The inclusivity and adaptation of the informed consent process to ensure community engagement and participation allowed us to meet GCP and bioethics standards [20]. Developing strong community engagement, including participation of community leaders and other stakeholders, enabled us to accomplish an 85% retention of study participants despite the heavy participant burden of weekly home visits and twice weekly sample collections. Engagement of the community does not end with the successful operationalization and conduct of the study; it needs to be followed by a process of feedback as well as frequent dissemination of study results to community leaders and participants throughout the study. This ensures the trust of the community in the process of research, provides an avenue for disseminating results, and promotes community participation in the inquiry of problems that affect them.
Assembling a highly trained and committed group of local researchers under the mentorship of experienced investigators is key to rapidly operationalize and sustain a study of this magnitude in the context of multiple local challenging conditions. Developing clear SOPs, forming sub-teams with specific roles, conducting well-planned trainings with frequent refreshers, performing on-site supervision and real-time feedback, and establishing strong team motivation for continuing education and career development are paramount to maintaining data quality and meeting study recruitment goals.
Population-health studies provide a unique opportunity to build local capacity and empower local investigators. Our study has provided many young nurses, who gained experience from well-structured ethical and research procedures trainings, with professional growth and special expertise that can help them contribute to enhancing local and regional clinical and public health practice. Many of our study supervisors have now advanced their careers by pursuing additional studies and degrees in epidemiology and public health, and they have grown to serve as study coordinators, laboratory managers, and data management coordinators, providing a positive circle of growth in which they serve as role models for young people and potentially become future leaders in their communities.
Acknowledgments
We thank all the members of study team, advisors, sponsors, and partners, especially SWT community members, parents and children whose support and participation made the study possible. We want to thank especially Dr. Walla Dempsey, Mary Smith, Gail Tauscher, Dr. Lisreina Toro, John Brett, Dr. Kathryn Colborn, Cristina del Hoyo, Agroamerica, and all the study and clinic staff at FUNSALUD.
References
- 1. Musso D, Ko A, Baud D. Zika Virus Infection—After the Pandemic. Published online October 4, 2019. pmid:31597021
- 2. Moore C, Staples J, Dobyns W, Pessoa A, Ventura C, Borges E, et al. Congenital Zika Syndrome: Characterizing the Pattern of Anomalies for Pediatric Healthcare Providers. JAMA Pediatr. 2017;171(3):288.
- 3. Pierson T, Diamond M. The emergence of Zika virus and its new clinical syndromes. Nat 2018 5607720. 2018;560(7720):573–581. pmid:30158602
- 4. Banatvala J, Brown D. Rubella. In: Lancet. Vol 363. Lancet; 2004:1127–1137.
- 5. Asturias E, Heinrichs G, Domek G, Brett J, Schick E, Cunningham J, et al. The Center for Human Development in Guatemala: An Innovative Model for Global Population Health. Adv Pediatr. 2016;63(1):357–387. pmid:27426907
- 6. Olson D, Lamb M, Lopez M, Colborn K, Paniagua-Avila A, Zacarias A, et al. Performance of a Mobile Phone App-Based Participatory Syndromic Surveillance System for Acute Febrile Illness and Acute Gastroenteritis in Rural Guatemala. J Med Internet Res. 2017;19(11):e368. pmid:29122738
- 7. Olson D, Lamb M, Zacarias A, Lopez M, Paniagua-Avila A, Samayoa-Reyes G, et al. Rapid active seroprevalence surveys as a tool to measure dengue virus disease burden in resource-limited settings. Published online 2016.
- 8. Departamento de Epidemiología. Situación Epidemiológica de Las Arbovirosis En Guatemala. Hasta La Semana Epidemiológica No. 8–2020.; 2020. http://epidemiologia.mspas.gob.gt/files/2020/salassituacionales/arbovirosis/SE082020.pdf
- 9. Domek G, Cunningham M, Jimenez-Zambrano A, Dunn D, Abdel-Maksoud M, Bronsert M, et al. Designing and Implementing an Early Childhood Health and Development Program in Rural, Southwest Guatemala: Lessons Learned and Future Directions. Adv Pediatr. 2017;64(1):381–401. pmid:28688599
- 10. Rick A, Domek G, Cunningham M, Olson D, Lamb M, Jimenez-Zambrano A, et al. High Background Congenital Microcephaly in Rural Guatemala: Implications for Neonatal Congenital Zika Virus Infection Screening. Glob Heal Sci Pract. 2017;5(4):686–696. pmid:29284702
- 11. WHO. Training Course on Child Growth Assessment.; 2008. https://www.who.int/childgrowth/training/module_b_measuring_growth.pdf?ua=1
- 12. Gordon A, Kuan G, Mercado JC, Gresh L, Aviles W, Balmaseda A, et al. The Nicaraguan Pediatric Dengue Cohort Study: Incidence of Inapparent and Symptomatic Dengue Virus Infections, 2004–2010. PLoS Negl Trop Dis. 2013;7(9):e2462–e2462. pmid:24086788
- 13. Duffy M, Chen T, Hancock W, Powers A, Kool J, Lanciotti R, et al. Zika virus outbreak on Yap Island, Federated States of Micronesia. N Engl J Med. 2009;360(24):2536–2543. pmid:19516034
- 14. World Health Organization. Integrated Management of Childhood Illnesses. Chart Booklet.; 2014. https://apps.who.int/iris/bitstream/handle/10665/104772/9789241506823_Chartbook_eng.pdf?sequence=16
- 15. Fernald L, Prado E, Kariger P, Raikes A. A toolkit for measuring early childhood development in low and middle income countries. Published online 2017:1–128.
- 16. Semrud-Clikeman M, Romero R, Prado E, Shapiro E, Bangirana P, John CC. Selecting measures for the neurodevelopmental assessment of children in low- and middle-income countries. Child Neuropsychol. 2017;23(7):761–802. pmid:27609060
- 17. Geisinger K. Cross-Cultural Normative Assessment: Translation and Adaptation Issues Influencing the Normative Interpretation of Assessment Instruments. Psychol Assess. 1994;6(4):304–312.
- 18. Hanlon C, Medhin G, Worku B, Tomlinson M, Alem M, Dewey M, et al. Adapting the Bayley Scales of infant and toddler development in Ethiopia: evaluation of reliability and validity. Child Care Health Dev. 2016;42(5):699–708. pmid:27381579
- 19. Hambleton R, Patsula L. Increasing the Validity of Adapted Tests: Myths to be Avoided and Guidelines for Improving Test Adaptation Practices | Hambleton | Journal of Applied Testing Technology. J Appl Test Technol. Published online 1999. Accessed April 14, 2020. http://www.jattjournal.com/index.php/atp/article/view/48345
- 20. K Connery A, Berrios-Siervo G, Arroyave P, Bauer D, Hernandez S, Paniagua-Avila A, et al. Responding to the Zika Epidemic: Preparation of a Neurodevelopmental Testing Protocol to Evaluate Young Children in Rural Guatemala. Am J Trop Med Hyg. 2019;100(2):438–444. pmid:30594262
- 21. Connery A, Colbert A, Lamb M, Hernandez S, Martinez M, Arroyave P, et al. Receptive language skills among young children in rural Guatemala: The relationship between the Test de Vocabulario en Imagenes Peabody and a translated and adapted version of the Mullen Scales of Early Learning. Child Care Health Dev. 2019;45(5):702–708. pmid:31270836
- 22. Colbert A, Lamb M, Asturias E, Munoz F, Bauer D, Arroyave P, et al. Reliability and Validity of an Adapted and Translated Version of the Mullen Scales of Early Learning (AT-MSEL) in Rural Guatemala. Child Care Health Dev. Published online February 3, 2020:cch.12748. pmid:31978249
- 23. WHO. Using the TDR Global Competency Framework for Clinical Research: A Set of Tools to Help Develop Clinical Researchers.; 2016.
- 24. WHO. Ethics in Epidemics, Emergencies and Disasters: Research, Surveillance and Patient Care.; 2015.
- 25. Lansang M, Dennis R. Building capacity in health research in the developing world. Bull World Health Organ. 2004;82(10). pmid:15643798
- 26. Cutts F, Enwere G, Zaman S, Yallop F. Operational challenges in large clinical trials: examples and lessons learned from the gambia pneumococcal vaccine trial. PLoS Clin Trials. 2006;1(3):e16. pmid:16871317
- 27. MAL-ED Network Investigators. Relationship between growth and illness, enteropathogens and dietary intakes in the first 2 years of life: findings from the MAL-ED birth cohort study. BMJ Glob Heal. 2018;2(4):e000370. pmid:29333282
- 28. Read J, Torres-Velasquez B, Lorenzi O, Rivera Sanchez A, Torres-Torres A, Rivera L, et al. Symptomatic Zika Virus Infection in Infants, Children, and Adolescents Living in Puerto Rico. JAMA Pediatr. 2018;172(7):686–693. pmid:29813148
- 29. Lebov J, Arias J, Balmaseda A, Britt W, Cordero J, Galvao L, et al. International prospective observational cohort study of Zika in infants and pregnancy (ZIP study): study protocol. BMC Pregnancy Childbirth. 2019;19(1):282. pmid:31391005
- 30. Buekens P, Alger J, Althabe F, Bergel E, Berrueta A, Bustillo C, et al. Zika virus infection in pregnant women in Honduras: Study protocol. Reprod Health. 2016;13(1):1–6. pmid:27423687
- 31. Ramond A, Lobkowicz L, Clemente NS, Aisling V, Dalva M, Wilder-Smith A, et al. Postnatal symptomatic Zika virus infections in children and adolescents: A systematic review. Charrel RN, ed. PLoS Negl Trop Dis. 2020;14(10):e0008612. pmid:33006989