Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Quantifying heterogeneities in arbovirus transmission: Description of the rationale and methodology for a prospective longitudinal study of dengue and Zika virus transmission in Iquitos, Peru (2014–2019)

  • Amy C. Morrison ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    amy.aegypti@gmail.com, acmorrison@ucdavis.edu

    Affiliation Department of Pathology, Microbiology, and Immunology, School of Veterinary Medicine, University of California, Davis, Davis, California, United States of America

  • Valerie A. Paz-Soldan,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Tropical Medicine, Tulane University School of Public Health and Tropical Medicine, New Orleans, Lousiana, United States of America

  • Gonzalo M. Vazquez-Prokopec,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Visualization, Writing – review & editing

    Affiliation Department of Environmental Sciences, Emory University, Atlanta, Georgia, United States of America

  • Louis Lambrechts,

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Writing – review & editing

    Affiliation Institut Pasteur, Université Paris Cité, CNRS UMR2000, Insect-Virus Interactions Unit, Paris, France

  • William H. Elson,

    Roles Data curation, Formal analysis, Investigation, Validation, Writing – review & editing

    Affiliation Department of Entomology and Nematology, University of California Davis, Davis, California, United States of America

  • Patricia Barrera,

    Roles Data curation, Investigation, Methodology, Supervision, Writing – review & editing

    Affiliations Department of Entomology and Nematology, University of California Davis, Davis, California, United States of America, Genomics Laboratory, Pontificia Universidad Católica del Peru, Lima, Peru

  • Helvio Astete,

    Roles Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliations Virology and Emerging Infections Department, United States Naval Medical Research Unit No. 6, Lima, Peru, Department of Entomology, United States Naval Medical Research Unit No. 6, Lima, Peru

  • Veronica Briesemeister,

    Roles Data curation, Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Department of Entomology and Nematology, University of California Davis, Davis, California, United States of America

  • Mariana Leguia,

    Roles Formal analysis, Investigation, Methodology, Validation, Writing – review & editing

    Affiliation Genomics Laboratory, Pontificia Universidad Católica del Peru, Lima, Peru

  • Sarah A. Jenkins,

    Roles Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Virology and Emerging Infections Department, United States Naval Medical Research Unit No. 6, Lima, Peru

  • Kanya C. Long,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Family Medicine and Public Health, University of California San Diego School of Medicine, La Jolla, California, United States of America

  • Anna B. Kawiecki,

    Roles Data curation, Investigation, Methodology, Software, Writing – review & editing

    Affiliation Department of Pathology, Microbiology, and Immunology, School of Veterinary Medicine, University of California, Davis, Davis, California, United States of America

  • Robert C. Reiner Jr.,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Writing – review & editing

    Affiliation University of Washington, Seattle, Washington, United States of America

  • T. Alex Perkins,

    Roles Conceptualization, Formal analysis, Investigation, Writing – review & editing

    Affiliation Department of Biological Sciences and Eck Institute for Global Health, University of Notre Dame, Notre Dame, Indiana, United States of America

  • Alun L. Lloyd,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Writing – review & editing

    Affiliation Biomathematics Graduate Program and Department of Mathematics, North Carolina State University, Raleigh, North Carolina, United States of America

  • Lance A. Waller,

    Roles Conceptualization, Formal analysis, Methodology, Writing – review & editing

    Affiliation Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Robert D. Hontz,

    Roles Funding acquisition, Investigation, Project administration, Supervision, Writing – review & editing

    Affiliation Virology and Emerging Infections Department, United States Naval Medical Research Unit No. 6, Lima, Peru

  • Steven T. Stoddard,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation School of Public Health, San Diego State University, San Diego, California, United States of America

  • Christopher M. Barker,

    Roles Investigation, Methodology, Project administration, Software, Supervision, Writing – review & editing

    Affiliation Department of Pathology, Microbiology, and Immunology, School of Veterinary Medicine, University of California, Davis, Davis, California, United States of America

  • Uriel Kitron,

    Roles Conceptualization, Methodology, Project administration, Writing – review & editing

    Affiliation Institut Pasteur, Université Paris Cité, CNRS UMR2000, Insect-Virus Interactions Unit, Paris, France

  • John P. Elder,

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Writing – review & editing

    Affiliation School of Public Health, San Diego State University, San Diego, California, United States of America

  • Alan L. Rothman,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    Affiliation Institute for Immunology and Informatics and Department of Cell and Molecular Biology, University of Rhode Island, Providence, Rhode Island, United States of America

  • Thomas W. Scott,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Entomology and Nematology, University of California Davis, Davis, California, United States of America

  •  [ ... ],
  • on behalf of the Proyecto Dengue Group

    Membership of the Proyecto Dengue Group is provided in the Acknowledgments.

  • [ view all ]
  • [ view less ]

Abstract

Current knowledge of dengue virus (DENV) transmission provides only a partial understanding of a complex and dynamic system yielding a public health track record that has more failures than successes. An important part of the problem is that the foundation for contemporary interventions includes a series of longstanding, but untested, assumptions based on a relatively small portion of the human population; i.e., people who are convenient to study because they manifest clinically apparent disease. Approaching dengue from the perspective of people with overt illness has produced an extensive body of useful literature. It has not, however, fully embraced heterogeneities in virus transmission dynamics that are increasingly recognized as key information still missing in the struggle to control the most important insect-transmitted viral infection of humans. Only in the last 20 years have there been significant efforts to carry out comprehensive longitudinal dengue studies. This manuscript provides the rationale and comprehensive, integrated description of the methodology for a five-year longitudinal cohort study based in the tropical city of Iquitos, in the heart of the Peruvian Amazon. Primary data collection for this study was completed in 2019. Although some manuscripts have been published to date, our principal objective here is to support subsequent publications by describing in detail the structure, methodology, and significance of a specific research program. Our project was designed to study people across the entire continuum of disease, with the ultimate goal of quantifying heterogeneities in human variables that affect DENV transmission dynamics and prevention. Because our study design is applicable to other Aedes transmitted viruses, we used it to gain insights into Zika virus (ZIKV) transmission when during the project period ZIKV was introduced and circulated in Iquitos. Our prospective contact cluster investigation design was initiated by detecttion of a person with a symptomatic DENV infection and then followed that person’s immediate contacts. This allowed us to monitor individuals at high risk of DENV infection, including people with clinically inapparent and mild infections that are otherwise difficult to detect. We aimed to fill knowledge gaps by defining the contribution to DENV transmission dynamics of (1) the understudied majority of DENV-infected people with inapparent and mild infections and (2) epidemiological, entomological, and socio-behavioral sources of heterogeneity. By accounting for factors underlying variation in each person’s contribution to transmission we sought to better determine the type and extent of effort needed to better prevent virus transmission and disease.

Introduction

Despite more than a century of intensive efforts, development of effective strategies to prevent Aedes-transmitted viral disease continues to lag behind the burden of disease, in part because of a paucity of empirical data examining pathogen transmission dynamics [1]. Interventions are largely founded on untested assumptions derived from observations of a relatively small portion of the human population, i.e., people who are convenient to study because they are ill and seek medical treatment. Evaluations of dengue from the perspective of people with overt illness have produced an extensive body of valuable literature. Those studies do not, however, capture heterogeneities in virus transmission dynamics that are increasingly recognized as key to controlling the most important insect-transmitted viral infection in humans. Only in the last 20 years have there been significant efforts to carry out comprehensive longitudinal dengue studies [2, 3] that allow research questions to be broadened to include a larger portion of the dengue virus (DENV)-infected human population.

Herein, we present the rationale, goals, and study design of a longitudinal research program entitled “Quantifying Heterogeneities in Dengue Virus Transmission” conducted in Iquitos, Peru from July 2014 to April 2019. This program was an extension of research conducted between 2006–2013 that examined the contribution of human movement to DENV transmission dynamics and included new expertise in behavioral science, spatial analysis, and modeling [49]. This publication describes our large and complex research program that followed our human movement studies. It is intended to be a single unified source that can be referenced in subsequent publications. Our aim is to provide a holistic overview of the integrated structure and methodology that we used to achieve our research objectives. Data collection for the project ended in 2019. Due to delays associated with the COVID-19 pandemic some data analysis and laboratory testing are ongoing. Although we previously published project associated reports (i.e., spectrum of dengue illness experienced in Iquitos [10] and impact of dengue on human mobility [11, 12] and quality of life measures [13]) in this publication we do not focus on project related data. Instead, we limit our presentation to the overall rationale and methodology of the study and how the project was designed to directly address key knowledge gaps in the understanding of DENV transmission.

Study rationale

Our study builds on findings from a series of longitidunal cohort studies conducted between 1999 and 2014, which showed that human movement accounts for significant variation in the spatial spread of DENV, that few individuals or locations may be giving rise to a disproportionate number of new infections, and the proportion of inapparent infections was high [2, 4, 14]. All of these factors are principal contributors to DENV transmission and could constitute strategic targets for intervention. Thus, a critical next step was to define the contribution of an understudied portion of total DENV infections, the estimated 300 million people [15] with inapparent and mild ambulatory infections. to DDENV transmission dynamics. Specifically, we tested the hypothesis that people infected with DENV vary in their contributions to transmission as a function of their viremia [16, 17], activity patterns, and contact [4] with mosquitoes. We predicted that people with inapparent and mild DENV infections contribute more to DENV transmission than previously recognized because these individuals are infectious to mosquito vectors and are less likely to limit their mobility due to their symptoms.

To test this prediction, it was essential that we identify people with active DENV infections across the spectrum of disease, especially those with inapparent and mild infections, who are not normally detected by disease surveillance systems. We built on an established multi-layered approach to real-time detection of human DENV infections that leveraged (1) a joint U.S. Naval Medical Research Unit No. 6 (NAMRU-6) and Peruvian Ministry of Health clinic-based surveillance program, (2) active community-based surveillance, and (3) contact cluster investigations for efficient detection of additional DENV infections, including people with inapparent and mild disease. By quantifying heterogeneities in people’s individual contributions to DENV transmission dynamics, we aimed to fill important knowledge gaps leading to improved strategies to prevent DENV transmission and disease. Ultimately, our study design and results could extend to research and prevention efforts for other infectious diseases.

Significance

DENV causes more human morbidity and mortality worldwide than any other arthropod-borne virus and has expanded its distribution further than any other vector-borne disease [15, 1821]. There are as many as 4 billion people living in areas currently at risk of infection, with 400 million estimated new infections and 50–100 million new symptomatic infections occurring each year [15, 21, 22]. From 1990 to 2013, dengue cases increased 4-fold and the virus rapidly increased its geographic range causing disease in new exposed susceptible populations [15, 2124]. In most of the world, dengue control is failing, despite the fact that some forms of vector control are theoretically straightforward. Unsuccessful programs are often attributed to a lack of resources, lack of political will, ineffective implementation [1, 25], and/or the absence of a rigorous evidence base for available methods that was generated through robust study designs with epidemiological endpoints [26, 27]. Equally important is our incomplete understanding of (1) the relationships between human behavior, mosquito ecology, and virus transmission dynamics; (2) the most appropriate methods to assess and respond to risk; and (3) the most effective use of surveillance information to inform programmatic control decisions [28]. Fundamental concepts of dengue disease prevention remain incompletely defined and underutilized. New theories, concepts, and tools are needed to improve dengue prevention. To this end, our program was designed to assess the contribution of the understudied majority of DENV-infected people (i.e., those with clinically inapparent/mild infections) to the epidemiological, entomological, and socio-behavioral heterogeneities in DENV transmission dynamics. Longitudinal cohort studies only detect clinically inapparent/mild infections in small numbers [29, 30] or retrospectively after their infectious, viremic period ended [2, 30]. Our contact cluster protocol can identify people with mild disease manifestations while they are viremic. We, therefore, shifted our research focus to people who do not manifest debilitating illness, but potentially are critical contributors to the temporal and spatial dynamics that amplify DENV transmission and whose infections confound prediction of explosive dengue outbreaks.

A key component of the heterogeneity in dengue epidemiology is the well-established phenomenon that typically half or more of people with DENV infections are not detected by standard public health surveillance [2, 20, 3032]. Variation in the ratio of symptomatic to inapparent/mild infections is often estimated retrospectively in longitudinal cohort studies [2, 3, 31], but the contribution of people with inapparent/mild infections to virus transmission remains largely unexplored. Overlooking inapparent/mild infections can result in (as has been seen for cholera) [33] inapparent infections forcing a more rapid rise and more rapid subsequent fall of epidemics, shifting the perceived peak of the epidemic curve to an earlier time period than was previously recognized, and accelerating the process of pathogen epidemic transmission and geographic spread. This has become especially apparent globally in 2020. SARS-CoV-2 transmission dynamics similarly appears to be fueled by innapparent and mild infections [34], underlining the importance of this understudied segment of the virus transmission process.

Whether inapparent/mild DENV infections produce a similar pattern to the one observed for cholera or SARS-CoV-2 remains to be determined. What is clear, however, is that the rapid spatial spread of epidemic dengue cannot be explained by clinically apparent infections alone [35]. For example, identification of seroconversions of a longitudinal cohort compared to virus isolates from a clinic-based surveillance study in Iquitos detected a 5–6 month period of “silent” transmission prior to the 2002 DENV-3 invasion into the city [2]. During 2008, DENV-4 circulated from February-July virtually unnoticed before causing a large outbreak later that same year [36, 37]. During the largest dengue epidemic in Iquitos history during 2010–2011 (DENV-2 Asian-American strain), severe disease was detected when attack rates were highest. These observations imply a functional relationship between force of infection and observed cases of severe disease with a prominent role played by people with inapparent/mild infections in virus transmission dynamics.

We expect that results from our project will have public health and basic science implications. If people across the continuum of disease are more accurately accounted for (1) dynamics in virus transmission will be more accurately interpreted, (2) surveillance and triggers for implementing control will be more effectively timed for maximum impact, (3) targets for vaccine and vector control evaluation and delivery will be more successfully estimated and implemented, (4) immunological precursors of dengue severity can be studied across a broader range of disease outcomes, and (5) data across all disease manifestations can be included in comprehensive analyses (mathematical and simulation models) of dengue transmission and control. Almost all dengue endemic countries base their surveillance on clinically apparent dengue cases and consequently miss the majority of infections. We hope that our results will encourage development of capacity to respond more quickly and, thus, more effectively to elevated risk and will drive innovations for quick, accurate, and inexpensive detection of a greater portion of infections. We expect our research will be of interest to people evaluating dengue vaccines and vector control, particularly if goals include dengue elimination (i.e., preventing the few remaining infections from spawning a resurgent wave of disease) and the prevention of re-emergence.

Program plan

Our overall goals were to (1) quantitatively define the relationship between severity of disease and contribution to DENV transmission dynamics; (2) assess the relative and joint contributions of epidemiological, entomological, and socio-behavioral sources of heterogeneity to the dynamics of DENV transmission; and (3) predict risk to identify public health measures to minimize DENV transmission and disease. Three distinct, but interdependent, projects shared a Surveillance Core and were supported by Administrative and Data Cores (Fig 1). Below, we review the structure and methods for projects and cores beginning with the Surveillance Core, followed by the three projects, and concluding with the Data and Administrative Cores. Although our study focus was dengue, from June 2016 to April 2017 Zika virus circulated in Iquitos, providing us the opportunity to ask the same questions for both viruses.

thumbnail
Fig 1. Project diagram showing the integration of the three projects and cores.

https://doi.org/10.1371/journal.pone.0273798.g001

Surveillance core

The Surveillance Core was designed to identify individuals with active DENV infections for detailed study in Projects 1 and 2 (Fig 2, see S1 Appendix for detailed methods). Activities encompassed field surveillance operations to identify acute disease cases to estimate disease incidence, routine serological (annual longitudinal blood samples from a pediatric subset of surveillance participants to estimate DENV/ZIKV seroconversion rates), routine entomological monitoring, and laboratory procedures for diagnostic and project-specific purposes. We took a proactive and multi-layered approach to surveillance. Cluster investigations were initiated by febrile individuals with detectable DENV or ZIKV viremias who reported the locations they visited in the previous 15 days. Susceptible contacts at reported residential locations were monitored for signs of infection over an ~30 day period. Infections were identified by NS1 antigen detection and RTq-PCR within 24 hours of blood collection. As soon as a viremic individual was detected, that person was recruited to participate in mosquito feeding experiments (Project 1) and monitoring of symptoms and behavior (Project 2). This nested approach to case detection facilitated direct comparison between alternative surveillance schemes and validation of models developed in Project 3.

thumbnail
Fig 2. Summary of procedures followed to collect individual data on human infectiousness to mosquitoes (Project 1) and their response to dengue and Zika illness (Project 2).

Participant capture occurred through multiple sources, including community-based surveillance, hospital-based surveillance, and contact-cluster investigations. Once viremic individuals were identified, sequential data on their behavior (retrospective mobility survey, RMS; infection-perception and response, IPR; and quality of well-being, QWB) and markers of infection in blood [viremia titer by qPCR, Complete Blood Count CBC, Apartate transaminase (AST)/Alanine aminotransferast (ALT), and cytokines], and direct laboratory-reared mosquito feeding (using 30 female mosquitoes for children and 60 mosquitoes for adults) were conducted throughout the illness period of each participant.

https://doi.org/10.1371/journal.pone.0273798.g002

Project 1: Dengue and Zika virus transmission from viremic people to mosquitoes

Project 1 was designed to quantitatively define the relationship between an individual’s infection across the spectrum of disease (inapparent to severe) and their contribution to DENV transmission. Aedes aegypti from a confirmed uninfected genetically diverse laboratory strain (GDLS) were fed directly on NS1/PCR-positive DENV-infected people (30 [for children] - 60 [for adults] mosquitoes per participant) (Section 3.3 in S1 Appendix). Rates of mosquito infection and in vitro transmission (i.e., assay of expectorated saliva) were determined (Fig 3, Section 5 in S1 Appendix). This allowed us to define the capacity of people with different disease manifestations and viremia levels to transmit virus to the mosquitoes they encountered during their daily activities (Project 2) and characterize the relative contributions of people with different dengue illnesses to seasonal and epidemic dengue dynamics (Project 3).

thumbnail
Fig 3. Workflow for mosquito feeding procedures carried out on DENV/ZIKV infected study participants.

FFA = Fluorescent Focus Assay, RT-PCR = Reverse Transcriptase Polymerase Chain Reaction.

https://doi.org/10.1371/journal.pone.0273798.g003

Project 2: Effects of dengue or Zika virus infection on human behavior with virus transmission potential

Project 2 assessed the relative and joint contributions of epidemiological, social, and human behavioral sources of heterogeneity to the dynamics of DENV transmission (Fig 2). Data were collected through interviews (Table 1, Section 6 in S1 Appendix) and laboratory analyses of blood samples from individuals with acute viremic DENV infections (Sections 4.1–4.4 in S1 Appendix). These were the same individuals participating in the mosquito feeding experiments (Project 1). By applying social and health science techniques we (1) described and quantified the association between subjective and objective measures of dengue disease severity, (2) examined and quantified human behavior changes associated with dengue disease of various severities [10, 11, 13], and (3) estimated individual human-mosquito contact rates to explore risk for potential forward DENV transmission (Project 3).

thumbnail
Table 1. Interview workflow for 8 survey types using surveys developed for CommCare [41] and deployed on mobile tablets running Android OS [51], each questionnaire was administered verbally by trained research staff, who recorded their responses using the application.

Shaded cells denote when surveys were applied.

https://doi.org/10.1371/journal.pone.0273798.t001

Project 3: Drivers of heterogeneities in dengue virus epidemiology, transmission dynamics, and control

Project 3 aimed to predict risk and identify the most effective public health measures to minimize virus transmission and disease. To quantify and assess the impact on dengue virus transmission dynamics and the effectiveness of different surveillance and control scenarios, we drew on empirical field data from Projects 1 and 2 and our previous research in Iquitos and generated mechanistic mathematical models that account for (1) host and vector movement, (2) a realistic spatial structure and mosquito population dynamics, and (3) heterogeneities in human infectiousness, attractiveness to mosquito bites, and mobility behavior as a function of disease severity.

Data core

The Data Core upgraded data support operations that were developed over the previous 20 years of dengue-related research in Iquitos. Key improvements were (1) implementation of a more advanced relational database in PostgreSQL [38] that integrated historical and current data, (2) implementation of open-source GIS tools built on PostGIS [39] and managed with QGIS [40], (3) development of a CommCare [41] mobile data collection system for collecting data from household surveys using tablets and mobile phones, (4) development of a secure, web-based user interface using the Django framework [42] for daily data management in collaboration with the University of Notre Dame’s Center for Research Computing (as a component of a clinical trial evaluating a spatial repellent in Iquitos [43], and (5) establishment of regular data redundancy and backup processes across multiple servers in Iquitos and UC Davis to ensure data preservation and integrity. The Data Core worked closely with the Surveillance Core to manage the project’s data systems, train project personnel as needed, and distribute and exchange data among the research team and key partners, such as NAMRU-6.

Administration core

The Administrative Core provided overall fiscal and research administrative support, including budget, fiscal, and progress reporting and IRB/human subjects compliance. The Administrative Core was based at the lead institution (UC Davis) and coordinated with local direction at the Iquitos field site.

Ethical considerations and consent

The study protocol was approved by the U.S. Naval Medical Research Unit No. 6 Institutional Review Board (Protocol Number NAMRU6.2014.0028), which included Peruvian representation and complied with US Federal and Peruvian regulations governing the protection of human subjects. IRB authorization agreements were established between U.S. Naval Medical Research Unit No. 6 and all participating institutions. The protocol was reviewed and approved by the Loreto Regional Health Department (LRHD), which oversaw health research in Iquitos. A clinic-based surveillance protocol (NMRCD2010.0010) and ongoing community-based vector control intervention protocol (NAMRU6.2014.0021) identified DENV/ZIKV positive cases that could be invited to participate in virus positive case protocols and initiate cluster investigations. The study had an information sheet that explained the overall goals and the different components of the study. Non-invasive components of the study, such as a household census, surveillance visits from study personnel, mosquito surveys, focus groups, and some pilot studies required only verbal consent. The study had written consent documents for the following separate activities: (1) providing annual blood samples for longitudinal monitoring of DENV neutralizing antibodies in child participants, (2) providing acute and convalescent blood sample and movement survey in the case of illness (samples tested for DENV/ZIKV), (3) participation in a cluster contact investigation (up to 5 blood samples in 30 days), and (4) as a DENV/ZIKV positive case that provided permission for all the procedures in Fig 2 and Table 1. Participants that were minors provided assent (written for 8-17-years old, verbal for <8 years old). Their parents or guardians provided written consent. Consent without written documentation (verbal) was approved for non-invasive procedures and activities including census, entomological surveys, focus group discussions, and some noninvasive pilot studies.

Study area

All study activities were carried out in Iquitos, a geographically isolated urban center approaching 400,000 inhabitants [44], located in the Amazon Basin of northeastern Peru. The city is located on a peninsula, surrounded on three sides by major rivers (Itaya, Nanay, and Amazon), and functions as a natural socio-epidemiological system because access to it is limited to air and river travel. The U.S. Navy initiated epidemiological studies on DENV in Iquitos in the early 1990s, then partnered with the University of California at Davis to study sequential invasions of distinct DENV serotypes. In general, each year DENV activity is low from May to July, increases in August and September, and then usually peaks between November and January. If no vector control is implemented, elevated levels of transmission can continue through April [45, 46]. In May 2016, the first human ZIKV infections were reported in Iquitos. ZIKV transmission continued through April 2017 with almost no detection of DENV during that time period [47, 48].

Iquitos is composed of parts of four larger districts, Punchana to the north, San Juan Bautista to the south, Belen to southeast, and Iquitos that extends to the west, but includes the core of the city. The city has experienced rapid urbanization and expansion in the past three decades [49], from the neighborhoods around the city center/commercial zones in the districts of Iquitos and Punchana to areas on the river (Belen and parts of Punchana) and to the south (San Juan Bautista). Each district includes less developed areas on the outer edges of the city to smaller rural communities along the Iquitos-Nauta highway and surrounding rivers with well developed transportation networks into the city. The main industries are small commercial enterprises, extractive business (logging, mining), and agricultural.

Our study followed and identified DENV and ZIKV cases from two ongoing cohort studies, both initiated in June 2015, and carried out in the more developed and central parts of the Iquitos and Punchana districts (Fig 2, S1 Fig in S1 Appendix full size map shown in Fig 2). Between June 2015-April 2019, ~20,000 participants were under disease surveillance. DENV/ZIKV acute cases were recruited from these ongoing cohort studies and from an ongoing clinic-based passive surveillance study [36]. The cohort neighborhoods were relatively homogenous, with a patchwork of households ranging from wood structures with dirt floors to brick and concrete and ceramic floors. The Peruvian Statistics and Informatics Institute states that about 30% of the urban populations in Amazon regions of Peru have at least one unmet basic need, 18.2% live in poverty, and 3% live in extreme poverty [49]. Evidence of extreme wealth is not observed in Iquitos, and luxury items such as air conditioners are rarely observed. Other indicators for the Maynas and Punchana districts indicate that 93% of structures are individual houses (row houses with shared walls), 82–83% have corrugated metal roofs, 90–97% have electricity, and literacy rates are 88–92% [44].

Study design

To achieve our program goals (Fig 2), our field team consisted of nurse technicians (n = 12–20), entomological technicians (n = 15), a “movement team” (4 team members who managed cluster investigations and conducted project 2 interviews), a small data management team, and a group of physician and nurse supervisors. Nurse supervisors enrolled households in the study areas and conducted disease surveillance visits to all houses in the cohort 3–5 times per week to identify acute DENV/ZIKV infections. We modified our protocol after the invasion of ZIKV into Iquitos during 2016 to include DENV and ZIKV-specific case definitions and differential laboratory diagnosis. From a subset of pediatric participants (i.e., an embedded longitudinal component), we drew blood annually to detect DENV antibody seroconversions. People with acute disease detected in community-based and passive clinic-based disease surveillance, and through contact-cluster investigations, were invited to participate in mosquito feeding experiments and illness experience and behavioral (movement) studies, and asked to initiate contact-cluster investigations. These activities were the methodological backbone of the program and were driven by the Surveillance and Data Cores.

Procedures performed on DENV- and ZIKV-infected participants.

Suspected and/or confirmed DENV/ZIKV cases from community- and clinic-based febrile surveillance or cluster contact investigations were invited to participate in (1) mosquito feeding procedures (Fig 3) and (2) collection of data related to their experience with illness and its intensity, health-related quality of life, and fine-scale history of movement. Participation consisted of allowing laboratory reared mosquitoes to feed directly on them (see Section 5.1 in S1 Appendix); collecting blood samples (EDTA and serum separator tube by venipuncture, see Section 2.1 in S1 Appendix) for complete blood count, cytokine, and liver enzyme testing; and responding to a series of seven separate surveys (Table 1). The procedures for conducting direct mosquito feeds on viremic participants were developed during a pilot study completed prior to the initiation of the program project [50]. Study procedures were repeated each day the participant’s blood tested positive for DENV or ZIKV during the previous days’ samples and the participant agreed to continue. Participants could decline individual procedures on to participate during individual days and remain in the study.

Data integration and analysis plan

To support the scientific and operational aspects of the research program, we developed innovative approaches to the collection of information on an individual’s infectiousness to mosquitoes and response to illness throughout the infectious period of each participant. All Projects and the Surveillance Core generated data and information that was managed by the Data Core in our secure database infrastructure (Fig 4). The Data Core provided real-time access to field personnel and investigators through a user-friend web-based Django interface. Data was entered by field staff either manually from paper forms or from downloaded data collected through android applications. Alternatively, the seven interview data collection instruments (Table 1) associated with dengue or Zika infected individuals were imported directly into the relational database. Each individual participant was registered in the system through a “census” form for an individual household. All individual data was geo-coded to the household level in a Geographic Information System (GIS). Individuals could only be added to locations found in the GIS. New locations were added constantly, either because they were newly added locations or households that split into two, after field validation with a GPS.

thumbnail
Fig 4. Data structure and integration for the project.

All data was managed in PostgreSQL relational database with a direct link to a geographic information system in Quantum GIS. Additional data was captured through mobile android applications using CommCare software and later processed and imported into PostgreSQL.

https://doi.org/10.1371/journal.pone.0273798.g004

All individuals in a household received a “participant_code” that included the “location_code”. For example, five people enrolled at the location_code MYC200 would be assigned the following participant_codes: MYC200P01, …, MYC200P05. On each cityblock the participant_codes were in alphanumeric order. If people, moved or houses were changed this information was managed in the participant_status table. Following the previous sample a year into the study house MYC200 was split in two houses (MYC200A and MYC200B), with the first two individuals staying in A and the remaining individuals in B. New participant_codes would be MYC200AP01 and MYC200AP02 and for house B (MYC200BP01, MYC200BP02, MYCB200P03 corresponding to MYC200P03-P05).

In the participant_status table each code had a start/stop date, except for the most recent status of the code. A status column kept track of active and inactive period. This information was used to calculate the person-time a person was under surveillance under any time interval specified.

The most innovative aspect of this data structure was the ability to following individuals from one location to another, or more importantly manage individuals who spent time in different locations during surveillance periods. That is, individuals could have more than one active participant_code at one time. The database system was duplicated on three servers, two in Iquitos and one in Davis. Ideally, the information was synchronized in realtime, but because of the bandwidth limitation in Iquitos, all data entry of human data occurred on one server and entomological data on the other. Sychronization was carried out at least weekly intervals, and daily tape backs were made from the Davis server.

Although the primary unit of analysis was the participant, information was usually grouped through a “consent” table linking to individuals who participated in the DENV/ZIKV + case protocol (Fig 4, Table 1). All blood samples and mosquito feeds and their respective laboratory results were linked to the participant through the consent_id. For all of the listed activities each participant had multiple observations (i.e., multiple days throughout the infectious period) per participant. Given the time-dependent nature of our data, most statistical analyses included parameters that accounted for the individual variability in response.

Generalized Linear Mixed models (GLMM) will be used widely used to account for individual variability (random intercept, set on participant ID) and temporal variability (random slope, setting time as a time-varying factor when applicable) [52]. For Project 1, the time varying mosquito infectiousness data (dependent variable, binomial) is being analyzed using multiple models to identify its association with independent variables, such as, day of illness, viremia titer, and disease severity.

Using similarly structured time-varying data, Project 2 will quantify (1) the functional relationship between self-reported and clinical outcomes of disease, (2) identified the temporal variations in such relationships, and (3) assessed the composite contribution of factors to the overall perception of dengue severity.

Programmatic synergies

Our project was designed to have a high-level of synergy between projects and cores in the flow of research aims, activities, data, and results (Figs 1 and 4). The Surveillance Core identified viremic people with varying disease manifestations for studies in Project 1 and 2 and provided data on the epidemiological context that helped define parameters for analyses carried out in Project 3; i.e., measures of herd immunity, community-wide dengue incidence rates, and fluctuations in Ae. aegypti population densities. Project 1 determined the transmission potential of viremic individuals, measured by relative infectiousness to mosquitoes that can be compared directly to objective and subjective measures of disease severity and behavior of those same individuals in Project 2. Project 2 estimated the risk of viremic people in Project 1 being bitten by mosquitoes. Projects 1, 2, and 3 required assimilation of data into a manageable format by the Data Core. The full impact of our project required the development of transmission and intervention models in Project 3 that are based on results from Projects 1 and 2, on concurrent epidemiologic trends provided by the Surveillance Core, and on historical patterns of DENV transmission provided by the Data Core. Information flowing from the Surveillance Core and all three projects was efficiently accumulated, processed, managed, integrated, and disseminated from the centralized Data Core. The Administrative Core provided administrative and financial oversight, logistical support, and outreach coordination for the other 2 cores and the 3 projects. We used a two-tiered administrative structure with one unit in Davis where the project PI, Program Manager, and Data Core were based and another unit in Iquitos where Morrison, the Surveillance Core Leader, lived and directed similar large integrative projects over the prior 14 plus years.

It is important to note that the composition of our research team was a blend of senior and junior scientists with integral participation by Peruvian scientists. We built the program on a history of outstanding collaboration among the research team, NAMRU-6 in Lima, and the Loreto Regional Department of Health (Ministry of Health). Our project and the research team structure provided a unique opportunity for junior researchers to continue to grow into key players in the fields of tropical disease ecology and epidemiology.

Supporting information

S1 Appendix. Supplementary appendix.

This appendix has been provided by the authors to give readers additional information about their work.

https://doi.org/10.1371/journal.pone.0273798.s001

(DOCX)

Acknowledgments

We thank the residents of Iquitos for their support and participation in this study. We greatly appreciate the support of the Loreto Regional Health Department, including Drs. Hugo Rodriguez-Ferruci, Christian Carey, Carlos Alvarez, Hernan Silva and the Lic. Wilma Casanova Rojas, who all facilitated our work in Iquitos. A special thanks to Gloria Talledo for her ongoing support with the preparation of IRB protocols and reports for this project. We appreciate the commentary and advice provided by the NAMRU-6 Institutional Review Board and Research Administration Program for the duration of this study.

A special thank you goes to our data management personnel (Gabriela Vasquez De La Torre, Magaly Ochoa Isuiza), and the nurse technicians involved in case capture (Llerme Armas Pisco, Cesar Augusto Banda Chavez, Linder Maria Canayo Zavaleta, Clara Chávez López, Karina Chuquipiondo Vasquez, Laury Dacia Cuespan Camus, Leny Curico Manihuari, Nadia Rocio Del Rio Chavez, Salome Elespuru, Junnelhy Mireya Flores López, Juan Flores Michi, Luz Angelica Galvez, Huayllahua, Rina Gonzales Jaba, Deisy Irene Huiñapi Cambunugue, Maria Edith Juárez Baldera, Xiomara Mafaldo García, Nora Marín Romero, Nadia Tereshkova Montes Criollo, Johnni Mozombite Flores, Sandra Ivonne Moñoz Perez, Lucy Navarro Sánchez, Geraldine Ocmin Galán, Zenith María Pezo Villacorta, Fiona Stefani Pinedo Zevallos, Iris Reátegui Carrión, Zoila Martha Reategui Chota, Sadith Jovita Ricopa Manuyama, Liliana Rios López, Rubiela Nerza Rubio Briceño, Ysabel Ruiz Berger, Miranda Angela Rocio Soplin, Rosana Magaly Sotero Jiménez, Rosa Tamani Babilonia, Zenith Tamani Guerrero, Moises Tanchiva, Sarita Del Pilar Tuesta Dávila, Flora Vargas Ceras, Rita Gabriela Vasquez Orbe).

The Proyecto Dengue Group is comprised of the following individuals. Jhonny Cordova (designated group lead, email: jhonnycordova777@gmail.com), Alfonso Vizcarra, and Arnold Noreiga affiliated with the Department of Entomology and Nematology, at the University of California, Davis. Jennifer E. Rios, W. Lorena Quiroz, S., Juan Sulca, Julia Sonia Ampuero, Isabel Bazan, Crystyan Siles, Stalin Vilcarromero, Leslye Angulo, Guadalupe Flores, Carolina Guevara, Maria Silva, Christopher Mores, Eric S. Halsey, Regina Fernandez, and Wesley R. Campbell are members of the Virology and Emerging Infections Department and Gissella Vasquez, from the Entomology Department of the U.S. Naval Medical Research Unit No. 6. Kathrine L. Schaber was in the Program of Population Biology, Ecology, and Evolution, Emory University.

Disclaimer: The views expressed in this article are those of the authors and do not necessarily reflect the official policy or position of the Department of the Navy, Department of Defense, nor the U.S. Government.

References

  1. 1. Morrison AC, Zielinski-Gutierrez E, Scott TW, Rosenberg R. Defining challenges and proposing solutions for control of the virus vector Aedes aegypti. PLoS Med. 2008;5: e68. pmid:18351798
  2. 2. Morrison AC, Minnick SL, Rocha C, Forshey BM, Stoddard ST, Getis A, et al. Epidemiology of dengue virus in Iquitos, Peru 1999 to 2005: interepidemic and epidemic patterns of transmission. PLoS Negl Trop Dis. 2010;4: e670. pmid:20454609
  3. 3. Endy TP, Yoon IK, Mammen MP. Prospective cohort studies of dengue viral transmission and severity of disease. Curr Top Microbiol Immunol. 2010;338: 1–13. pmid:19802574
  4. 4. Stoddard ST, Forshey BM, Morrison AC, Paz-Soldan VA, Vazquez-Prokopec GM, Astete H, et al. House-to-house human movement drives dengue virus transmission. Proc Natl Acad Sci U S A. 2013;110: 994–999. pmid:23277539
  5. 5. Olkowski S, Forshey BM, Stoddard S, Morrison AC, Vilcarromero S, Long KC, et al. Effects of pre-existing DENV antibody on the occurrence of symptomatic illness associated with novel DENV-4 infection. American Society of Tropical Medicine and Hygeine. 2011.
  6. 6. Vazquez-Prokopec GM, Bisanzio D, Stoddard ST, Paz-Soldan V, Morrison AC, Elder JP, et al. Using GPS technology to quantify human mobility, dynamic contacts and infectious disease dynamics in a resource-poor urban environment. PLoS One. 2013;8: e58802. pmid:23577059
  7. 7. Perkins TA, Garcia AJ, Paz-Soldan VA, Stoddard ST, Reiner RC Jr, Vazquez-Prokopec G, et al. Theory and data for simulating fine-scale human movement in an urban environment. J R Soc Interface. 2014;11. pmid:25142528
  8. 8. Paz-Soldan VA, Reiner RC Jr, Morrison AC, Stoddard ST, Kitron U, Scott TW, et al. Strengths and weaknesses of Global Positioning System (GPS) data-loggers and semi-structured interviews for capturing fine-scale human mobility: findings from Iquitos, Peru. PLoS Negl Trop Dis. 2014;8: e2888. pmid:24922530
  9. 9. Paz-Soldan VA, Stoddard ST, Vazquez-Prokopec G, Morrison AC, Elder JP, Kitron U, et al. Assessing and maximizing the acceptability of global positioning system device use for studying the role of human movement in dengue virus transmission in Iquitos, Peru. Am J Trop Med Hyg. 2010;82: 723–730. pmid:20348526
  10. 10. Elson WH, Reiner RC, Siles C, Bazan I, Vilcarromero S, Riley-Powell AR, et al. Heterogeneity of dengue illness in community-based prospective study, Iquitos, Peru. Emerg Infect Dis. 2020;26: 2077–2086. pmid:32818402
  11. 11. Schaber KL, Paz-Soldan VA, Morrison AC, Elson WHD, Rothman AL, Mores CN, et al. Dengue illness impacts daily human mobility patterns in Iquitos, Peru. PLoS Negl Trop Dis. 2019;13: e0007756. pmid:31545804
  12. 12. Schaber KL, Perkins TA, Lloyd AL, Waller LA, Kitron U, Paz-Soldan VA, et al. Disease-driven reduction in human mobility influences human-mosquito contacts and dengue transmission dynamics. PLoS Comput Biol. 2021;17: e1008627. pmid:33465065
  13. 13. Elson WH, Riley-Powell AR, Morrison AC, Gotlieb EE, Groessl EJ, Cordova JJ, et al. Measuring health related quality of life for dengue patients in Iquitos, Peru. PLoS Negl Trop Dis. 2020;14: e0008477. pmid:32722709
  14. 14. Rocha C, Morrison AC, Forshey BM, Blair PJ, Olson JG, Stancil JD, et al. Comparison of two active surveillance programs for the detection of clinical dengue cases in Iquitos, Peru. Am J Trop Med Hyg. 2009;80: 656–660. pmid:19346395
  15. 15. Bhatt S, Gething PW, Brady OJ, Messina JP, Farlow AW, Moyes CL, et al. The global distribution and burden of dengue. Nature. 2013;496: 504–507. pmid:23563266
  16. 16. Vaughn DW, Green S, Kalayanarooj S, Innis BL, Nimmannitya S, Suntayakorn S, et al. Dengue viremia titer, antibody response pattern, and virus serotype correlate with disease severity. J Infect Dis. 2000;181: 2–9. pmid:10608744
  17. 17. Libraty DH, Acosta LP, Tallo V, Segubre-Mercado E, Bautista A, Potts JA, et al. A prospective nested case-control study of Dengue in infants: rethinking and refining the antibody-dependent enhancement dengue hemorrhagic fever model. PLoS Med. 2009;6: e1000171. pmid:19859541
  18. 18. Pan American Sanitary Bureau. Dengue and dengue hemorrhagic fever in the Americas: guidelines for prevention and control. Washington, D.C.: Pan American Health Organization, Pan American Sanitary Bureau, Regional Office of the World Health Organization; 1994.
  19. 19. Gubler DJ. Epidemic dengue/dengue hemorrhagic fever as a public health, social and economic problem in the 21st century. Trends Microbiol. 2002;10: 100–103. pmid:11827812
  20. 20. Halstead SB. Dengue virus-mosquito interactions. Annu Rev Entomol. 2008;53: 273–291. pmid:17803458
  21. 21. Brady OJ, Gething PW, Bhatt S, Messina JP, Brownstein JS, Hoen AG, et al. Refining the global spatial limits of dengue virus transmission by evidence-based consensus. PLoS Negl Trop Dis. 2012;6: e1760. pmid:22880140
  22. 22. Stanaway JD, Shepard DS, Undurraga EA, Halasa YA, Coffeng LE, Brady OJ, et al. The global burden of dengue: an analysis from the Global Burden of Disease Study 2013. Lancet Infect Dis. 2016;16: 712–723. pmid:26874619
  23. 23. Messina JP, Brady OJ, Scott TW, Zou C, Pigott DM, Duda KA, et al. Global spread of dengue virus types: mapping the 70 year history. Trends Microbiol. 2014;22: 138–146. pmid:24468533
  24. 24. Ng JKW, Zhang SL, Tan HC, Yan B, Martinez JM, Tan WY, et al. First experimental in vivo model of enhanced dengue disease severity through maternally acquired heterotypic dengue antibodies. PLoS Pathog. 2014;10: e1004031. pmid:24699622
  25. 25. Gubler DJ. Aedes aegypti and Aedes aegypti-borne disease control in the 1990s: top down or bottom up. Charles Franklin Craig Lecture. Am J Trop Med Hyg. 1989;40: 571–578. pmid:2472746
  26. 26. Wilson AL, Boelaert M, Kleinschmidt I, Pinder M, Scott TW, Tusting LS, et al. Evidence-based vector control? Improving the quality of vector control trials. Trends Parasitol. 2015;31: 380–390. pmid:25999026
  27. 27. Bowman LR, Donegan S, McCall PJ. Is Dengue Vector Control Deficient in Effectiveness or Evidence?: Systematic Review and Meta-analysis. PLoS Negl Trop Dis. 2016;10: e0004551.
  28. 28. Scott TW, Morrison AC. Longitudinal field studies will guide a paradigm shift in dengue prevention. In: Lemon SM, Institute of Medicine (U.S.). Forum on Microbial Threats., editors. Vector-borne diseases: understanding the environmental, human health, and ecological connections: workshop summary. Washington, D.C.: National Academies Press; 2008. pp. 32–149.
  29. 29. Beckett CG, Kosasih H, Faisal I, Nurhayati , Tan R, Widjaja S, et al. Early detection of dengue infections using cluster sampling around index cases. Am J Trop Med Hyg. 2005;72: 777–782. pmid:15967759
  30. 30. Endy TP, Chunsuttiwat S, Nisalak A, Libraty DH, Green S, Rothman AL, et al. Epidemiology of inapparent and symptomatic acute dengue virus infection: a prospective study of primary school children in Kamphaeng Phet, Thailand. Am J Epidemiol. 2002;156: 40–51. pmid:12076887
  31. 31. Endy TP, Anderson KB, Nisalak A, Yoon IK, Green S, Rothman AL, et al. Determinants of inapparent and symptomatic dengue infection in a prospective study of primary school children in Kamphaeng Phet, Thailand. PLoS Negl Trop Dis. 2011;5: e975. pmid:21390158
  32. 32. Balmaseda A, Standish K, Mercado JC, Matute JC, Tellez Y, Saborio S, et al. Trends in patterns of dengue transmission over 4 years in a pediatric cohort study in Nicaragua. J Infect Dis. 2010;201: 5–14. pmid:19929380
  33. 33. King AA, Ionides EL, Pascual M, Bouma MJ. Inapparent infections and cholera dynamics. Nature. 2008;454: 877–880. pmid:18704085
  34. 34. Wiersinga WJ, Rhodes A, Cheng AC, Peacock SJ, Prescott HC. Pathophysiology, transmission, diagnosis, and treatment of Coronavirus disease 2019 (COVID-19): A review. JAMA. 2020;324: 782–793. pmid:32648899
  35. 35. Morrison AC, Getis A, Santiago M, Rigau-Perez JG, Reiter P. Exploratory space-time analysis of reported dengue cases during an outbreak in Florida, Puerto Rico, 1991–1992. Am J Trop Med Hyg. 1998;58: 287–298. pmid:9546405
  36. 36. Forshey BM, Guevara C, Laguna-Torres VA, Cespedes M, Vargas J, Gianella A, et al. Arboviral etiologies of acute febrile illnesses in Western South America, 2000–2007. PLoS Negl Trop Dis. 2010;4: e787. pmid:20706628
  37. 37. Forshey BM, Morrison AC, Cruz C, Rocha C, Vilcarromero S, Guevara C, et al. Dengue virus serotype 4, northeastern Peru, 2008. Emerg Infect Dis. 2009;15: 1815–1818. pmid:19891873
  38. 38. PostgreSQL Global Development Group. PostgreSQL. 10 Spring 2020 [cited 10 Spring 2020]. Available: https://www.postgresql.org/
  39. 39. Developers P. PostGIS—Spatial and Geographic Objects for PostgreSQL. [cited 10 Spring 2020]. Available: https://postgis.net
  40. 40. QGIS Development Team. QGIS Geographic Information System. Open Source Geospatial Foundation. 2019. Available: http://qgis.osgeo.org
  41. 41. CommCare by Dimagi. [cited 10 Spring 2020]. Available: https://www.dimagi.com/commcare/
  42. 42. Django Software Foundation. 2018, Django version #.#. 2018 [cited 10 Spring 2020]. Available: https://djangoproject.com
  43. 43. Morrison AC, Reiner RC Jr, Elson WH, Astete H, Guevara C, del Aguila C, et al. Efficacy of a spatial repellent for control of Aedes-borne virus transmission: A cluster randomized trial in Iquitos, Peru. bioRxiv. medRxiv; 2021.
  44. 44. INEI. Censos Nacionales 2017: XII De Poblacion, VII de Viviendas y III de communidades indigenas. Systema de Consulta de base de datos. 2017 [cited 20 Oct 2018]. Available: http://censos2017.inei.gob.pe
  45. 45. Stoddard ST, Wearing HJ, Reiner RC Jr, Morrison AC, Astete H, Vilcarromero S, et al. Long-term and seasonal dynamics of dengue in Iquitos, Peru. PLoS Negl Trop Dis. 2014;8: e3003. pmid:25033412
  46. 46. Gunning CE, Okamoto K, Astete H, Vasquez GM, Erhardt E, Del Aguila C, et al. Efficacy of Aedes aegypti control by indoor Ultra Low Volume (ULV) insecticide spraying in Iquitos, Peru. PLoS Negl Trop Dis. 2018;12: e0006378. pmid:29624581
  47. 47. Weldon CT, Riley-Powell AR, Aguerre IM, Celis Nacimento RA, Morrison AC, Oberhelman RA, et al. “Zika is everywhere”: A qualitative exploration of knowledge, attitudes and practices towards Zika virus among women of reproductive age in Iquitos, Peru. PLoS Negl Trop Dis. 2018;12: e0006708. pmid:30161130
  48. 48. [cited 29 Dec 2020]. Available: http://www.dge.gob.pe/portal/docs/vigilancia/sala/2017/SE33/zika.pdf
  49. 49. INEI. Pobreza. 2017. Available: https://www.inei.gob.pe/estadisticas/indice-tematico/poverty/
  50. 50. Long KC, Sulca J, Bazan I, Astete H, Jaba HL, Siles C, et al. Feasibility of feeding Aedes aegypti mosquitoes on dengue virus-infected human volunteers for vector competence studies in Iquitos, Peru. PLoS Negl Trop Dis. 2019;13: e0007116. pmid:30753180
  51. 51. Android. Android; [cited 10 Spring 2020]. Available: https://www.android.com/
  52. 52. Bourdeau PE. Mixed Effects Models and Extensions in Ecology with R. Statistics for Biology and Health. By Alain F. Zuur , Elena N. Ieno , Neil J. Walker , Anatoly A. Saveliev , and Graham M. Smith . New York: Springer. $84.95. xxii + 574 p.; ill.; index. 978‐0‐387‐87457‐9. 2009. Q Rev Biol. 2009;84: 404–405.