A common challenge to the study of several infectious diseases consists in combining limited cross-sectional survey data, collected with a more sensitive detection method, with a more extensive (but biased) syndromic sentinel surveillance data, collected with a less sensitive method. Our article describes a novel modeling framework that overcomes this challenge, resulting in enhanced understanding of malaria in the Western Brazilian Amazon.
A cohort of 486 individuals was monitored using four cross-sectional surveys, where all participants were sampled regardless of symptoms (aggressive-active case detection), resulting in 1,383 microscopy and 1,400 polymerase chain reaction tests. Data on the same individuals were also obtained from the local surveillance facility (i.e., passive and active case detection), totaling 1,694 microscopy tests. Our model accommodates these multiple pathogen and case detection methods. This model is shown to outperform logistic regression in terms of interpretability of its parameters, ability to recover the true parameter values, and predictive performance. We reveal that the main infection determinant was the extent of forest, particularly during the rainy season and in close proximity to water bodies, and participation on forest activities. We find that time residing in Acrelandia (as a proxy for past malaria exposure) decreases infection risk but surprisingly increases the likelihood of reporting symptoms once infected, possibly because non-naïve settlers are only susceptible to more virulent Plasmodium strains. We suggest that the search for asymptomatic carriers should focus on those at greater risk of being infected but lower risk of reporting symptoms once infected.
The modeling framework presented here combines cross-sectional survey data and syndromic sentinel surveillance data to shed light on several aspects of malaria that are critical for public health policy. This framework can be adapted to enhance inference on infectious diseases whenever asymptomatic carriers are important and multiple datasets are available.
Citation: Valle D, Clark JS, Zhao K (2011) Enhanced Understanding of Infectious Diseases by Fusing Multiple Datasets: A Case Study on Malaria in the Western Brazilian Amazon Region. PLoS ONE 6(11): e27462. https://doi.org/10.1371/journal.pone.0027462
Editor: Javier R. Lama, Asociacion Civil Impacta Salud y Educacion, Peru
Received: August 18, 2011; Accepted: October 17, 2011; Published: November 8, 2011
Copyright: © 2011 Valle et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Denis Valle was partly supported by a pilot project grant from the Duke Global Health Initiative. No additional external funding was received for this study. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Extensive syndromic sentinel surveillance data are often routinely collected by public health agencies. However, estimates of disease prevalence based on these data are known to be biased because only symptomatic individuals are sampled , . Furthermore, because of the sentinel surveillance network extent, cheaper and less sensitive diagnostic methods are typically employed. Researchers also collect data to study infectious disease risk factors and asymptomatic pathogen carriers, but using cross-sectional surveys and more expensive and sensitive diagnostic methods. These data, however, are often geographically and temporally limited and thus are not as abundant as sentinel surveillance data. Robust inference on disease prevalence and risk factors would ideally combine these datasets because they clearly complement each other; unfortunately, standard statistical tools are not well suited for this task. We describe here a novel statistical model that coherently combines these disparate datasets, allowing for enhanced inference on infectious diseases.
Our study focuses on malaria. Malaria is responsible for ∼3% of the total global disease burden , affecting approximately half of the world's population  and significantly hindering economic and social development of tropical countries . Despite its public health relevance and recent increased attention to malaria research and control , malaria risk factors remain difficult to evaluate, due both to the idiosyncrasies of how data are collected (as detailed below) and the fact that not all infected individuals are symptomatic. Our approach addresses these challenges, providing sharper inference on Plasmodium infection risk factors, factors determining symptom status given infection, and overall infection and disease prevalence. We first describe the statistical model, then we compare its performance against standard logistic regression using simulated and real data, and finally we apply it to a large malaria dataset collected in the Western Brazilian Amazon.
In Brasil, malaria cases are concentrated in the Amazon region , resulting in substantial morbidity , . Similar to other countries (e.g., India, ), the malaria surveillance data from the Brazilian government consist of microscopy results from predominantly symptomatic individuals, sampled through active and passive case detection (ACD and PCD, respectively). ACD data are obtained by health agents during home visits to symptomatic individuals whereas PCD data come from health facilities, visited by individuals who believe they have malaria . Inherent biases in both datasets make it difficult to determine overall malaria prevalence and the factors that influence it , . Aggressive active case detection (AACD) has been proposed as an alternative surveillance technique, consisting of cross-sectional surveys where all individuals are sampled, regardless of symptom status . AACD data can be used to estimate infection prevalence and its determinants and the size of the reservoir represented by asymptomatic Plasmodium carriers –. Drawbacks of AACD include high costs and the often low acceptability from the population , , which often limits AACD data to a short time-frame and a small geographical area. As a consequence, AACD data might not be as well suited as ACD/PCD data in determining the effect of covariates that change substantially in time and/or space (e.g., precipitation and presence of wetlands).
Imperfect Plasmodium detection is a concern for all surveillance methods. The Brazilian Health Ministry primarily makes use of microscopy of thick blood smears, because it is relatively inexpensive and straight-forward . However, microscopy has limited ability to detect the pathogen when parasitemia is low –. In research settings, Polymerase Chain Reaction (PCR) has been extensively used as the standard against which the sensitivity and specificity of other detection methods (e.g., microscopy and rapid diagnostic tests) are evaluated. Unfortunately, PCR data is often not available due to costs and expertise required for the procedure , .
How does one integrate the less biased but more limited dataset (e.g., data from AACD) with a more extensive, time continuous and biased dataset (e.g., data from ACD/PCD)? Furthermore, how can the more sensitive but limited PCR dataset be used jointly with the less sensitive but more extensive microscopy dataset? Logistic regression is the most common statistical tool used to analyze individual-level disease data. However, logistic regression does not correct for the biases in the ACD/PCD dataset, even if dummy covariates are added to represent differences in how individuals were sampled (e.g., AACD, ACD, and PCD). It also does not accommodate detection error rates for the different Plasmodium detection methods. In recognition of these problems, analysis might focus on the most sensitive pathogen detection method (i.e., PCR) and less biased case detection method (i.e., AACD), with the drawback of ignoring considerable information contained in the rest of the data.
Logistic regression also does not allow for important conditional relationships that determine malaria risk. Malaria researchers typically assume perfect detection and choose to model either the probability of being diseased (i.e., ) or the probability of being infected (i.e., ), where S and I stand for symptom and infection status. These probabilities are related and models can be developed to combine them in a statistically and biologically coherent way. Our model factors as , allowing us to separately evaluate infection risk factors (i.e., ) from risk factors of symptoms given infection (i.e., ). This approach can provide inference on factors that influence the joint distribution of symptom and infection statuses. For example, we can coherently estimate the prevalence of asymptomatic carriers, namely , and the factors that influence it. The limitations of standard statistical tools prompted us to create a customized method to analyze our data.
Here, we illustrate how inference on malaria risk factors and infection/disease prevalence can be improved using a hierarchical framework based on the joint distribution of symptom and infections statuses and by properly accommodating the different pathogen and case detection methods. First, we detail the model. Then, we compare the performance of this method to that of typical logistic regressions using simulated and real data. Finally, we apply this model on a large malaria dataset collected in the Western Brazilian Amazon and discuss the implication of our findings.
The study protocol was approved by the Ethical Review Board of the Institute of Biomedical Sciences of the University of São Paulo, Brazil (318/2002 and 538/2004) and we obtained written informed consent from each adult participant and from the parent or legal guardian of every minor.
Data were collected in a rural settlement area, in a region known as Ramal Granada (Acrelandia, Acre, Brasil), on 486 individuals that agreed to participate in the study. AACD data come from four cross-sectional surveys (March/April 2004, September/October 2004, February/March 2005, and October/November 2006) in which all study participants that were present at the time of the survey were sampled, regardless of their symptomatic status. This dataset contained a total of 1383 microscopy and 1400 PCR malaria tests. Further details on the area, data collection, and characteristics of this cohort can be found elsewhere , , . We gathered ACD/PCD data by searching the malaria records at the local health facility. All malaria records between 2004 and 2007 from the AACD study participants were entered in a database, resulting in a total of 1694 microscopy tests, with approximately 94% of the individuals feeling symptomatic when tested.
We start by describing some basic conditional probabilities for our model and their associated assumptions. We then proceed to detail the likelihood associated with each potential outcome. We conclude this section with a description of how we fit the model.
We consider data from two Plasmodium detection methods, namely microscopy and polymerase chain reaction (PCR). Let stand for a positive Plasmodium detection using microscopy for individual i at time t. Let and stand for being infected and having malaria symptoms, respectively. Note that is a latent variable because we never directly observe it. Using these definitions, let and be the microscopy sensitivity given that and , respectively. We allow sensitivity to depend on symptom status because it has been shown that low-grade infections (i.e., low density of parasites in the blood) are associated with asymptomatic cases and failure to detect them with microscopy –, . Furthermore, let be the microscopy specificity. We set the specificity of the microscopy to one because it is virtually impossible for an experienced microscopist to identify malaria pathogens on a blood sample from an uninfected patient, regardless of the symptomatic status of the patient (Ferreira, personal communication; ).
In relation to PCR, let stand for a positive Plasmodium detection using PCR for individual i at time t. Let the PCR sensitivity and specificity be denoted by and , respectively. Errors in amplification or contamination of the sample can produce both false-positives and false-negatives . From prior knowledge, we know that the sensitivity of PCR is greater than that of microscopy and that microscopy sensitivity is probably greater when the individual is symptomatic than when not symptomatic (i.e., ) . Finally, we assume that PCR sensitivity and specificity are not influenced by microscopy detection and symptomatic status of the individual, given infection status. The assumption of conditional independence between PCR and microscopy results seems reasonable because detections are based on fundamentally different biological processes , . We adopted uniform priors for the sensitivity and specificity of PCR, where the limits were based on earlier reports on PCR error rates , . More specifically, the joint prior adopted for these detection parameters was a uniform distribution in the set .
where is the design vector and is the vector with the corresponding parameters. The design vector contains potential risk factors. For our case study using data from the Western Brazilian Amazon, these covariates were gender, educational level, age, time in Acrelandia (as a proxy for past exposure to malaria), if participates on extractivism activities, if hunts or fishes, if works as chain sawyer, if shares the house with somebody that had a positive malaria diagnosis in the past 30 days, surface water area, forest area, deforestation rate, precipitation, and a drought index. These covariates are detailed in Appendix S1. Individual and household-level random effects are denoted by and , respectively, where h[i] indexes the household where the ith person resides. These random effects were modeled as and , where and are the individual and household-level random effect variances, respectively.
where is a vector of parameters to be estimated and is the design vector. We assume that the covariates most likely to influence this probability are variables related to the individual's immune system and not variables related to present exposure to vectors. Thus, for our Western Brazilian Amazon case study, the covariates in were age, gender, and time in Acrelandia (as a proxy for past malaria exposure). Finally, we assumed that the probability of having symptoms despite not being infected was a constant parameter to be estimated.
The definitions above are the basis for the hierarchical model that we built (depicted in Fig. 1), borrowing some ideas from Clark & Hersh . These definitions and model structure allow us to describe the likelihoods of all the possible outcomes in AACD (Table S1). For the ACD and PCD datasets, we start by noting that and , because ACD and PCD focuses mostly on symptomatic individuals. Therefore, we can assume that knowing whether the person was sampled in ACD or PCD does not bring any additional information about the risk of being infected if we condition on symptomatic status. More formally, we assume that and . Based on these assumptions, it can be shown that the likelihood for each outcome will be similar to those for AACD with the exception that it will have a correction term of the form or . Here, and are the conditional probability that an individual with symptom status S is sampled through ACD or PCD, respectively, and and are the corresponding marginal probabilities. The likelihood of all the possible outcomes in ACD and PCD is shown in Table S2. The detailed derivation of these likelihoods is given in Appendix S2.
An important assumption in our analysis of the ACD/PCD dataset is that malaria tests (and the symptomatic status at the time of the test) more than one week apart from each other were considered to be independent. There were some cases where symptomatic individuals would choose to be tested multiple times within a short period of time (<7 days), probably expecting a positive result or the symptoms to ameliorate. To avoid making several assumptions regarding the temporal dependencies of symptoms and test results from these multiple tests, we chose to retain just the first test and the associated symptomatic status whenever we detected multiple tests within this short time-frame.
Let be all the parameters we will estimate and let and be the different datasets, where subscripts denote how individuals were sampled. Assuming conditional independence given the parameters , the full model can be written as
where is the posterior distribution of the parameters to be estimated, is the likelihood of dataset k (Table S1 and Table S2) and are the priors. All the estimated parameters are listed and described in Table 1, together with their associated priors.
This model was fitted using a Gibbs sampler. Most parameters were updated using a Metropolis sampling step and the few parameters that were updated via a Gibbs sampling step have their full conditional distributions described in Appendix S3. In total, 150,000 iterations were run and the initial 20,000 iterations were discarded as burn-in. Convergence was assessed using trace-plots of the parameters.
We compare the proposed model with standard logistic regressions, both with and without individual and household level random effects. Let be a positive Plasmodium detection, either from microscopy, PCR or both. The response variable for these logistic regressions were proxies for a) disease: a person having symptoms and a positive detection (i.e., ); and b) infection: a person having a positive detection (i.e., ) (Table 2). To mimic how researchers would typically use these multiple datasets ( and ), we merged the three datasets into a single one and added two dummy covariates in the logistic regressions to allow for differences between datasets.
These different statistical methodologies were compared using both simulated and real data. Simulated data were used to compare the different methods in relation to how well they retrieved the true parameters influencing infection probability. To evaluate the importance of combining these multiple datasets, we further compared how inference from the proposed model would change if fitted only to the PCR dataset versus all datasets. Details of how the simulated data were generated are given in Appendix S4, Table S3, and in Table S4. We also compared how well each model predicted the real data, using a 10-fold cross validation. This validation exercise consisted in fitting these models to 90% of the real data and comparing their predictions for the remaining 10%. This was done ten times with different portions of the data retained for validation at each time. Each method predicted which individuals had a positive test result () and which individuals had a positive test result and were symptomatic (). We summarized this information as a) the proportion of individuals correctly predicted as or ; and b) the proportion of individuals correctly predicted as or not . For this validation exercise, we also evaluated the predictive ability of the chosen covariates by adding the prediction results from a model that simply used the proportion of individuals with (or ) in the training dataset. All statistical procedures and graphics were performed in R .
Our results using simulated data reveal that the 95% confidence intervals from the logistic regressions, both with and without random effects, were typically narrower than the 95% credible intervals from the proposed model (Fig. 2), often missing the true regression parameters, even when these effects were large. In contrast to these results, the 95% credible interval generated by the proposed model fitted to all datasets always included the true regression parameters. One parameter of particular importance is the intercept as it reveals the infection prevalence for individuals with mean covariate values. Our results show that all logistic regressions grossly overestimated this parameter. The simulated data also revealed that fitting the proposed model to all datasets (microscopy and PCR results from the ACD, PCD, and AACD datasets) resulted in sharper inference, both in terms of smaller bias and uncertainty, when compared to results from the proposed model fitted just to PCR results (black circle vs. black triangle, Fig. 2). This improved inference arises not only because of the larger sample size but also because the ACD and PCD datasets are more time continuous, resulting in greater variability for several covariates.
The true values of the infection risk factor parameters are depicted in horizontal black dashed lines. Logistic regression models with disease (models 2 and 4) and infection (models 3 and 5) as response variables are depicted in red and blue, respectively. Models with and without random effects are depicted with continuous and dashed vertical lines, respectively. Models 2–5 were fitted to all datasets. Model 1 was fitted twice, once for just the PCR dataset (black triangle) and once for all datasets (black circle). Details of these models are given in Table 2.
An important concern related to the proposed model is that it might be over-fitting the data, given that it includes almost twice as many parameters as the logistic regressions (30 vs. 17, respectively, after excluding random effects and their variances), potentially resulting in poor out-of-sample predictive ability. However, our validation results using the real data show that the proposed model had a similar or better predictive ability when compared to the logistic regression model with random effects (Fig. 3). Interestingly, even the model without any covariates had a good predictive ability, sometimes yielding equivalent or better predictions than the logistic models, with or without random effects. In contrast, the proposed model always yielded better predictions than the model without any covariates. Furthermore, the proposed model is capable of generating all predictions depicted in Fig. 3 whereas distinct logistic regressions were fit to predict these different outcomes.
These figures show the proportion of individuals correctly classified by each model. Numbers on the left refer to the different validation datasets. Logistic regression models with disease (models 2 and 4) and infection (models 3 and 5) as response variables are depicted in red and blue, respectively. Models with and without random effects are depicted with continuous and dashed lines, respectively. Details of these models are given in Table 2.
Findings from the Western Brazilian Amazon region
We estimated that the infection prevalence for the cohort we studied was approximately 0.13 (95% credible interval (CI) 0.10–0.16). Malaria prevalence was considerably lower (0.04, 95% CI 0.03–0.06) because not all individuals exhibit symptoms. From the pool of infected individuals, more than half will typically be asymptomatic (0.63, 95% CI 0.53–0.72) but the overall prevalence of asymptomatic carriers is low (0.08, 95% CI 0.06–0.12). We can compare these model-based estimates with estimates calculated directly from the data, if we assume that all individuals with a positive (or negative) detection result are infected (or not infected). Similar, but not identical, results were obtained using only PCR data (Fig. 4). On the other hand, considerably different summary statistics were obtained using microscopy, either from AACD or from the PCD/ACD datasets. These differences arise because microscopy is known to have limited ability to detect individuals with low parasitemia, which tend to be asymptomatic individuals, and because the PCD/ACD datasets include predominantly symptomatic individuals. One option would be to analyze just the PCR dataset collected with the AACD method, ignoring malaria risk information from the other datasets. However, as we showed with the simulated data and as suggested elsewhere , inference can be greatly improved when all datasets are jointly used if the model is able to adequately accommodate the inherent differences among datasets. Thus, we exploit the information on infection/disease prevalence and malaria risk factors from all datasets.
The summary statistics are infection (i.e., ) and malaria prevalence (i.e., ), proportion of asymptomatic individuals among the pool of infected individuals (i.e., ) and overall proportion of asymptomatic carriers in the population (i.e., ). Estimates from the proposed model are depicted in black. Estimates calculated directly from the data are depicted in red (PCR data), green (microscopy results from AACD), and blue (microscopy results from ACD and PCD). Vertical lines depict 95% credible intervals for model 1 and approximate 95% confidence intervals for the other estimates, calculated as .
The clearest infection risk factor was forest extent surrounding the subject's house (Table 3, Fig. 5; the marginal posterior distributions for all the estimated parameters are provided in Figure S1 and Figure S2). The effect of forest extent was further exacerbated by proximity to larger water bodies, particularly during the wet season. Furthermore, men (probably as a result of spending more time in the forest than women) and those participating in forest related activities (e.g., extractivism, hunting or fishing) were more likely to be infected (Table 3, Fig. 5). These risk factors consistently suggest that these degraded forests are prime breeding habitat for the vector. On the other hand, annual deforestation rates and working as a chain sawyer were not important risk factors. We hypothesize that the extensive use of fire for land clearing during the dry season might be responsible for this pattern. We also expected increased infection risk if the person co-inhabited a house with somebody diagnosed with malaria within the past 30 days but this was not the case, probably because infectious individuals might be diagnosed after (instead of before) the focal person is tested for malaria. Unfortunately, these past and future dependencies cannot currently be included in the model.
The probability of infection was calculated with the other covariates fixed at their mean value. CI stands for credible interval. Lower right panel shows the independent effect of being a woman (‘Women’), being a man (‘Men’), participating on extractivism activities (‘Extract.’), and participating on hunting or fishing activities (‘Hunt/Fish’). The summed effect of being a man, partipating on extractivism and hunting/fishing activities is also shown (‘M,E,HF’).
There is some evidence that time living in Acrelandia, as a proxy for past malaria exposure, reduces the risk of being infected (Table 3, Fig. 5). This result suggests that non-naïve settlers acquire parasitological immunity and/or considerable knowledge on how to reduce one's exposure to infection. However, our results also suggest that this same factor increases the probability of feeling symptoms once infected (Table 3). One possible explanation is that non-naïve settlers are only susceptible to the more virulent Plasmodium strains.
Asymptomatic Plasmodium carriers pose a considerable public health challenge. Our results suggest ways to strategically identify these carriers. While sampling all individuals regardless of symptoms (as in AACD) might be useful, a more efficient strategy would be to sample individuals at high risk of infection but low probability of feeling symptoms given infection. In other words, we maximize by maximizing the individual components and . For instance, if we estimate the probability of being an asymptomatic Plasmodium carrier as a function of time in Acrelandia and forest extent, it becomes clear that we should preferentially sample individuals that are new to the area (thus with high ) on highly forested areas with abundant surface water (thus with high ) (Fig. 6).
The probability of sampling an asymptomatic Plasmodium carrier is shown as a function of time in Acrelandia and proportion of forest area in places with abundant surface water.
The estimated parameters can be jointly used to make coherent predictions, relying on information from all datasets. For example, a predicted infection risk surface can be created using information on surface water and forest area (infection prevalence map in Fig. 7). These results can be extrapolated to a larger geographical region using remote sensing imagery, revealing substantial spatial heterogeneity in infection prevalence attributable to the river that crosses the upper part of the region and the large forest blocks away from the roads (extrapolated infection prevalence map in Fig. 7). These maps also highlight the striking differences in infection prevalence due to precipitation, a result greatly corroborated by recent entomological surveys conducted at the same site . Besides infection risk surfaces, asymptomatic carrier risk and malaria burden surfaces can also be created, using household information on how long people have been living in Acrelandia (asymptomatic carrier and malaria prevalence maps in Fig. 7). Despite similarities, the asymptomatic carrier prevalence surface indicates that these carriers are more likely to be found in the northern part of our study area whereas infected symptomatic individuals can also be found in the central region of our study area.
From left to right, maps depict interpolated surfaces of predicted infection prevalence (i.e., ), asymptomatic carrier prevalence (i.e., )), and malaria prevalence (i.e., ), all for the studied area, and an extrapolated surface of infection prevalence. Upper and lower maps are the prevalence surfaces for the rainy and dry seasons, respectively. Interpolation was done using an inverse distance weighted algorithm.
As expected, we find strong influence of priors on the estimation of the PCR error rates (Fig. S2), suggesting that there was not enough information on our dataset to estimate all these parameters jointly. Microscopy sensitivity, on the other hand, was well estimated to be approximately 0.3 and 0.1, almost a three-fold difference for symptomatic and asymptomatic individuals, respectively (Table 3). Nevertheless, even for symptomatic individuals, sensitivity of microscopy was relatively low. Several quantities can be derived from these error rate estimates. For example, sampling predominantly symptomatic individuals (as is usually done in ACD/PCD) is sensible given that the probability of being infected increases dramatically if the person is symptomatic . However, the challenge of using microscopy as the only method to monitor infection and disease prevalence is evident if we compare our knowledge of infection probability for symptomatic individuals before and after obtaining a negative microscopy result ( and , respectively), indicating very little gain of information when microscopy yields a negative result. This finding suggests that close monitoring of individuals that are symptomatic but that have recently obtained a negative microscopy result might be warranted. On the other hand, a positive microscopy detection is very informative since . PCR results, regardless if positive or negative, were also informative since but and .
Large spatial-scale patterns regarding malaria typically involves syndromic surveillance data (e.g., , ), despite limited microscopy sensitivity and the biased nature of these data. On the other hand, more reliable infection and disease prevalence estimates are often spatially and temporally restricted, relying almost exclusively on PCR data , , –. The proposed model uses information from both datasets to improve the estimates of infection and disease prevalence at our research site, which is then extrapolated to a larger area. Alternatively, we can infer large spatial-scale patterns of Plasmodium infection prevalence using the syndromic surveillance data after adjusting for the inherent biases in this dataset. This adjustment is only possible with the parameters estimated here and is part of our ongoing research.
Our results identify the important role of forests and forest related activities in Plasmodium infection risk, particularly during the rainy season and in close proximity to large water bodies (Fig. 5). Unfortunately, the data do not contain more information regarding these forests (e.g., level of forest degradation) and thus we cannot determine which characteristic of these forests are important infection risk factors. These results corroborate the findings of others that proximity to the forest enhances infection risk , , – but we do not find support for the idea that deforestation activity per se  or the lack of forest ,  significantly increase infection risk. Our results also suggest that one of the factors most amenable to public policy is the participation in forest related activities (e.g., extractivism, hunting and fishing activities). Hunting and fishing activities are particularly popular, with nearly two thirds of the individuals in our cohort reporting that they engage in these activities. Educational campaigns might be effective in raising awareness about how participation in these activities affects one's health and the health of their family and community, particularly for those individuals more likely to exhibit symptoms given infection (i.e., non-naïve settlers).
Malaria immunity is typically portrayed as a phenomenon that depends on age (as a proxy for past malaria exposure), with severe malaria being relatively common for young children, and older cohorts having progressively less cases of severe malaria and proportionally more cases of mild malaria and asymptomatic infection , . This descriptions refers to people exposed to malaria since birth in holoendemic countries, but it is much more complex (and less well understood) in areas with lower levels of exposure and where mild malaria predominates . In these latter settings, previous studies have suggested that past exposure to malaria can decrease clinical malaria risk in rural settlers  and provide both anti-parasite and anti-disease immunity in traditional riverine populations , . Our results suggest that anti-parasite immunity arises even in rural settlers. However, unlike previous studies, we find evidence that it also increases the probability of feeling symptoms once infected. We hypothesize that more experienced settlers are susceptible only to more virulent Plasmodium strains. Further studies are clearly needed to determine if this hypothesis is correct.
Joint models or analyzes, like ours, are models that simultaneously make inference on multiple outcomes (e.g., detection and symptom status), even allowing one outcome to influence the others (e.g., symptom status affecting detection). These models have recently become very popular in the medical statistics literature because more information and interpretability can be gained when compared to performing separate analysis of the different outcomes (e.g., , ). Another active research area in statistics focuses on the use of multiple pathogen detection methods to determine overall disease prevalence and sensitivity/specificity of these detection methods , –. A recent malaria-specific example can be found in Speybroeck et al. . Our model builds on both of these trends by evaluating the risk factors of infection and symptoms given infection using data from multiple case and pathogen detection methods. Our results using simulated and real data revealed that the proposed model yields better inference on risk factors and disease/infection prevalence without over-fitting the data. To our knowledge, most of the epidemiological research regarding malaria has focused on infection risk factors. However, unlike standard logistic regression, the proposed model allows coherent inference on several other important parameters, such as detection error rates and risk factors associated with symptoms given infection. The latter is critical to advance our understanding of malaria burden and asymptomatic carriers. A direct result of this coherent inference is the identification of the need for better monitoring strategies regarding symptomatic individuals with negative microscopy results and how to sample more effectively potential asymptomatic Plasmodium carriers (Fig. 6). Finally, predicted surfaces of infection risk, asymptomatic carrier risk, and malaria burden allow for optimal spatial allocation of resources and malaria control activities.
One of the critical assumptions in our analysis was that data from ACD/PCD only differ from the AACD data by the unusually high proportion of symptomatic individuals. Although this is clearly a key factor, other characteristics of the individuals sampled in ACD/PCD might also be important, such as the distance of their house to the health facility. Also, our model clearly depends on having individual level data on both positive and negative microscopy tests. Unfortunately, individual level data from negative microscopy tests are typically discarded, both by the Brazilian Ministry of Health and malaria researchers, hampering future analysis of these rich datasets.
We modeled symptomatic status as a binary variable despite the fact that there is considerable variation in the type and intensity of symptoms one may exhibit . Future work might allow for multinomial or continuous symptomatic status. Evidently, this would only be productive if this symptomatic status score was collected routinely in AACD and ACD/PCD. Another variable not included in the model is parasitemia. Precise and accurate estimates of this variable can be challenging to obtain . Although new quantitative PCR methods can potentially overcome this problem, dramatic fluctuations in parasite density occur in the same individual within a short time period . Therefore, the inclusion of parasitemia into an analysis like ours remains an important challenge. Furthermore, there is no way to distinguish new Plasmodium infections from recrudescence and relapses, even using modern genotyping technology, given that an individual might be initially infected by multiple strains and/or re-infected by the same common strain , . Thus, what we have called infection risk factors actually refers to the risk factors of having a relapse, a recrudescence, and/or a new infection. Finally, because P. vivax and P. falciparum are particularly prevalent in the region, it would be interesting to evaluate if the probability of feeling symptoms given infection or the infection risk factors differ among these species. This remains an important research topic.
Using malaria in the Western Brazilian Amazon as a case study, we have shown that the modeling framework presented here can exploit information from multiple datasets to shed light on several aspects of an infectious disease (e.g., infection risk factors, risk factors associated with symptoms given infection, detection error rates) that are critical for its monitoring and control (e.g., indicating how to efficiently search for asymptomatic carriers and which symptomatic individuals should be closely monitored). While standard logistic regressions are undoubtedly important tools, these statistical models are not well suited to integrate multiple datasets. We believe that the Bayesian modeling framework described here fundamentally enhances our ability to overcome this challenge, being broadly applicable to other settings and diseases whenever asymptomatic carriers are an important public health concern and multiple datasets are available.
Red vertical lines are drawn at zero for reference. CI stands for credible interval.
The first row of graphics displays the estimated parameters associated with . Red vertical lines are drawn at zero for reference. The second row of graphics displays the estimated detection parameters of microscopy (which depends on symptomatic status S) and PCR. The last row of graphics displays the estimated probability of feeling symptomatic given no infection (i.e., ) and several other estimated probabilities associated with the different case detection methods. ACD and PCD stand for active and passive case detection, respectively. CI stands for credible interval.
Likelihood of each of the possible outcomes in AACD.
Likelihood of each of the possible outcomes in ACD and PCD.
Summary of parameter values adopted for the simulated data.
Number of microscopy and PCR results for the different sampling designs, both from the original and simulated datasets.
Full conditional distribution for the parameters sampled via a Gibbs sampling step.
We thank Marcelo Urbano Ferreira and Monica da Silva-Nunes for kindly providing the AACD malaria dataset and logistic support during our field work. We also thank Fundacao de Tecnologia do Estado do Acre (FUNTAC) for providing high resolution imagery; Surya Tokdar, Alan Gelfand and Merlise Clyde for providing suggestions regarding our modeling framework; and the malaria control team of Acrelandia.
Analyzed the data: DV. Wrote the paper: DV. Collected the PCD and ACD datasets: DV. Performed the remote sensing analysis to identify water bodies: DV KZ. Provided suggestions on the statistical model: JSC. Provided suggestions on the final version of the manuscript: JSC KZ.
- 1. Snow RW, Guerra CA, Noor AM, Myint HY, Hay SI (2005) The global distribution of clinical episodes of Plasmodium falciparum malaria. Nature 434: 214–217.RW SnowCA GuerraAM NoorHY MyintSI Hay2005The global distribution of clinical episodes of Plasmodium falciparum malaria.Nature434214217
- 2. Hardnett FP, Hoekstra RM, Kennedy M, Charles L, Angulo FJ (2004) Epidemiologic issues in study design and data analysis related to FoodNet activities. Clinical Infectious Diseases 38: S121–126.FP HardnettRM HoekstraM. KennedyL. CharlesFJ Angulo2004Epidemiologic issues in study design and data analysis related to FoodNet activities.Clinical Infectious Diseases38S121126
- 3. Pruss-Ustun A, Corvalan C (2006) Preventing disease through healthy environments. Towards an estimate of the environmental burden of disease. Geneva, Switzerland: World Health Organization. A. Pruss-UstunC. Corvalan2006Preventing disease through healthy environments.Towards an estimate of the environmental burden of diseaseGeneva, SwitzerlandWorld Health Organization
- 4. Hay SI, Guerra CA, Tatem AJ, Noor AM, Snow RW (2004) The global distribution and population at risk of malaria: past, present, and future. Lancet Infectious Diseases 4: 327–336.SI HayCA GuerraAJ TatemAM NoorRW Snow2004The global distribution and population at risk of malaria: past, present, and future.Lancet Infectious Diseases4327336
- 5. Sachs J, Malaney P (2002) The economic and social burden of malaria. Nature 415: 680–685.J. SachsP. Malaney2002The economic and social burden of malaria.Nature415680685
- 6. Ravishankar N, Gubbins P, Cooley RJ, Leach-Kemon K, Michaud CM, et al. (2009) Financing of global health: tracking development assistance for health from 1990 to 2007. Lancet 373: 2113–2124.N. RavishankarP. GubbinsRJ CooleyK. Leach-KemonCM Michaud2009Financing of global health: tracking development assistance for health from 1990 to 2007.Lancet37321132124
- 7. Oliveira-Ferreira J, Lacerda MVG, Brasil P, Ladislau JLB, Tauil PL, et al. (2010) Malaria in Brazil: an overview. Malaria Journal 9: J. Oliveira-FerreiraMVG LacerdaP. BrasilJLB LadislauPL Tauil2010Malaria in Brazil: an overview.Malaria Journal9
- 8. Castro MC, Monte-Mor RL, Sawyer DO, Singer BH (2006) Malaria risk on the Amazon frontier. PNAS 103: 2452–2457.MC CastroRL Monte-MorDO SawyerBH Singer2006Malaria risk on the Amazon frontier.PNAS10324522457
- 9. Camargo LMA, Colletto GMD, Ferreira MU, Gurgel SM, Escobar AL, et al. (1996) Hypoendemic malaria in Rondonia (Brazil, western Amazon region): seasonal variation and risk groups in an urban locality. Am J Trop Med Hyg 55: 32–38.LMA CamargoGMD CollettoMU FerreiraSM GurgelAL Escobar1996Hypoendemic malaria in Rondonia (Brazil, western Amazon region): seasonal variation and risk groups in an urban locality.Am J Trop Med Hyg553238
- 10. Laneri K, Bhadra A, Ionides EL, Bouma MJ, Dhiman RC, et al. (2010) Forcing versus feedback: epidemic malaria and monsoon rains in Northwest India. PLOS Computational Biology 6: K. LaneriA. BhadraEL IonidesMJ BoumaRC Dhiman2010Forcing versus feedback: epidemic malaria and monsoon rains in Northwest India.PLOS Computational Biology6
- 11. da Silva-Nunes M, Ferreira MU (2007) Clinical spectrum of uncomplicated malaria in semi-immune Amazonians: beyond the “symptomatic” vs “asymptomatic” dichotomy. Mem Inst Oswaldo Cruz 102: 341–347.M. da Silva-NunesMU Ferreira2007Clinical spectrum of uncomplicated malaria in semi-immune Amazonians: beyond the “symptomatic” vs “asymptomatic” dichotomy.Mem Inst Oswaldo Cruz102341347
- 12. Ferreira MU, Silva-Nunes M (2010) Evidence-based public health and prospects for malaria control in Brazil. J Infect Dev Ctries 4: 533–545.MU FerreiraM. Silva-Nunes2010Evidence-based public health and prospects for malaria control in Brazil.J Infect Dev Ctries4533545
- 13. Ladeia-Andrade S, Ferreira MU, Carvalho ME, Curado I, Coura JR (2009) Age-dependent acquisition of protective immunity to malaria in riverine populations of the Amazon Basin of Brazil. Am J Trop Med Hyg 80: 452–459.S. Ladeia-AndradeMU FerreiraME CarvalhoI. CuradoJR Coura2009Age-dependent acquisition of protective immunity to malaria in riverine populations of the Amazon Basin of Brazil.Am J Trop Med Hyg80452459
- 14. Macauley C (2005) Aggressive active case detection: a malaria control strategy based on the Brazilian model. Social Science & Medicine 60: 563–573.C. Macauley2005Aggressive active case detection: a malaria control strategy based on the Brazilian model.Social Science & Medicine60563573
- 15. FUNASA (2001) Manual de Terapeutica da Malaria. Brasilia, , Brasil: Ministerio da Saude. Superintendencia de Campanhas de Saude Publica - SUCAM. FUNASA2001Manual de Terapeutica da Malaria.Brasilia, , BrasilMinisterio da Saude. Superintendencia de Campanhas de Saude Publica - SUCAM
- 16. Silva N, da Silva-Nunes M, Malafronte R, Menezes M, D'Arcadia R, et al. (2010) Epidemiology and control of frontier malaria in Brazil: lessons from community-based studies in rural Amazonia. Transactions of the Royal Society of Tropical Medicine and Hygiene 104: 343–350.N. SilvaM. da Silva-NunesR. MalafronteM. MenezesR. D'Arcadia2010Epidemiology and control of frontier malaria in Brazil: lessons from community-based studies in rural Amazonia.Transactions of the Royal Society of Tropical Medicine and Hygiene104343350
- 17. Okell LC, Ghani AC, Lyons E, Drakeley CJ (2009) Submicroscopic infection in Plasmodium falciparum-endemic populations: a systematic review and meta-analysis. The Journal of Infectious Diseases 200: 1509–1517.LC OkellAC GhaniE. LyonsCJ Drakeley2009Submicroscopic infection in Plasmodium falciparum-endemic populations: a systematic review and meta-analysis.The Journal of Infectious Diseases20015091517
- 18. O'Meara WP, Collins WE, McKenzie FE (2007) Parasite prevalence: a static measure of dynamic infections. Am J Trop Med Hyg 77: 246–249.WP O'MearaWE CollinsFE McKenzie2007Parasite prevalence: a static measure of dynamic infections.Am J Trop Med Hyg77246249
- 19. Hanscheid T, Grobusch MP (2002) How useful is PCR in the diagnosis of malaria? Trends in Parasitology 18: 395–398.T. HanscheidMP Grobusch2002How useful is PCR in the diagnosis of malaria?Trends in Parasitology18395398
- 20. Moody A (2002) Rapid diagnostic tests for malaria parasites. Clinical Microbiology Reviews 15: 66–78.A. Moody2002Rapid diagnostic tests for malaria parasites.Clinical Microbiology Reviews156678
- 21. da Silva-Nunes M, Malafronte RS, Luz BA, Souza EA, Martins LC, et al. (2006) The Acre project: the epidemiology of malaria and arthropod-borne virus infections in a rural Amazonian population. Cad Saude Publica 22: 1325–1334.M. da Silva-NunesRS MalafronteBA LuzEA SouzaLC Martins2006The Acre project: the epidemiology of malaria and arthropod-borne virus infections in a rural Amazonian population.Cad Saude Publica2213251334
- 22. da Silva-Nunes M, Codeco CT, Malafronte RS, Silva NS, Juncansen C, et al. (2008) Malaria on the Amazonian frontier: transmission dynamics, risk factors, spatial distribution, and prospects for control. Am J Trop Med Hyg 79: 624–635.M. da Silva-NunesCT CodecoRS MalafronteNS SilvaC. Juncansen2008Malaria on the Amazonian frontier: transmission dynamics, risk factors, spatial distribution, and prospects for control.Am J Trop Med Hyg79624635
- 23. Doolan DL, Dobano C, Baird JK (2009) Acquired immunity to malaria. Clinical microbiology reviews 22: 13–36.DL DoolanC. DobanoJK Baird2009Acquired immunity to malaria.Clinical microbiology reviews221336
- 24. Branscum AJ, Gardner IA, Johnson WO (2005) Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling. Preventive Veterinary Medicine 68: 145–163.AJ BranscumIA GardnerWO Johnson2005Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling.Preventive Veterinary Medicine68145163
- 25. Enoe C, Georgiadis MP, Johnson WO (2000) Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Preventive Veterinary Medicine 45: 61–81.C. EnoeMP GeorgiadisWO Johnson2000Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown.Preventive Veterinary Medicine456181
- 26. Barker RH Jr, Banchongaksorn T, Courval JM, Suwonkerd W, Rimwungtragoon K, et al. (1994) Plasmodium falciparum and P. vivax: factors affecting sensitivity and specificity of PCR-based diagnosis of malaria. Experimental Parasitology 79: 41–49.RH Barker JrT. BanchongaksornJM CourvalW. SuwonkerdK. Rimwungtragoon1994Plasmodium falciparum and P. vivax: factors affecting sensitivity and specificity of PCR-based diagnosis of malaria.Experimental Parasitology794149
- 27. Laserson KF, Petralanda I, Hamlin DM, Almera R, Fuentes M, et al. (1994) Use of the polymerase chain reaction to directly detect malaria parasites in blood samples from the Venezuelan Amazon. Am J Trop Med Hyg 50: 169–180.KF LasersonI. PetralandaDM HamlinR. AlmeraM. Fuentes1994Use of the polymerase chain reaction to directly detect malaria parasites in blood samples from the Venezuelan Amazon.Am J Trop Med Hyg50169180
- 28. Clark JS, Hersh MH (2009) Inference in incidence, infection, and impact: co-infection of multiple hosts by multiple pathogens. Bayesian Analysis 4: 337–366.JS ClarkMH Hersh2009Inference in incidence, infection, and impact: co-infection of multiple hosts by multiple pathogens.Bayesian Analysis4337366
- 29. R_Development_Core_Team (2007) R: A language and environment for statistical computing; Computing RFfS, editor. Vienna, Austria. R_Development_Core_Team2007R: A language and environment for statistical computing; Computing RFfS, editor.Vienna, Austria
- 30. Hedt BL, Pagano M (2010) Health indicators: eliminating bias from convenience sampling estimators. Statistics in Medicine 30: 560–568.BL HedtM. Pagano2010Health indicators: eliminating bias from convenience sampling estimators.Statistics in Medicine30560568
- 31. Moutinho PR, Gil LHS, Cruz RB, Ribolla PEM (2011) Population dynamics, structure and behaviour of Anopheles darlingi in a rural settlement in the Amazon rainforest of Acre, Brazil. Malaria Journal 10: PR MoutinhoLHS GilRB CruzPEM Ribolla2011Population dynamics, structure and behaviour of Anopheles darlingi in a rural settlement in the Amazon rainforest of Acre, Brazil.Malaria Journal10
- 32. Olson SH, Gangnon R, Elguero E, Durieux L, Guegan J-F, et al. (2009) Links between climate, malaria, and wetlands in the Amazon basin. Emerging Infectious Diseases 15: 659–662.SH OlsonR. GangnonE. ElgueroL. DurieuxJ-F Guegan2009Links between climate, malaria, and wetlands in the Amazon basin.Emerging Infectious Diseases15659662
- 33. Olson SH, Gangnon R, Silveira GA, Patz JA (2010) Deforestation and malaria in Mancio Lima county, Brazil. Emerging Infectious Diseases 16: 1108–1115.SH OlsonR. GangnonGA SilveiraJA Patz2010Deforestation and malaria in Mancio Lima county, Brazil.Emerging Infectious Diseases1611081115
- 34. Alves FP, Durlacher RR, Menezes MJ, Krieger H, Silva LHP, et al. (2002) High prevalence of asymptomatic Plasmodium vivax and Plasmodium falciparum infections in native Amazonian populations. Am J Trop Med Hyg 66: 641–648.FP AlvesRR DurlacherMJ MenezesH. KriegerLHP Silva2002High prevalence of asymptomatic Plasmodium vivax and Plasmodium falciparum infections in native Amazonian populations.Am J Trop Med Hyg66641648
- 35. Scopel KKG, Fontes CJF, Nunes AC, Horta MF, Braga EM (2004) High prevalence of Plasmodium malariae infections in a Brazilian Amazon endemic area (Apiacas - Mato Grosso State) as detected by polymerase chain reaction. Acta Tropica 90: 61–64.KKG ScopelCJF FontesAC NunesMF HortaEM Braga2004High prevalence of Plasmodium malariae infections in a Brazilian Amazon endemic area (Apiacas - Mato Grosso State) as detected by polymerase chain reaction.Acta Tropica906164
- 36. Katsuragawa TH, Cunha RPA, Souza DCA, Gil LHS, Cruz RB, et al. (2009) Malaria and hematological aspects among residents to be impacted by reservoirs for the Santo Antonio and Jirau Hydroeletric power stations, Rondonia State, Brazil. Cad Saude Publica 25: 1486–1492.TH KatsuragawaRPA CunhaDCA SouzaLHS GilRB Cruz2009Malaria and hematological aspects among residents to be impacted by reservoirs for the Santo Antonio and Jirau Hydroeletric power stations, Rondonia State, Brazil.Cad Saude Publica2514861492
- 37. Castro MC, Singer BMalaria foci and colonization processes on the Amazon frontier: new evidence from a spatial analysis; 2001; Salvador, Bahia, Brasil. MC CastroB. SingerMalaria foci and colonization processes on the Amazon frontier: new evidence from a spatial analysis; 2001; Salvador, Bahia, Brasil
- 38. Vittor AY, Pan W, Gilman RH, Tielsch J, Glass G, et al. (2009) Linking deforestation to malaria in the Amazon: characterization of the breeding habitat of the principal malaria vector, Anopheles darlingi. Am J Trop Med Hyg 81: 5–12.AY VittorW. PanRH GilmanJ. TielschG. Glass2009Linking deforestation to malaria in the Amazon: characterization of the breeding habitat of the principal malaria vector, Anopheles darlingi.Am J Trop Med Hyg81512
- 39. Oliveira EC, Santos ES, Zeihofer P, Souza-Santos R, Atanaka-Santos M (2011) Spatial patterns of malaria in a land reform colonization project, Juruena municipality, Mato Grosso, Brazil. Malaria Journal 10: EC OliveiraES SantosP. ZeihoferR. Souza-SantosM. Atanaka-Santos2011Spatial patterns of malaria in a land reform colonization project, Juruena municipality, Mato Grosso, Brazil.Malaria Journal10
- 40. Vittor AY, Gilman RH, Tielsch J, Glass G, Shields T, et al. (2006) The effect of deforestation on the human-biting rate of Anopheles darlingi, the primary vector of Falciparum malaria in the Peruvian Amazon. Am J Trop Med Hyg 74: 3–11.AY VittorRH GilmanJ. TielschG. GlassT. Shields2006The effect of deforestation on the human-biting rate of Anopheles darlingi, the primary vector of Falciparum malaria in the Peruvian Amazon.Am J Trop Med Hyg74311
- 41. Guerra CA, Snow RW, Hay SI (2006) A global assessment of closed forests, deforestation and malaria risk. Annals of Tropical Medicine & Parasitology 100: 189–204.CA GuerraRW SnowSI Hay2006A global assessment of closed forests, deforestation and malaria risk.Annals of Tropical Medicine & Parasitology100189204
- 42. Langhorne J, Ndungu FM, Sponaas A-M, Marsh K (2008) Immunity to malaria: more questions than answers. Nature Immunology 9: 725–732.J. LanghorneFM NdunguA-M SponaasK. Marsh2008Immunity to malaria: more questions than answers.Nature Immunology9725732
- 43. Schwartz SL, Gelfand AE, Miranda ML (2010) Joint Bayesian analysis of birthweight and censored gestational age using finite mixture models. Statistics in Medicine 29: 1710–1723.SL SchwartzAE GelfandML Miranda2010Joint Bayesian analysis of birthweight and censored gestational age using finite mixture models.Statistics in Medicine2917101723
- 44. Slasor P, Laird N (2003) Joint models for efficient estimation in proportional hazards regression models. Statistics in Medicine 22: 2137–2148.P. SlasorN. Laird2003Joint models for efficient estimation in proportional hazards regression models.Statistics in Medicine2221372148
- 45. Gardner IA, Stryhn H, Lind P, Collins MT (2000) Conditional dependence between tests affects the diagnosis and surveillance of animal diseases. Preventive Veterinary Medicine 45: 107–122.IA GardnerH. StryhnP. LindMT Collins2000Conditional dependence between tests affects the diagnosis and surveillance of animal diseases.Preventive Veterinary Medicine45107122
- 46. Branscum AJ, Gardner IA, Johnson WO (2004) Bayesian modeling of animal- and herd-level prevalences. Preventive Veterinary Medicine 66: 101–112.AJ BranscumIA GardnerWO Johnson2004Bayesian modeling of animal- and herd-level prevalences.Preventive Veterinary Medicine66101112
- 47. Joseph L, Gyorkos TW, Coupal L (1995) Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. American Journal of Epidemiology 141: 263–272.L. JosephTW GyorkosL. Coupal1995Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard.American Journal of Epidemiology141263272
- 48. Johnson WO, Gastwirth JL, Pearson LM (2001) Screening withou a “gold standard”: the Hui-Walter paradigm revisited. American Journal of Epidemiology 153: 921–924.WO JohnsonJL GastwirthLM Pearson2001Screening withou a “gold standard”: the Hui-Walter paradigm revisited.American Journal of Epidemiology153921924
- 49. Su C-L, Gardner IA, Johnson WO (2004) Diagnostic test accuracy and prevalence inferences based on joint and sequential testing with finite population sampling. Statistics in Medicine 23: 2237–2255.C-L SuIA GardnerWO Johnson2004Diagnostic test accuracy and prevalence inferences based on joint and sequential testing with finite population sampling.Statistics in Medicine2322372255
- 50. Speybroeck N, Praet N, Claes F, van Hong N, Torres K, et al. (2011) True versus apparent malaria infection prevalence: the contribution of a Bayesian approach. PLoS ONE 6: N. SpeybroeckN. PraetF. ClaesN. van HongK. Torres2011True versus apparent malaria infection prevalence: the contribution of a Bayesian approach.PLoS ONE6
- 51. O'Meara WP, McKenzie FE, Magill AJ, Forney JR, Permpanich B, et al. (2005) Sources of variability in determining malaria parasite density by microscopy. Am J Trop Med Hyg 73: 593–598.WP O'MearaFE McKenzieAJ MagillJR ForneyB. Permpanich2005Sources of variability in determining malaria parasite density by microscopy.Am J Trop Med Hyg73593598
- 52. Markus MB (2011) The hypnozoite concept, with particular reference to malaria. Parasitol Res 108: 247–252.MB Markus2011The hypnozoite concept, with particular reference to malaria.Parasitol Res108247252
- 53. Juliano JJ, Gadalla N, Sutherland CJ, Meshnich SR (2010) The perils of PCR: can we accurately ‘correct’ antimalarial trials? Trends in Parasitology 26: 119–124.JJ JulianoN. GadallaCJ SutherlandSR Meshnich2010The perils of PCR: can we accurately ‘correct’ antimalarial trials?Trends in Parasitology26119124