Trials of intermittent preventive treatment in infants (IPTi) and children (IPTc) have shown promising results in reducing malaria episodes but with varying efficacy and cost-effectiveness. The effects of different intervention and setting characteristics are not well known. We simulate the effects of the different target age groups and delivery channels, seasonal or year-round delivery, transmission intensity, seasonality, proportions of malaria fevers treated and drug characteristics.
We use a dynamic, individual-based simulation model of Plasmodium falciparum malaria epidemiology, antimalarial drug action and case management to simulate DALYs averted and the cost per DALY averted by IPTi and IPTc. IPT cost components were estimated from economic studies alongside trials.
IPTi and IPTc were predicted to be cost-effective in most of the scenarios modelled. The cost-effectiveness is driven by the impact on DALYs, particularly for IPTc, and the low costs, particularly for IPTi which uses the existing delivery strategy, EPI. Cost-effectiveness was predicted to decrease with low transmission, badly timed seasonal delivery in a seasonal setting, short-acting and more expensive drugs, high frequencies of drug resistance and high levels of treatment of malaria fevers. Seasonal delivery was more cost-effective in seasonal settings, and year-round in constant transmission settings. The difference was more pronounced for IPTc than IPTi due to the different proportions of fixed costs and also different assumed drug spacing during the transmission season. The number of DALYs averted was predicted to decrease as a target five-year age-band for IPTc was shifted from children under 5 years into older ages, except at low transmission intensities.
Modelling can extend the information available by predicting impact and cost-effectiveness for scenarios, for outcomes and for multiple strategies where, for practical reasons, trials cannot be carried out. Both IPTi and IPTc are generally cost-effective but could be rendered cost-ineffective by characteristics of the setting, drug or implementation.
Citation: Ross A, Maire N, Sicuri E, Smith T, Conteh L (2011) Determinants of the Cost-Effectiveness of Intermittent Preventive Treatment for Malaria in Infants and Children. PLoS ONE 6(4): e18391. https://doi.org/10.1371/journal.pone.0018391
Editor: Erika Martins Braga, Universidade Federal de Minas Gerais, Brazil
Received: December 3, 2010; Accepted: February 28, 2011; Published: April 7, 2011
Copyright: © 2011 Ross et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by The Bill and Melinda Gates Foundation grant numbers 39777, 38479 and 33679. The funders had no role in study design, analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
An estimated 250 million episodes of malaria led to nearly one million deaths in 2008, the brunt of which was borne by young children and infants in sub-Saharan Africa . In addition to its impact on the health of individuals, malaria places considerable costs on households –, communities  and nations , .
Intermittent preventive treatment in infants (IPTi) and children (IPTc) have received attention in recent years as potential interventions to reduce malaria morbidity and mortality. Both follow the same strategy: to deliver a full course of an anti-malarial treatment to a population at risk at specified time points whether or not they are known to be infected , . Both aim to retain the benefits of chemoprophylaxis whilst avoiding the acceleration of drug resistance or impairing the development of acquired immunity –.
The two interventions differ in their target age group and delivery system. By targeting infants under 12 months, IPTi is able to benefit from the existing delivery strategy of the Expanded Programme on Immunization (EPI). The delivery of IPTi involves training health workers to administer a dose of an antimalarial drug during routine scheduled visits in health facilities and to document this using modified EPI monitoring tools , . IPTc has targeted mainly children up to the age of five years – but also older age groups  and school children –. In children under five years, IPTc has no established delivery system but studies have used community health workers and outreach clinics to provide doses for the target age-group , . Studies have mostly focused on IPTc as a seasonal intervention in settings with seasonal transmission.
Both IPTi and IPTc have been found to reduce clinical incidence. Several clinical trials in different settings have shown IPTi to be effective against malaria to varying degrees –. A pooled analysis of data from six completed trials of IPTi with sulfadoxine-pyrimethamine (SP) estimated a 30% (95% CI 20%, 39%) protective efficacy (PE) against clinical malaria and 38% (13%, 56%) PE against hospital admissions with malaria parasites . Studies using drugs other than SP found that efficacious, long-lasting drugs had a greater PE than shorter-acting drugs or drugs with high levels of resistance , . Seasonal IPTc with combinations of SP, artesunate (AS) and amodiaquine (AQ) has been seen to reduce the incidence of clinical malaria in children under the age of five years in settings with a short malaria transmission season , , ,  and where the transmission season is longer , . A pooled analysis of IPTc trials estimated a 75% (64%, 83%) protective efficacy against malaria episodes during the intervention period . The trials were not designed to detect an impact on mortality due to the very large sample sizes required.
There have been costing and cost-effectiveness studies alongside many of the IPT trials , , , –. In nearly all of the studies where IPT was efficacious, it was highly cost-effective. In sites where IPTi had a significant effect, the cost per malaria episode averted for IPTi-SP ranged from US$ 1.36 to 4.03 based on trial specific data . For IPTi using more expensive antimalarials, the cost per treated episode averted ranged from US$4.62 using AQAS to US$ 18.56 using mefloquine (MQ) . For seasonal IPTc, a trial in Ghana estimated the costs per episode averted for three different regimens administered over the six month transmission period. Bimonthly SP cost $105 ($75, $157) per treated episode averted, bimonthly ASAQ was $212 ($127, $399) and monthly ASAQ was US$68 ($62, $75) . The estimates for district scale-up fell to $28, $60 and $22 respectively . In addition, where efficacious, IPT reduced health system costs and showed significant savings to households from malaria episodes averted.
The variations in efficacy and cost-effectiveness between trials stem not only from the choice of drug but also from the different setting and trial characteristics such as transmission intensity, timing of delivery, local costs and use of other interventions. This raises questions that the trials were not designed to answer such as the effects of the different characteristics, the impact on severe malaria and mortality, and the limits beyond which IPT is no longer cost-effective –. It is not feasible to carry out a large number of large field trials of different combinations to determine the impact of each factor on different malariological outcomes. Where data cannot be collected, mathematical modelling can be used to provide predictions.
In this paper, we use a comprehensive model of Plasmodium falciparum epidemiology and economics  to investigate the influence of different variables on the effects and the cost-effectiveness of IPT in preventing disability adjusted life years (DALYs): target age group and delivery channel, seasonal or year-round delivery, transmission intensity and seasonality of the setting, the timing of the first IPT dose for seasonal delivery, different coverage levels of treatment for malaria fevers and the impact of drug resistance. We also predict the impact of IPT on transmission intensity.
The simulation model
We use a dynamic, individual-based, stochastic simulation of malaria epidemiology which has been described elsewhere . Briefly, there is a simulated population of humans who are updated at each five-day time step via model components representing new infections, parasite densities, acquired immunity, uncomplicated and severe episodes, direct and indirect malaria mortality, infectivity to mosquitoes and case management. This study does not include simulation of anaemia. The course of parasite densities over an infection are described by averaged empirical data . Immunity to asexual parasites is derived from a combination of cumulative exposure to both inoculations and parasite densities, and maternal immunity . The inclusion of acquired immunity allows us to model potential effects of IPT on immunity through loss of exposure and the inclusion of infectivity captures potential effects on transmission intensity. The probability of a clinical attack of malaria depends on the current parasite density and a pyrogenic threshold . The pyrogenic threshold responds dynamically to recent parasite load, increasing or saturating with exposure to parasites and decaying with time, and thus is individual-and time- specific. Severe malaria can arise in two ways, either as a result of overwhelming parasite densities or through uncomplicated malaria with concurrent non-malaria co-morbidity . Mortality can be either direct (following severe malaria) or indirect (uncomplicated malaria in conjunction with co-morbidity, or during the neonatal period as a result of maternal infection). Thus the model does not assume a fixed case fatality rate for malaria episodes, but makes a number of intermediary assumptions to model pathways from an acute episode to death. The parameter values for each of the components of the model were estimated by fitting to data from a total of 61 malaria field studies of different aspects of malaria epidemiology  and are reported elsewhere . The model has been validated using age-specific results from six IPTi trials with SP . It has subsequently been validated against trials of IPTc , .
We simulate seasonal and non-seasonal delivery for both IPTi and IPTc to allow us to separate the effects of seasonal delivery from the combination of the intervention target age-group and delivery channel. We simulate two contrasting seasonal patterns (constant and highly seasonal transmission) and two IPT drugs (SP and ASAQ). These four factors have two levels each making a set of 16 baseline intervention scenarios (Table 1). For each of these scenarios, we then investigated the impact of varying levels of drug resistance, transmission intensity, the timing of seasonal implementation and the proportion of malaria fevers which are effectively treated (Table 2). We also simulate the impact of either widening the target IPTc age group or shifting it into older ages. We simulate 10 seeds for each scenario each of a population of 100,000 individuals aged up to 90 years over ten years from the introduction of the IPT programme.
Delivery frequency and modality of IPTc and IPTi in the baseline scenarios
For IPTi, the EPI visits were assumed to be scheduled at 3, 4 and 9 months of age (Table 1). For seasonal delivery, only infants who were presented for their EPI visits during the short transmission season received the doses and so no infant would receive all three doses.
The baseline target IPTc age group was 3 months to 5 years. We model IPTc delivery either every two months throughout the year or as three IPTc doses at monthly intervals during the malaria season. IPTc was assumed to be delivered, and costed, via community health workers (CHWs) who were individuals in the community given a small financial incentive to deliver IPTc. Studies in The Gambia and Ghana found that CHWs were able to reach more children under five years than outreach services linked to EPI , . The timing of the doses relative to the start of the season for seasonal delivery is shown in Figure 1. In the baseline scenarios, we assumed that IPTi coverage was 95% per dose (86% for 3 doses)  and that IPTc coverage was 84% per dose for CHW , . ASAQ includes 3 tablets to be taken on 3 consecutive days: we assumed that compliance with the tablets given to carers to administer at home was 100%. Compliance has been reported to be 88% to 99% in trial settings , , , .
The shaded area is the 3 month period of IPT delivery. The seasonal pattern follows that reported for Niakhar, Senegal .
We simulate two drugs, ASAQ and SP, both of which have previously been chosen for IPT trials. They demonstrate different characteristics: SP is a cheap, long-acting drug with high levels of resistance whereas ASAQ is a more expensive, shorter-acting drug currently meeting less drug resistance. We recognise that there are other potential IPT drug candidates that we have not included, nevertheless, the contrasting characteristics of these two drugs demonstrate the substantive effects.
A simple model component for antimalarial drug action  was adapted from Hastings and Watkins  and incorporated into the simulations. Briefly, the ability of SP and ASAQ to both clear existing infections and to prevent new infections becoming established depends on the genotype of the infection. Infections are assigned genotypes randomly according to assumed frequencies (Table 2). Hastings and Watkins quantify the chances of failing treatment with correct dosing of SP for wildtype infections and infections with single, double and triple dihydrofolate reductase (dhfr) mutations conferring resistance at 0, 0, 0, 50% respectively while periods of prophylactic effects are 52, 12, 12, 2 days . We round these to the five-day timesteps used by the model. For ASAQ, we assume that all infections are cleared and that for AQ-sensitive infections, the prophylactic period is assumed to be 15 days and for AQ-resistant infections, 0 days –.
The costs (Table 3) were based on economic evaluations conducted in a range of IPTi and IPTc sites , , , . Similar cost categories and methodological costing approaches were used for both interventions covering district costs associated with community sensitization, behaviour change and communication, drug distribution and administration, training and supervision. The costs were identified from components of trial budgets and primary data on resource use. Care was taken to exclude costs relating specifically to research or to a trial environment. We costed IPTc only in the baseline target age group of 3 months to 5 years since while schools may be used for some age groups , the delivery mechanisms for others are unclear. Costs of incentivising the CHW who delivers the IPTc drugs to an assumed 250 children were included in administration costs to reflect an allowance of approximately US$10 a month during the months of administration , . The costs of the IPT drugs were based on prices presented on the International Drug Price Indicators List : SP was assumed to cost $0.02 per dose and ASAQ $0.36 per course of three tablets. Remainder fractions of tablets were assumed to be wastage. The cost of the intervention to households was found to be negligible and therefore excluded . The cost per dose of IPT drugs, delivery and administration remained unchanged for each dose irrespective of the number of doses given. The costs of training, sensitization and a minimum level of supervision were assumed to be fixed over the course of the year and therefore the unit cost per dose of IPT year-round was less than that of seasonal delivery. This assumption was based on trial activity and discussions with implementers about how IPT would be delivered if introduced as part of routine activity. Whether the doses were given throughout the year or concentrated in three months, a one-off training would be held each year for those involved in delivering IPT. Sensitization activities would involve the same resources even though the message about IPT frequency would be different. Supervision was assumed to be semi-fixed in that a minimum would be required and so it would be slightly more intense for seasonal than year-round IPT. The costs were calculated in US$2006 to be comparable with previous costs for case management , all costs were then inflated to US$2009 using US dollar inflation rates .
Potential cost savings of IPT
The simulations include direct malaria treatment costs to both the providers and households. We do not include indirect costs such as potential earnings forgone by the carers . The health system adopted is based on a previously used model  with artemisinin combination therapy as the first-line treatment with low rates of access. The case management costs assumed have been previously published .
The approach adopted follows previous work on modelling the cost-effectiveness of malaria vaccines ,  and follows standard practices , . The primary epidemiological outcome was the number of DALYs averted since they are a comparable, summary measure of the burden. One DALY represents a year of healthy life lost. Years of life lived with disability were calculated on the basis of the duration of disability and the disability weights for the different malaria attributable disease conditions obtained from the Global Burden of Disease study . DALYs were calculated assuming age-specific life expectancies typical for an East African setting with low malaria transmission ,  and with no age weighting to follow standard cost-effectiveness practices . Future costs and health gains are discounted at 3%. The cost-effectiveness ratios are to be interpreted as incremental cost-effectiveness ratios (ICERs) of implementing the interventions in the simulated scenarios relative to a do nothing scenario which corresponds to maintaining only case management.
Recognising that the selection of cost-effectiveness thresholds in published literature is subjective , we refer to the conservative cut off point of US$ 223 per DALY averted to reflect a cost-effective intervention, and US$ 37 per DALY averted to reflect a highly cost-effective intervention. These thresholds are based on US$ 150 and US$ 25 thresholds suggested by the World Bank in 1993 ,  and inflated to their 2009 equivalent.
Both IPTc and IPTi were cost-effective in a wide range of simulated settings.
Seasonal and year-round delivery in seasonal and perennial transmission settings
The effect of seasonal delivery depends on the seasonal pattern of transmission. In the constant transmission setting (Figure 2 top row), year-round delivery averts a greater number of DALYs than seasonal delivery for both IPTi and IPTc (Figure 2 a and c). Year-round delivery is also more cost-effective than seasonal delivery, substantially so for IPTc whereas for IPTi the difference is less pronounced. As well as the different unit costs, the different spacing of doses in combination with the assumed prophylactic periods contribute to year-round IPTc delivery being more cost-effective. For IPTi, the numbers of DALYs averted are proportional to the numbers of doses administered.
Blue filled circles: year-round IPTc in children aged 3 months to 5 years, blue hollow circles: seasonal IPTc, red filled triangles: year-round IPTi, red hollow triangles: seasonal IPTi. Top row (constant transmission): a) DALYs averted and b) cost per DALY averted for IPT with SP c) DALYs averted and d) cost per DALY averted for IPT with ASAQ. Bottom row (Niakhar seasonality): e) DALYs averted and f) cost per DALY averted for IPT with SP, g) DALYs averted and h) cost per DALY averted for IPT with ASAQ. The baseline scenario values are given in Tables 1 and 2. Simulated individuals are aged 0–90 years. There is a large degree of stochasticity in costs per DALY where few DALYs are averted.
In the highly seasonal setting (Figure 2, bottom row), the numbers of DALYs averted are much closer for seasonal and year-round delivery since there are few episodes outside the main transmission season. In this case, seasonal delivery is more cost-effective than year-round for both IPTi and IPTc due to the lower total costs.
Transmission intensity and target age group
We focus on the lower end of the range of transmission because interest lies in determining where IPT is not cost-effective (Figure 2). For all of the IPT strategies, the predicted number of DALYs averted is low at low transmission intensities and increases up to a plateau at moderate levels decreasing slightly at very high transmission intensities. This slight decrease in DALYs averted at high transmission intensities occurs despite increasing predicted total numbers of DALYs in the scenarios with no IPT. The predictions suggest that IPTi and IPTc are cost-effective, although not highly cost-effective, at the low transmission intensities simulated. With zero transmission, IPT would clearly not be cost-effective. A clear lower limit below which IPT is not cost-effective is not obvious: care should be taken with interpretation since the model was created using data mainly from medium and high transmission settings and so there is greater uncertainty in predictions for low transmission intensity settings. The predictions do however indicate an approximately log-linear relationship.
Since the age-distribution of episodes is affected by transmission intensity , , the relative impact at a low transmission intensity was compared for IPTc and IPTi for uncomplicated episodes, severe episodes and deaths (Figure 3). IPTc averts more clinical events than IPTi in the simulated scenarios, and the ratio of clinical events averted by IPTc to IPTi is greater at an EIR of 1 than at an EIR of 21. The size of the ratio, however, depends on the outcome and the seasonality of the setting.
Blue filled circles: year-round IPTc in children aged 3 months to 5 years, blue hollow circles: seasonal IPTc, red filled triangles: year-round IPTi, red hollow triangles: seasonal IPTi. The baseline scenario values are given in Tables 1 and 2. Simulated individuals are aged 0–90 years.
The predicted number of DALYs averted increased as the target age group for IPTc was widened to include older children for all transmission levels simulated (Figure 4, top row), although the number of DALYs averted per IPT dose decreased. Since the predictions cover the first ten years of an IPT programme they will not include potential rebound effects in those receiving IPT for long periods of time. Increasing the target ages of a five-year wide age-band for IPTc (Figure 4 bottom row) lead to a decrease in DALYs averted with increasing age for settings with an EIR of 6 and 21. The scenario with an EIR of 1, however, increased gently to a maximum at 20 years. This prediction is highly uncertain, and is driven in the model by the increased surface area of the individual leading to a higher number of mosquito bites. Nevertheless, the predictions suggest that IPT would be more beneficial in older age groups at very low transmission intensities.
Light blue circles = EIR 1; mid-blue diamonds = EIR 6; dark blue squares = EIR 21. Top row (widening age groups): DALYs averted and DALYs averted per dose for constant seasonality with year-round IPTc a) and b), and Niakhar seasonality with seasonal IPTc c) and d). Bottom row: shifting five-year age-bands.
Choice of IPT drug
In all of our simulated scenarios, SP averted a greater number of DALYs and was more cost-effective than ASAQ. This is driven by the longer prophylactic period of SP, the lower costs and the low levels of drug resistance we have assumed.
Timing of first dose in seasonal settings
The cost-effectiveness of seasonal delivery of IPTi and IPTc in a highly seasonal setting is sensitive to the timing of the first dose (Figure 5). Too early or too late and at least part of the treatment and prophylactic actions of the drug are wasted. There is some leeway however and SP was less sensitive to timing than ASAQ due to the longer prophylactic period. If the three-month delivery period was begun very early, very few DALYs were averted and the corresponding costs per DALY were subject to considerable stochasticity: these values could not be included on the figures. Whilst the extent of mistiming is unlikely to be three months in practice, these predictions show that badly timed implementation can push IPT over the cost-effectiveness threshold.
Blue hollow circles: seasonal IPTc in children aged 3 months to 5 years, red hollow triangles: seasonal IPTi. Very high and low costs per DALY were not included for early implementations where the number of DALYs averted were very low since these values were subject to considerable stochasticity. The baseline scenario values are given in Tables 1 and 2. Simulated individuals are aged 0–90 years.
Proportions of malaria fevers treated
As treatment coverage increases the number of DALYs averted by IPT decreases and the costs per DALY increase (Figure 6). This is driven by a reduction in the total DALY burden: the prompt treatment prevented severe malaria and deaths and cleared infections which could later produce symptoms and the high treatment coverage of all age groups lead to a small reduction in transmission. There was no apparent synergy between health system coverage and IPT. At very high treatment coverage levels using ASAQ, some scenarios are no longer cost-effective. However, this only occurred at treatment levels which would be unrealistic even for very good health-systems.
Blue filled circles: year-round IPTc in children aged 3 months to 5 years, blue hollow circles: seasonal IPTc, red filled triangles: year-round IPTi, red hollow triangles: seasonal IPTi. Top row (constant transmission): a) DALYs averted and b) cost per DALY averted for IPT with SP c) DALYs averted and d) cost per DALY averted for IPT with ASAQ. Bottom row (Niakhar seasonality): e) DALYs averted and f) cost per DALY averted for IPT with SP, g) DALYs averted and h) cost per DALY averted for IPT with ASAQ. The baseline scenario values are given in Tables 1 and 2. Simulated individuals are aged 0–90 years.
We simulated the effect of varying levels of drug resistance for year-round IPTi and seasonal IPTc both with SP only. In both cases, the number of DALYs averted decreased with rising drug resistance and the corresponding cost-effectiveness decreased. In all of the scenarios simulated, IPT remained cost-effective. However, if a drug has no effect whatsoever, then clearly this would not be the case , . We did not simulate levels of resistance which would render SP completely ineffective. The linear pattern between DALYs averted and drug sensitivity (Figure 7a) was also observed for constant seasonality and for other transmission intensities with an annual EIR of 1 and 200 (not shown).
Blue hollow circles: seasonal IPTc, red filled triangles: year-round IPTi. SP sensitivity is quantified as the proportion of wildtype infections with no dhfr nutations, with the remainder being divided 50:50 between infections with dhfr single or double and triple mutations. The action of SP varies according to these genotypes (Methods section). The baseline scenario values are given in Tables 1 and 2. Simulated individuals are aged 0-90 years.
The predictions suggest that both IPTi and IPTc are cost-effective in the majority of scenarios simulated, even with the conservative thresholds we have used. In general, IPTc averted a greater number of DALYs than IPTi, but the costs were greater and consequently the costs per DALY averted were greater. A greater number of DALYs are averted for both IPTc and IPTi by year-round compared to seasonal delivery in perennial transmission settings, but similar numbers of DALYs are averted in seasonal settings since there are few episodes outside the main transmission season. Seasonal delivery is more cost-effective in seasonal settings, and year-round in constant transmission settings. However the difference is more pronounced for IPTc than IPTi due to the different proportions of fixed costs and also different assumed drug spacing during the transmission season. Cost-effectiveness was predicted to decrease with decreasing transmission, badly timed seasonal delivery in a seasonal setting, short-acting and more expensive drugs, increased frequencies of drug resistance and increasing levels of treatment coverage. A greater number of DALYs were averted as the target age groups were widened to include older children for IPTc in all simulated transmission settings, although the number of DALYs averted per IPT dose fell slightly. The number of DALYs averted decreased as the target ages for a five-year age-band were increased except for very low transmission intensities. This concurs with a systematic review of the age-distribution of episodes by transmission intensity in children , however the burden in adults is not well established.
Our aim was not to pit IPTc and IPTi against each other since they are both interventions focusing on drug administration and differing only in target age group and delivery system. Instead, we aimed to tease out the contribution of seasonal delivery in different settings for both interventions and to investigate factors which affect their impact and cost-effectiveness. We selected a limited number of scenarios in order to focus on a manageable number of questions and to investigate the substantive effects. We recognize that there are many other potential scenarios differing in characteristics such as IPT schedule, target age groups, candidate drugs, seasonal patterns and also equity and heterogeneity in IPT coverage .
The costs of an IPT programme are largely driven by the cost of the IPT drug and, in the case of IPTc, delivery since it does not benefit from the existing delivery strategy EPI. The predicted cost- effectiveness is driven by the low costs, particularly for IPTi, and the impact on DALYs, particularly for IPTc. The DALYs were dominated by the contribution from deaths.
Our predicted costs per episode averted are generally lower than estimates from clinical trials. The predicted cost per uncomplicated episode averted ranges from $1.08 to 17.59 for seasonal IPTc including all the values for transmission intensity (Figure 3), drug resistance and treatment coverage in comparison to $22 to $60 per treated episode estimated for district delivery from trial data . For year-round IPTi with SP, the predicted cost per episode averted ranges from $0.42 to $7.71 (Figure 3 and not shown) compared to $1.36 to $11.93 per treated episode from trial studies . Although our predictions are not of the specific trials and so differ in many ways, the largest single reason for the difference is that we have predicted all episodes whereas the trial data refers to treated episodes only. Our model for acute episodes  is fitted to data from Ndiop and Dielmo in Senegal where intensive daily active surveillance was carried out  thus capturing episodes unavoidably missed by passive case detection.
The predicted cost-effectiveness of IPTc and IPTi is in line with other malaria control interventions. Inflating using US dollars only to US$ 2009, the cost per DALY averted of insecticide-treated net programmes is estimated to range from $14 to $74 –, and for indoor residual spraying, US$131–145 . Case management is estimated to cost between $11 and $31 depending on the treatment drug and for IPTp estimates vary from $42 to approximately $422 per DALY averted , .
The question of where the boundaries of IPT cost-effectiveness lie has been raised, particularly for transmission intensity , . Our predictions show that, as transmission intensity decreases to low levels, the number of DALYs averted decreases and the corresponding cost per DALY increases. Unfortunately, while the log-linear nature of the relationship is apparent from our predictions, a boundary where IPTc and IPTi are no longer cost-effective is not. Even at low transmission intensities, IPT is predicted to be cost-effective although not highly cost-effective according to the World Bank thresholds however IPT would clearly not be cost-effective if there was no transmission. Caution must be taken with interpreting the predictions for settings with low transmission intensities since the model was created used data from mainly medium and high transmission settings and does not take into account variables such as heterogeneity in transmission or decay of immunity which may have strong effects in low transmission settings . In addition, children under five years old are not predicted to be the optimum target group at very low transmission intensities and the combination of other factors is important, for example higher frequencies of drug resistance would increase the levels of transmission intensity at which IPT is no longer cost-effective.
Both IPTi and IPTc in children under five years of age were predicted to have negligible effects on transmission in this study. This agrees with previous predictions of IPT in these target age groups ,  although simulations of IPTc in children aged 5 to 18 years suggested a reduction in transmission . These results indicate that a wider target age range including older children would be necessary to reduce transmission, such as is being considered for mass screen and treat.
An increased incidence of clinical episodes following the end of the prophylactic period was observed in some IPTi trials, but not others . In the seasonal IPTc trials which followed the participants up over the following season, no rebound effects were observed in individual trials , ,  but a meta-analysis indicated a small increase in the incidence of clinical episodes . A previous study of year-round IPTi predicted a modest increase in susceptibility following the prophylactic period which was outweighed by the cumulative benefits . The model would also predict this same pattern for IPTc doses in older children, although to a much lesser extent if there is a seasonal break in transmission. Monthly SP may be akin to chemoprophylaxis  after which rebounds have been observed , . In practice, whether IPT equates to chemoprophylaxis would depend on coverage, the timing of delivery and levels of drug resistance.
Limitations of the model components are discussed elsewhere –, –. Some assumptions are especially relevant to this study. The predictions are likely to be sensitive to parameters relating to age-patterns and outcomes of severe disease in the first years of life. The predictions of indirect malaria mortality, and to a lesser extent, severe episodes rely on age-dependent co-morbidity functions. In a trial setting with access to good health care, the age-pattern of co-morbidity may be quite different to that assumed by our models, which were fitted to datasets from other settings . This would affect age-dependent comparisons such as between IPTc and IPTi, and post-intervention effects. We acknowledge that a limitation of this study is the lack of a full sensitivity analysis. We are currently developing an interface which will facilitate extensive probability sensitivity analyses. Additionally, an ensemble of models with alternative assumptions where uncertainty exists would provide information on model sensitivity.
The model component for the action of antimalarial drugs was compatible with our within-host model. The drugs are assumed to act on the infection, either clearing or sparing it. This model would be unable to account for observed effects such as density-dependent cure rate or effects of acquired immunity. More sophisticated models for within-host parasite dynamics and drug concentrations are in preparation.
We used DALYs as an aggregate measure to minimise the number of predictions presented. They are an imperfect measure and depend on value judgements for the disability weighting, discounting and age-weighting and on the life table used , . We followed standard practices, and calculated the DALYs with no age weighting recognizing that there is a lack of consensus on this issue , .
The simulations assume a low coverage of case-management and no other interventions. This is a common approach which measures the ‘full’ impact of an intervention and offers consistency when comparing ICERs. However, we recognise decision makers may already have a variety of interventions in operation and want to know the incremental benefit of changing their existing status quo. Model components for other interventions are under development and these predictions for IPT contribute to a growing database of the likely effectiveness of different malaria control strategies generated using a common simulation platform.
When considering IPTc or IPTi for a specific location, both the local characteristics and issues other than epidemiological impact and cost-effectiveness should be considered. This study does not address issues of affordability nor of safety, development of drug resistance, first line treatment drug choice, sustainability or malaria species other than P. falciparum.
In conclusion, modelling can extend the information available to policy-makers by providing predictions of the likely impact and cost-effectiveness for settings, for outcomes and for multiple strategies where, for practical reasons, trials cannot be carried out. Our predictions indicate that both IPTi and IPTc can be cost-effective interventions in a range of settings. This cost-effectiveness is driven by low delivery costs and the predicted impact on mortality. Both IPTi and IPTc could be rendered cost-ineffective by very low transmission, mis-timed seasonal delivery, ineffective drugs, very high treatment coverage or combinations of these factors. Seasonal delivery is more cost-effective in seasonal settings and year-round in constant transmission settings, the difference is more pronounced for IPTc than IPTi. Predictions suggested that the optimum target age group for IPT in settings with a very low transmission intensity would include children over five years.
We are grateful for comments from Rick Steketee, Alan Brooks, the members of the Technical Advisory Group (Michelle Gatton, Azra Ghani, Simon Hay, Steve Lindsay, Kevin Marsh, David Schellenberg) and two anonymous reviewers. We thank the many volunteers who donated computing power via malariacontrol.net. We are grateful to Alain Studer, Diggory Hardy, Aurelio Di Pasquale and Michael Tarantino for software development.
Developed the software architecture: NM. Conceived and designed the experiments: AR LC. Performed the experiments: AR NM. Wrote the paper: AR NM ES TS LC.
World Health Organization (2009) World malaria report 2009. Geneva, WHO.
- 2. Asenso-Okyere W, Dzator J (1997) Household cost of seeking malaria care. A retrospective study of two malaria districts in Ghana. Soc Sci Med 45: 659–667.
- 3. Deressa W, Hailemariam D, Ali A (2007) Economic costs of epidemic malaria to households in rural Ethiopia. Trop Med Int Health 12: 1148–1156.
- 4. Wiseman V, McElroy B, Conteh L, Stevens W (2006) Malaria prevention in The Gambia: patterns of expenditure and determinants of demand at the household level. Trop Med Int Health 11: 419–431.
- 5. Owusu-Agyei S, Awini E, Anto F, Mensah-Afful T, Adjuik M, et al. (2007) Assessing malaria control in the Kassena-Nankana district of northern Ghana through repeated surveys using the RBM tools. Malar J 6: 103.
- 6. Kiszewski A, Johns B, Schapira A, Delacollette C, Crowell V, et al. (2007) Estimated global resources needed to attain international malaria goals. Bull WHO 85: 623–630.
Sachs J (2001) Macroeconomics and health: investing in health for economic
development. Geneva, WHO.
- 8. Egan A, Crawley J, Schellenberg D (2005) Intermittent preventive treatment for malaria control in infants: moving towards evidence-based policy and public health action. Trop Med Int Health 10: 815–817.
- 9. Greenwood B (2006) Review: intermittent preventive treatment - a new approach to the prevention of malaria in children in areas with seasonal malaria transmission. Trop Med Int Health 11: 983–991.
- 10. Grobusch M, Egan A, Gosling R, Newman R (2007) Intermittent preventive therapy for malaria: progress and future directions. Curr Opin Infect Dis 20: 613–620.
- 11. O'Meara W, Breman J, McKenzie F (2005) The promise and potential challenges of intermittent preventive treatment for malaria in infants (IPTi). Malar J 4: 33.
- 12. Manzi F, Schellenberg J, Hamis Y, Mushi A, Shirima K, et al. (2009) Intermittent preventive treatment for malaria and anaemia control in Tanzanian infants: the development and implementation of a public health strategy. Trans Roy Soc Trop Med Hyg 103: 79–86.
- 13. Manzi F, Hutton G, Schellenberg J, Tanner M, Alonso P, et al. (2008) From strategy development to routine implementation: the cost of intermittent preventive treatment in infants for malaria control. BMC Health Services Res 8: 165.
- 14. Konaté A, Yaro J, Ouédraogo A, Diarra A, Gansané A, et al. (2011) Intermittent preventive treatment of malaria provides substantial protection against malaria in children already protected by an insecticide treated bednet in Burkina Faso: A randomised, double-blind, placebo-controlled trial PLoS Med 8: e1000408.
- 15. Dicko A, Diallo A, Tembine I, Dicko Y, Dara N, et al. (2011) Intermittent preventive treatment of malaria provides substantial protection against malaria in children already protected by an insecticide treated bednet in Mali: A randomised, double-blind, placebo-controlled trial PLoS Med 8: e1000407.
- 16. Sokhna C, Cissé B, Ba E, Milligan P, Hallett R, et al. (2008) A trial of the efficacy, safety and impact on drug resistance of four drug regimens for seasonal intermittent preventive treatment for malaria in Senegalese children. PLoS ONE 3: e1471.
- 17. Cisse B, Sokhna C, Boulanger D, Milet J, Ba E, et al. (2006) Seasonal intermittent preventive treatment with artesunate and sulfadoxine-pyrimethamine for prevention of malaria in Senegalese children: a randomised, placebo-controlled, double-blind trial. Lancet 367: 659–667.
- 18. Cisse B, Cairns M, Faye E, NDiaye O, Faye B, et al. (2009) Randomized trial of piperaquine with sulphadoxine-pyrimethamine or dihydroartemisinin for malaria intermittent preventive treatment in children. PLoS ONE 4: e7164.
- 19. Kweku M, Liu D, Adjuik M, Binka F, Seidu M, et al. (2008) Seasonal intermittent preventive treatment for the prevention of anaemia and malaria in Ghanaian children: a randomized, placebo-controlled trial. PLoS ONE 3: e4000.
- 20. Kweku M, Webster J, Adjuik M, Abudey S, Greenwood B, Chandramohan D (2010) Options for the delivery of intermittent preventive treatment for malaria to children: a community randomised trial PLoS ONE 4: e7256.
- 21. Bojang K, Akor F, Conteh L, Webb E, Bittaye O, et al. (2011) Two strategies for the delivery of IPTc in an area of seasonal malaria transmission in The Gambia: A randomised controlled trial PLoS Med 8: e1000409.
- 22. Bojang K, Akor F, Bittaye O, Conway D, Bottomley C, et al. (2010) A randomised trial to compare the safety, tolerability and efficacy of three drug combinations for intermittent preventive treatment in children. PLoS ONE 5: e11225.
- 23. Dicko A, Sagara I, Sissoko M, Guindo O, Diallo A, et al. (2008) Impact of intermittent preventive treatment with sulphadoxine-pyrimethamine targeting the transmission season on the incidence of clinical malaria in children in Mali. Malar J 7: 123.
- 24. Barger B, Maiga H, Traore H, Tekete M, Tembine I, et al. (2009) Intermittent preventive treatment using artemisinin-based combination therapy reduces malaria morbidity among school-aged children in Mali. Trop Med Int Health 14: 784–791.
- 25. Clarke S, Jukes M, Njagi J, Khasakhala L, Cundill B, et al. (2008) Effect of intermittent preventive treatment of malaria on health and education in schoolchildren: a cluster-randomized, double-blind, placebo-controlled trial. Lancet 372: 127–138.
- 26. Temperley M, Mueller D, Njagi J, Akhwale W, Clarke S, et al. (2008) Costs and cost-effectiveness of delivering intermittent preventive treatment through schools in western Kenya. Malar J 7: 196.
- 27. Rohner F, Zimmerman M, Amon R, Vounatsou P, Tschanen A, et al. (2010) In a randomized controlled trial of iron fortification, anthelminthic treatment, and intermittent preventive treatment of malaria for anemia control in Ivorian children, only anthelminthic treatment shows modest benefit. J Nutr 140: 635–641.
- 28. Chandramohan D, Owusu-Agyei S, Carneiro I, Awine T, Amponsa-Achiano K, et al. (2005) Cluster randomised trial of intermittent preventive treatment for malaria in infants in area of high, seasonal transmission in Ghana. BMJ 331: 727–733.
- 29. Grobusch M, Lell B, Schwarz N, Gabor J, Dornemann J, et al. (2006) Intermittent preventive treatment against infants in Gabon - a randomized, double-blind, placebo-controlled trial. J Inf Dis 196: 1595–1602.
- 30. Macete E, Aide P, Aponte J, Sanz S, Mandomando I, et al. (2006) Intermittent preventive treatment for malaria control administered at the time of routine vaccinations in Mozambican infants: a randomized, placebo-controlled trial. J Inf Dis 194: 276–285.
- 31. Mockenhaupt F, Reither K, Zanger P, Roepcke F, Danquah I, et al. (2007) Intermittent preventive treatment in infants as a means of malaria control: a randomized, double-blind, placebo-controlled trial in northern Ghana. Antimicrob Agents Chemother 51: 3273–3281.
- 32. Schellenberg D, Menendez C, Kahigwa E, Aponte J, Vidal J, et al. (2001) Intermittent treatment for malaria and anaemia control at time of routine vaccinations in Tanzanian infants: a randomised, placebo-controlled trial Lancet 357: 1471–1477.
- 33. Kobbe R, Kreuzberg C, Adjei S, Thompson B, Langefeld I, et al. (2007) A randomized controlled trial of extended intermittent preventive antimalarial treatment in infants Clin Inf Dis 45: 16–25.
- 34. Aponte J, Schellenberg D, Egan A, Breckenridge A, Carneiro I, et al. (2009) Efficacy and safety of intermittent preventive treatment with sulfadoxine-pyrimethamine for malaria in African infants: a pooled analysis of six randomised, placebo-controlled trials Lancet 374: 1533–1542.
- 35. Gosling R, Gesase S, Mosha J, Carneiro I, Hashim R, et al. (2009) Protective efficacy and safety of three antimalarial regimens for intermittent preventive treatment for malaria in infants: a randomised, placebo-controlled trial Lancet 374: 1521–1532.
- 36. Odhiambo F, Hamel M, Williamson J, Lindblade K, ter Kuile F, et al. (2010) Intermittent preventive treatment in infants for the prevention of malaria and anaemia in rural Western Kenya: a randomized, double-blind, placebo-controlled trial. PLoS ONE 5: e10016.
- 37. Sesay S, Milligan P, Touray E, Sowe M, Webb E, et al. (2011) A trial of intermittent preventive treatment and home-based management of malaria in a rural area of The Gambia. Malar J 10: 2.
- 38. Tagbor H, Cairns M, Nakwa E, Browne E, Sarkodie B, et al. (2011) The clinical impact of combining intermittent preventive treatment with home management of malaria in children aged below 5 years: cluster randomised trial. Trop Med Int Health (published online).
- 39. Wilson A on behalf of the IPTc Taskforce (2010) A systematic review and meta-analysis of the efficacy and safety of intermittent preventive treatment of malaria in children (IPTc) PLoS ONE 6: e16976.
- 40. Conteh L, Sicuri E, Manzi F, Hutton G, Obonyo B, et al. (2010) The cost-effectiveness of intemittent preventive treatment in infants in sub-Saharan Africa PLoS ONE 5: e10313.
- 41. Hutton G, Schellenberg D, Tediosi F, Macete E, Kahigwa E, et al. (2009) Cost-effectiveness of malaria intermittent preventive treatment in infants (IPTi) in Mozambique and the United Republic of Tanzania Bull WHO 87: 123–129.
- 42. Conteh L, Patouillard E, Kweku M, Legood R, Greenwood B, et al. (2010) The cost-effectiveness of intermittent preventive treatment in children (IPTc) using amodiaquine and artesunate versus sulphadoxine-pyrimethamine in Hohoe district, Ghana PLoS ONE 5: e12223.
- 43. McGready R (2009) Intermittent preventive treatment of malaria in infancy. Lancet 374: 1478–1480.
- 44. Buffet P, Briand V, Rénia L, Thellier M, Danis M, et al. (2008) Intermittent preventive antimalarial treatment to children (IPTc): firebreak or fire trap? Trends Parasitol 24: 482–485.
- 45. Chandramohan D, Webster J, Smith L, Awine T, Owusu-Agyei S, et al. (2007) Is the Expanded Programme on Immunisation the most appropriate delivery system for intermittent preventive treatment of malaria in West Africa? Trop Med Int Health 12: 1–8.
- 46. de Sousa A, Salama P, Chopra M (2010) Implementing intermittent preventive treatment in infants. Lancet 375: 121.
- 47. Beeson J, Rogerson S, Mueller I, Richards J, Fowkes F (2011) Intermittent preventive treatment to reduce the burden of malaria in children: new evidence on integration and delivery PLoS Med 8: e1000410.
- 48. Smith T, Killeen GF, Maire N, Ross A, Molineaux L, et al. (2006) Mathematical modeling of the impact of malaria vaccines on the clinical epidemiology and natural history of Plasmodium falciparum malaria: Overview. Am J Trop Med Hyg 75: Suppl 21–10.
- 49. Maire N, Smith T, Ross A, Owusu-Agyei S, Dietz K, et al. (2006) A model for natural immunity to asexual blood stages of Plasmodium falciparum malaria in endemic areas. Am J Trop Med Hyg 75: Suppl 219–31.
- 50. Smith T, Ross A, Maire N, Rogier C, Trape JF, et al. (2006) An epidemiologic model of the incidence of acute illness in Plasmodium falciparum malaria. Am J Trop Med Hyg 75: Suppl 256–62.
- 51. Ross A, Maire N, Molineaux L, Smith T (2006) An epidemiologic model of severe morbidity and mortality caused by Plasmodium falciparum. Am J Trop Med Hyg 75: Suppl 263–73.
- 52. Smith T, Maire N, Ross A, Penny M, Chitnis N, et al. (2008) Towards a comprehensive simulation model of malaria epidemiology and control Parasitol 135: 1507–1516.
- 53. Ross A, Penny M, Maire N, Studer A, Carneiro I, et al. (2008) Modelling the epidemiological impact of intermittent preventive treatment against malaria in infants PLoS ONE 3: e2661.
- 54. Hastings I, Watkins WM (2006) Tolerance is the key to understanding antimalarial drug resistance. Trends Parasitol 22: 71–77.
- 55. Orrell C, Little F, Smith P, Folb P, Taylor W, et al. (2008) Pharmacokinetics and tolerability of artesunate and amodiaquine alone and in combination in healthy volunteers Eur J Clin Pharmacol 64: 683–690.
- 56. Pussard E, Verdier F, Faurisson F, Schermann J, Le Bras J, et al. (1987) Disposition of monodesethylamodiaquine after a single oral dose of amodiaquine and three regimens for prophylaxis against Plasmodium falciparum malaria. Eur J Clin Phamacol 33: 409–414.
- 57. Winstanley P, Simooya O, Kofi-Ekue J, Walker O, Salako L, et al. (1990) The disposition of amodiaquine in Zambians and Nigerians with malaria. Br J Clin Pharmacol 29: 695–701.
- 58. Patouillard E, Conteh L, Webster J, Kweku M, Greenwood B, Chandramohan D (2011) Coverage and costs of two different systems for delivering intermittent preventive treatment of malaria to Ghaian children. In prep.
- 59. International drug price indicator guide (2007) 18: Available: http://erc.msh.org/dmpguide/Accessed 2011 Mar.
- 60. Tediosi F, Maire N, Penny M, Studer A, Smith T (2009) Simulation of the cost-effectiveness of malaria vaccines. Malar J 8: 127.
- 61. Bureau of Labor Statistics (2010) CPI Inflation calculator. 18: Available: http://www.bls.gov/data/inflation_calculator.htm Accessed 2011 Mar.
- 62. Penny M, Maire N, Studer A, Schapira A, Smith T (2008) What should vaccine developers ask? Simulation of the effectiveness of malaria vaccines. PLoS ONE 3: e3193.
- 63. Tediosi F, Hutton G, Maire N, Smith T, Ross A, et al. (2006) Predicting the cost-effectiveness of introducing a pre-erythrocytic malaria vaccine into the expanded program on immunization in Tanzania. Am J Trop Med Hyg 75: 2 Suppl131–143.
Gold M, Gold S, Weinstein M (1996) Cost-effectiveness in health and medicine. New York: Oxford University Press.
- 65. Weinstein M, Siegel J, Gold M, Kamlet M, Russell L (1996) Recommendations of the panel of cost-effectiveness in medicine. JAMA 276: 1253–1341.
Murray C, Lopez A (1996) The global burden of disease: a comprehensive assessment of
mortality and disability from diseases, injuries, and risk factors in 1990
and projected to 2020. Harvard: Harvard University Press.
- 67. Fox-Rushby J, Hanson K (2001) Calculating and presenting disability-adjusted life years (DALYs) in cost-effectiveness analysis. Health Policy Plan 16: 326–331.
- 68. Shillcutt S, Walker D, Goodman C, Mills A (2009) Cost-effectiveness in low- and middle- income countries: a review of the debates surrounding the decision rules. Phamacoecon 27: 903–917.
World Bank (1993) World development report. Washington, DC 1993.
- 70. Carneiro I, Roca-Feltrer A, Griffin J, Smith L, Tanner M, et al. (2010) Age-patterns of malaria vary with severity, transmission intensity and seasonality in sub-Saharan Africa: a systematic review and pooled analysis. PLoS ONE 5: e8988.
- 71. Vinetz J (2010) Intermittent preventive treatment for malaria in sub-Saharan Africa: a halfway technology or a critical intervention? Am J Trop Med Hyg 82: 755–756.
- 72. Trape J, Rogier C (1996) Combating malaria morbidity and mortality by reducing transmission. Parasitol Today 12: 236–240.
- 73. Yukich J, Lengeler C, Tediosi F, Brown N, Mulligan J, et al. (2008) Costs and consequences of large-scale vector control for malaria. Malar J 7: 258.
- 74. Morel C, Lauer J, Evans D (2005) Achieving millenium development goals for health: cost-effectiveness analysis of strategies to combat in developing countries. BMJ 331: 1299.
Goodman C, Coleman P, Mills A (2000) Economic analysis of malaria control in sub-Saharan
Africa. Geneva, Global Forum for Health Research.
- 76. Gosling R, Ghani A, Deen J, von Seidlein L, Greenwood B, et al. (2008) Can changes in malaria transmission intensity explain prolonged protection and contribute to high protective efficacy of intermittent preventive treatment for malaria in infants? Malar J 7: 54.
- 77. Aguas R, Lourenço J, Gomes M, White L (2009) The impact of IPTi and IPTc interventions on malaria clinical burden - in silico perspectives. PLoS ONE 4: e6627.
- 78. Aponte J, Menendez C, Schellenberg D, Kahigwa E, Mshinda H, et al. (2007) Age interactions in the development of naturally acquired immunity to Plasmodium falciparum and its clinical presentation. PLoS Med 4: e359.
- 79. Meremikwu M, Donegan S, Esu E (2008) Chemoprophylaxis and intermittent treatment for preventing malaria in children (review). Cochrane Database Syst Rev 2008 Apr(16): CD003756.
- 80. Smith T, Maire N, Dietz K, Killeen G, Vounatsou P, et al. (2006) Relationship between the entomologic inoculation rate and the force of infection for Plasmodium falciparum malaria. Am J Trop Med Hyg 75: Suppl 211–18.
- 81. Ross A, Smith T (2006) The effect of malaria transmission intensity on neonatal mortality in endemic areas. Am J Trop Med Hyg. 75: Suppl 274–81.
- 82. Ross A, Killeen G, Smith T (2006) Relationships between host infectivity to mosquitoes and asexual parasite density in Plasmodium falciparum. Am J Trop Med Hyg 75: Suppl 232–37.
- 83. Killeen G, Ross A, Smith T (2006) Infectiousness of malaria-endemic human populations to vectors. Am J Trop Med Hyg 75: 2 Suppl38–45.
- 84. Tediosi F, Maire N, Smith T, Hutton G, Utzinger J, et al. (2006) An approach to model the costs and effects of case management of Plasmodium falciparum malaria in sub-Saharan Africa. Am J Trop Med Hyg 75: Suppl 290–103.
- 85. Arnesen T, Nord E (1999) The value of DALY life: problems with ethics and validity of disability-adjusted life years. BMJ 319: 1423–1425.
- 86. Anand S, Hanson K (1997) Disability-adjusted life years: a critical review. J Health Econ 16: 685–702.
- 87. Arnesen T, Kapiriri L (2004) Can the value choices in DALYs influence global health priorities? Health Policy 70: 137–149.
Mathers C, Salomon J, Ezzati M, Begg S, vander Hoorn S, et al. (2006) Sensitivity and uncertainty analyses for burden of disease and
risk factor estimates. Global burden of disease and risk
factors. New York: Oxford University Press. pp. 399–426.
- 89. Robert V, Dieng H, Lochouarn L, Traoré S, Simondon F, et al. (1998) La transmission du paludisme dans la zone de Niakhar, Sénégal. Trop Med Int Health.3: 667–677.