Seasonal influenza is a major cause of mortality worldwide. Routine immunization of children has the potential to reduce this mortality through both direct and indirect protection, but has not been adopted by any low- or middle-income countries. We developed a framework to evaluate the cost-effectiveness of influenza vaccination policies in developing countries and used it to consider annual vaccination of school- and preschool-aged children with either trivalent inactivated influenza vaccine (TIV) or trivalent live-attenuated influenza vaccine (LAIV) in Thailand. We also compared these approaches with a policy of expanding TIV coverage in the elderly.
Methods and Findings
We developed an age-structured model to evaluate the cost-effectiveness of eight vaccination policies parameterized using country-level data from Thailand. For policies using LAIV, we considered five different age groups of children to vaccinate. We adopted a Bayesian evidence-synthesis framework, expressing uncertainty in parameters through probability distributions derived by fitting the model to prospectively collected laboratory-confirmed influenza data from 2005-2009, by meta-analysis of clinical trial data, and by using prior probability distributions derived from literature review and elicitation of expert opinion. We performed sensitivity analyses using alternative assumptions about prior immunity, contact patterns between age groups, the proportion of infections that are symptomatic, cost per unit vaccine, and vaccine effectiveness. Vaccination of children with LAIV was found to be highly cost-effective, with incremental cost-effectiveness ratios between about 2,000 and 5,000 international dollars per disability-adjusted life year averted, and was consistently preferred to TIV-based policies. These findings were robust to extensive sensitivity analyses. The optimal age group to vaccinate with LAIV, however, was sensitive both to the willingness to pay for health benefits and to assumptions about contact patterns between age groups.
Vaccinating school-aged children with LAIV is likely to be cost-effective in Thailand in the short term, though the long-term consequences of such a policy cannot be reliably predicted given current knowledge of influenza epidemiology and immunology. Our work provides a coherent framework that can be used for similar analyses in other low- and middle-income countries.
Every year, millions of people catch influenza, a viral disease of the airways. Most infected individuals recover quickly, but elderly people, the very young, and chronically ill individuals are at high risk of developing serious complications such as pneumonia; seasonal influenza kills about half a million people annually. Small but frequent changes in the influenza virus mean that an immune response produced one year by exposure to the virus provides only partial protection against influenza the next year. Annual immunization with a vaccine that contains killed or live-attenuated (weakened) influenza viruses of the major circulating strains can reduce a person’s chance of catching influenza. Consequently, many countries run seasonal influenza vaccination programs that target elderly people and other people at high risk of influenza complications, and people who care for these individuals.
Why Was This Study Done?
As well as reducing the vaccinated person’s risk of infection, influenza vaccination protects unvaccinated members of the population by reducing the chances of influenza spreading. Because children make a disproportionately large contribution to the transmission of influenza, vaccination of children might therefore provide greater benefits to the whole population than vaccination of elderly people, particularly when vaccination uptake among the elderly is low. Thus, many high-income countries now recommend annual influenza vaccination of children with a trivalent live-attenuated influenza vaccine (LAIV; a trivalent vaccine contains three viruses), which is sprayed into the nose. However, to date no low- or middle-income countries have evaluated this policy. Here, the researchers develop a mathematical model (framework) to evaluate the cost-effectiveness of annual vaccination of children with LAIV or trivalent inactivated influenza vaccine (TIV) in Thailand. A cost-effectiveness analysis evaluates whether a medical intervention is good value for money by comparing the health outcomes and costs associated with the introduction of the intervention with the health outcomes and costs of the existing standard of care. Thailand, a middle-income country, offers everyone over 65 years old free seasonal influenza vaccination with TIV, but vaccine coverage in this age group is low (10%).
What Did the Researchers Do and Find?
The researchers developed a modeling framework that contained six connected components including a transmission model that incorporated infectious contacts within and between different age groups, a health outcome model that calculated the disability-adjusted life years (DALYs, a measure of the overall disease burden) averted by specific vaccination policies, and a cost model that calculated the costs to the population of each policy. They used this framework and data from Thailand to calculate the cost-effectiveness of six childhood vaccination policies in Thailand (one with TIV and five with LAIV that targeted children of different ages) against a baseline policy of 10% TIV coverage in the elderly; they also investigated the cost-effectiveness of increasing vaccination in the elderly to 66%. All seven vaccination policies tested reduced influenza cases and deaths compared to the baseline policy, but the LAIV-based polices were consistently better than the TIV-based policies; the smallest reductions were seen when TIV coverage in elderly people was increased to 66%. All seven policies were highly cost-effective according to the World Health Organization’s threshold for cost-effectiveness. That is, the cost per DALY averted by each policy compared to the baseline policy (the incremental cost-effectiveness ratio) was less than Thailand’s gross domestic product per capita (the total economic output of a country divided by the number of people in the country).
What Do These Findings Mean?
These findings suggest that seasonal influenza vaccination of children with LAIV is likely to represent good value for money in Thailand and, potentially, in other middle- and low-income countries in the short term. The long-term consequences of annual influenza vaccination of children in Thailand cannot be reliably predicted, however, because of limitations in our current understanding of influenza immunity in populations. Moreover, the accuracy of these findings is limited by the assumptions built into the modeling framework, including the vaccine costs and efficacy that were used to run the model, which were estimated from limited data. Importantly, however, these findings support proposals for large-scale community-based controlled trials of policies to vaccinate children against influenza in low- and middle-income countries. Indeed, based on these findings, Thailand is planning to evaluate school-based seasonal influenza vaccination in a few provinces in 2016 before considering a nationwide program of seasonal influenza vaccination of children.
This list of resources contains links that can be accessed when viewing the PDF on a device or via the online version of the article at http://dx.doi.org/10.1371/journal.pmed.1001829.
- The UK National Health Service Choices website provides information for patients about seasonal influenza, about influenza vaccination, and about influenza vaccination in children
- The World Health Organization provides information on seasonal influenza (in several languages) and on influenza vaccines
- The US Centers for Disease Control and Prevention also provides information for patients and health professionals on all aspects of seasonal influenza, including information about vaccination, about children, influenza, and vaccination, and about herd immunity; its website contains a short video about personal experiences of influenza
- Flu.gov, a US government website, provides access to information on seasonal influenza and vaccination
- MedlinePlus has links to further information about influenza and about vaccination (in English and Spanish)
- The Thai National Influenza Center monitors influenza activity throughout Thailand
Citation: Meeyai A, Praditsitthikorn N, Kotirum S, Kulpeng W, Putthasri W, Cooper BS, et al. (2015) Seasonal Influenza Vaccination for Children in Thailand: A Cost-Effectiveness Analysis. PLoS Med 12(5): e1001829. https://doi.org/10.1371/journal.pmed.1001829
Academic Editor: Lone Simonsen, George Washington University, UNITED STATES
Received: June 26, 2014; Accepted: April 13, 2015; Published: May 26, 2015
Copyright: © 2015 Meeyai et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Funding: This work was supported by the World Health Organization headquarters in Geneva, Switzerland (grant details: WHO Reference: 2012/259630-0, Reg. File: V21-TSA-011). BSC was also supported by The Medical Research Council and Department for International Development (grant number MR/K006924/1) and works within the Wellcome Trust-Mahidol University-Oxford Tropical Medicine Research Programme supported by the Wellcome Trust (089275/Z/09/Z). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: CEAC, cost-effectiveness acceptability curve; CEAF, cost-effectiveness acceptability frontier; CrI, credible interval; DALY, disability-adjusted life year; EVPI, expected value of perfect information; EVPPI, expected value of partial perfect information; ILI, influenza-like illness; INB, incremental net benefit; I$, international dollars; IP, influenza pneumonia; LAIV, trivalent live-attenuated influenza vaccine; TIV, trivalent inactivated influenza vaccine; VE, vaccine efficacy
Vaccination against influenza has the potential to substantially reduce mortality and morbidity both through direct protection (reduced risk of infection in those receiving the vaccine) and through indirect protection (reduced risk of infection in those not receiving the vaccine) [1,2]. Because children have a high burden of influenza-related illness and make a large contribution to influenza transmission in the wider community, it has been proposed that preferentially vaccinating this age group would represent efficient use of vaccine in high-income countries in the temperate climate zone [3–7]. The experience in Japan, where children were routinely immunized against influenza between 1962 and 1987, suggests that indirect benefits could be large . Moreover, in settings where access to health care is limited, or where voluntary uptake of influenza vaccination in high-risk populations has been low, vaccinating school-aged children could represent a pragmatic and effective intervention to reduce influenza morbidity and mortality in the whole community. A further advantage of targeting this age group is that vaccine effectiveness may be greater in children than in elderly high-risk age groups . Such a policy may be particularly relevant for Thailand, where despite free provision of seasonal influenza vaccine to all Thai nationals aged 65 y and above since 2008, annual vaccine coverage in this age group has remained in the region of 10% .
Two types of influenza vaccine are licensed for use in children: trivalent inactivated influenza vaccine (TIV) and trivalent live-attenuated influenza vaccine (LAIV). We consider both in our analysis, though the primary focus is on LAIV, which has been found to be more effective in children . TIV is administered intramuscularly and is recommended for those aged at least 6 mo. LAIV is administered intranasally and is recommended only for those between the ages of 2 and 49 y. In both cases, one dose each year is recommended, except for children under 9 y who were not vaccinated the previous influenza season, for whom two doses at least 4 wk apart are recommended . Antibodies indicating influenza protection emerge about 2 wk after vaccination.
Currently, however, no low- or middle-income country has adopted or, to our knowledge, formally evaluated a childhood influenza vaccination policy. We aimed to evaluate whether such a policy could be cost-effective in a tropical middle-income country, using detailed epidemiological and cost data from Thailand to inform our analysis. Our work also provides a coherent framework (and computer code) that can be used to allow the analysis to be repeated in other low- and middle-income countries.
When evaluating costs and health outcomes associated with vaccination, both direct and indirect effects should be accounted for . Our approach does this using an age-structured dynamic transmission model. We employ a Bayesian approach, representing uncertainty in model parameters through probability distributions chosen to represent current knowledge and beliefs . This allows us to combine information from multiple sources within a unified framework, while ensuring appropriate propagation of uncertainty through the model and accounting for correlations between parameter values . The model thus combines analysis of prospective epidemiological data, meta-analysis of clinical trial data, estimates of life years lost due to influenza infections, and prior probability distributions derived from literature review and formal elicitation of expert opinion. We report both the epidemiological and the economic outcomes of the model.
We compared seven vaccination policies against a baseline policy (policy 0) of no additional vaccination (Table 1). Policies 1–6 involved annual vaccination of children in specified age ranges: 2–11 y for policies 1 and 2, and 2–17 y, 2–5 y, 6–11 y, and 12–17 y, respectively, for polices 3–6. In policies 2–6, children were vaccinated with LAIV. Policy 1 differed from policy 2 only in the use of TIV instead of LAIV. Age groups were chosen to reflect the three stages in the Thai education system (3–5 y, kindergarten; 6–11 y, elementary school; 12–17 y, secondary school). For the youngest age group we extended the age range to 2 y, the minimum age at which LAIV can be used. For comparison we also considered a policy of expanding annual coverage levels with TIV to 66% in those aged at least 60 y (policy 7). In all other scenarios (including policy 0), 10% of those aged 60 y and over were assumed to receive TIV annually. For a given value of willingness to pay per disability-adjusted life year (DALY) averted (the cost-effectiveness threshold), we consider the optimal policy to be the one with the highest expected incremental net benefit (INB). The INB is the difference between the monetary value of health gains (the product of the number of DALYs averted by the policy and the cost-effectiveness threshold) and the costs of these health gains.
We evaluated the sensitivity of our results to alternative assumptions about (i) mixing patterns between age groups, (ii) vaccine effectiveness, (iii) baseline immunity (prior to vaccination), (iv) vaccine coverage, (v) influenza transmissibility in Thailand, (vi) vaccine costs, and (vii) the probability that an influenza infection is symptomatic (Table 2).
The cost-effectiveness analysis combined six connected components (Fig 1): a dynamic transmission model, which defined infectious contacts within and between different age groups; an epidemiological model, which used the transmission model to specify the number infected in each age group at each time point; an observation model, which related the output of the epidemiological model to influenza surveillance data; a vaccination model, which combined meta-analysis of vaccine trial data with the transmission model and vaccination scenarios; a health outcome model, which calculated the number of DALYs averted by each vaccination policy; and a cost model, which calculated costs from a societal perspective associated with the different policies.
The directed acyclic graph illustrates the dependencies between model components. Squares represent data sources, and circles represent quantities about which we are uncertain (double circles indicate quantities for which we have external information about their values, which is represented by informative prior distributions). Single and double arrows indicate stochastic and deterministic relationships, respectively, and arrows point towards the dependent variable. ILI, influenza-like illness.
Using this framework we calculated the following: (i) the probability distributions of the number of infections, DALYs averted, and deaths averted by each policy; (ii) the probability that each policy had the highest INB as a function of the cost-effectiveness threshold—this is shown by the cost-effectiveness acceptability curves (CEACs) ; (iii) the policy with the highest expected INB as a function of the cost-effectiveness threshold—the probability that a policy has the highest INB for a given threshold is shown on the cost-effectiveness acceptability frontier (CEAF) ; (iv) the expected value of perfect information (EVPI), which measures the expected monetary value of improved decision-making that would result from perfect information about model parameters ; (v) the expected value of partial perfect information (EVPPI), which is similar to EVPI but assumes perfect information about only one parameter at a time ; and (vi) the optimal policy as a function of vaccine effectiveness, vaccine cost, and the cost-effectiveness threshold (a threshold analysis).
Probability distributions for model parameters were obtained by combining prior distributions (derived from previous research and formal elicitation of expert opinion) with the likelihood of the observed data to obtain posterior distributions. All outcomes of interest can be expressed as summaries of functions of these posterior distributions. We also performed eight sensitivity analyses where we used alternative prior distributions or varied other modeling assumptions (Table 2).
Details of Model Components
The transmission model was implemented as a system of coupled ordinary differential equations. For each of the three influenza subtypes (influenza A/H1N1, A/H3N2, and B), individuals within each of six age groups (<2 y, 2–5 y, 6–11 y, 12–17 y, 18–59 y, and ≥60 y) were partitioned into four compartments: susceptible and able to be infected with a circulating influenza subtypes; latently infected, but not yet infectious; currently infectious; and immune (not able to be infected with the same influenza subtype). Immunity may arise either through natural infection or effective vaccination. Potentially infectious contacts between age groups are accounted for using a matrix of contact patterns (the “mixing matrix”) empirically derived from a diary-based survey. In the base case analysis, we derived this matrix using all contacts (physical skin-to-skin contacts and nonphysical two-way spoken exchanges between people at the same location). In sensitivity analysis 1, we used only physical contacts.
We defined each influenza season to run from April 1 of a given year to March 31 of the following year. We assumed that at the start of each influenza season a proportion of people in each age group were immune to circulating influenza subtypes, and that a small proportion were already infected. Both proportions were age-dependent and influenza-subtype-specific, and uncertainty in their values was expressed in informative prior distributions, derived from an elicitation exercise (see below). Sensitivity analyses 2 and 6 made alternative immunity assumptions. Within each influenza season, we assumed that once individuals were infected with one influenza subtype, they remained immune to that subtype (i.e., were not able to be reinfected) but that immunity to other subtypes was not affected. Prior distribution assumptions for model parameters are given in Table 3.
Model fitting was based on 4 y of data (April 2005–March 2009) derived from the national influenza surveillance network in Thailand. These data combine laboratory-confirmed cases of infection with influenza A/H1N1, A/H3N2, and B collected prospectively from sentinel sites throughout Thailand with national data on outpatients presenting with influenza-like illness (ILI) and inpatients with influenza pneumonia (IP) symptoms .
The laboratory-confirmed cases each month were assumed to follow a multinomial distribution, where the probability of a test yielding a positive result for each influenza subtype depended on the predicted number of infections with each influenza sybtype, the probability that an influenza infection in a given age group was reported as an ILI case, the test sensitivity, and the proportion of ILI cases caused by the given influenza subtype.
It was assumed that some age-specific proportion of people with influenza infections seek medical attention and are recorded as cases of ILI. We also assumed that the number of ILI and IP cases not due to influenza varies with season and age group. We took the minimum monthly number of ILI and IP cases for the given season and age group as an estimate of this quantity. A small (and known) number of people presenting with ILI are tested for virus positivity and classified either as infected with influenza A/H1N1, influenza A/H3N2, or influenza B, or as having no detectable influenza infection . We assumed imperfect sensitivity for these tests, but perfect specificity.
The vaccination model included a meta-analysis to determine vaccine efficacy (VE) in children and to derive a predictive distribution of vaccine effectiveness. In our base case analysis, we used data from randomized controlled trials of TIV and LAIV satisfying previously specified inclusion criteria , with the additional requirement that the median age of participants was between 2 and 15 y. These criteria required laboratory-confirmed influenza infection to be the primary end point, vaccine administration to be in accordance with recommendations, and the control group to receive a placebo or a vaccine other than influenza . Trials meeting these criteria were sought in recent systematic reviews and through PubMed searches [10,17,18].
We defined VE as one minus the ratio of the probability of influenza infection if vaccinated to the probability of influenza infection if not vaccinated. For cluster-randomized trials we accounted for clustering effects by adjusting the effective sample size . We considered outcomes only in those who received the intervention or control vaccine. This is more relevant than the intention to treat population, as the model requires an estimate of vaccine effectiveness in those who actually receive the vaccine and separately accounts for incomplete coverage. In sensitivity analysis 3, the VE for LAIV was estimated using only studies predominantly conducted in Asia without imposing any age restrictions.
When modeling vaccination policies it was assumed that in all cases vaccination started on May 1st and continued for 90 d. This date was chosen to coincide with the start of the new school year in Thailand and because it is shortly after the southern hemisphere influenza vaccine, which is recommended in Thailand, becomes available. April–June is also considered the optimal time for influenza vaccination in most southern and southeastern Asian countries lying north of the equator . The number of children vaccinated per day was assumed to be constant within each age group and was chosen to ensure that target vaccine coverage was reached at 90 d after vaccination started. Amongst children initially susceptible when vaccinated, it was assumed that a proportion given by the vaccine effectiveness was successfully immunized and that vaccine effectiveness remained constant over a 12-mo period. Once vaccinated (with one or two doses depending on age group), children were not vaccinated again in the same year. In the base case analysis, vaccine coverage was 66% in target age groups. Sensitivity analysis 4 assumed 50% coverage.
Health outcome model.
We estimated DALYs averted by vaccination policies 1 to 7 compared with policy 0. This analysis accounted for life years lost due to deaths resulting from influenza infection, DALYs lost due to nonfatal influenza infection (accounting both for hospitalized pneumonia and influenza cases and for nonhospitalized cases), and adverse events resulting from vaccination.
Estimates of age-specific mortality attributed to each influenza subtype in each of the 4 y were obtained from a separate Bayesian analysis (S4 Table within S1 Text) . Many of those dying from influenza are likely to have co-morbidities that are associated with reduced life expectancy for reasons unrelated to influenza. The health outcome model accounted for this by using priors derived from previous estimates of life years lost as a result of influenza infections in Hong Kong accounting for underlying illness, adjusting for the shorter life expectancy in Thailand .
Estimates of DALYs lost due to hospitalized pneumonia and influenza cases were derived from Lugner et al. . Estimates of DALYs lost due to nonhospitalized pneumonia cases and vaccine adverse events were obtained from Prosser et al. . Further details are given in Table 4 and S5 Table within S1 Text.
We adopted the societal viewpoint, taking into consideration direct medical, direct non-medical, and indirect costs incurred from each policy option. The unit cost of outpatient care for influenza illness was derived from a cross-sectional study conducted in Thailand . Unit costs of hospitalization and vaccine-related adverse events were derived from the National Hospital Database, containing information on inpatient care from all public and private hospitals throughout the country. The cost of medically attended Guillain-Barré syndrome was considered both in influenza infection and vaccination groups . We assumed that individuals with symptomatic influenza who do not seek medical attention require only over-the-counter medication and do not need to absent themselves from school or the workplace (as employers and schools in Thailand typically require a medical certificate in the case of absence from work or school). Direct medical costs of vaccination were the summation of vaccine acquisition cost, supply chain and logistic costs, administration costs, and vaccine-related adverse event costs. The TIV acquisition cost of 201 baht (11.3 international dollars [I$]) per dose was derived from the Thai Government Pharmaceutical Organization’s average purchasing price between 2009 to 2012 (personal communication from Dr. Sit Thirapakpoomanunt, Government Pharmaceutical Organization, Thailand). Because LAIV is not currently available in Thailand, in the base case analysis we assumed the same LAIV/TIV price ratio as reported in the US Centers for Disease Control and Prevention’s vaccine price list . This corresponded to an assumption that LAIV is 1.6 times more expensive than TIV, at 322 baht (I$18.1) per dose, and is broadly in agreement with studies in the US, Canada, and Germany [30–32].
Children aged 6–17 y were assumed to incur an additional administration cost for the school-based vaccination program. Only preschool children aged 2–5 y incurred the direct non-medical cost due to receiving the vaccine at a hospital or health service center, which includes expenses for food and transportation. All costs were adjusted to 2012 Thai baht using the Consumer Price Index . For intercountry comparisons, costs were converted into international dollars using the purchasing power parity exchange rate of I$1 = 17.76 baht (year 2012 values) . Prior distributions for cost parameters are summarized in Table 4. Full cost vectors used in the analysis are given in S6 Table within S1 Text.
Derivation of model priors.
Informative prior distributions were obtained from published literature and formal expert opinion elicitations (Tables 3 and 4). Elicited priors were used for parameters that either had not been reliably estimated or had been estimated only in locations where their values were thought likely to differ substantially from those in Thailand. The elicitation procedure followed the Sheffield Elicitation Framework (SHELF, version 2.0) . For our base case assumption for the proportion of influenza infections that are symptomatic, we based our prior on a review of human volunteer challenge studies that suggested that about two-thirds of infections are symptomatic . In sensitivity analysis 8, we used a distribution that supported much lower values (between about 14% and 19%) chosen to be consistent with a cohort study in Viet Nam .
We estimated model parameters for influenza A/H1N1, A/H3N2, and B, obtaining independent estimates for each of the four seasons, assuming that infection with one virus subtype did not alter the risk of infection with another. Sampled outcomes from the four 1-y runs were combined to obtain final estimates of health benefits and costs associated with the vaccination policies.
Bayesian inference was performed using a Markov chain Monte Carlo approach using WinBUGS version 1.4, which was also used to calculate outcome measures of interest, accounting for parameter uncertainty . The dynamic transmission model was implemented in Component Pascal as a hard-wired plug-in to WinBUGS using the BlackBox Component Builder (Oberon Microsystems). Full implementation details are presented in S1 Text, and model code is available at http://goo.gl/htrvrk.
Vaccine Efficacy in School-Aged Children
For both TIV and LAIV, there were two trials evaluating VE in children within the target age range [38–41]. Meta-analysis gave VE estimates for TIV and LAIV of 48.5% (95% credible interval [CrI] 0.7%, 68.9%) and 90.0% (95% CrI 84.9%, 94.2%). When we considered only trials predominantly conducted in Asia, the estimated LAIV VE was 67.1% (95% CrI 59.2%, 73.7%) (S2 and S3 Tables within S1 Text) [42,43].
Transmission and Epidemiological Models
The transmission model gave good fits to observed influenza surveillance data for most years and subtypes, and under base case assumptions was consistent with subtype-specific pre-epidemic reproduction numbers between 1.1 and 1.3 (Fig 2). Note that temporal variation in the number of laboratory-confirmed influenza cases reflects both changes in positivity rates and changes in the number of isolates tested. For other epidemiological parameters, including immunity at the start of the influenza season, posterior distributions were similar to the priors (S7 Table within S1 Text). The predicted mean serological attack rate (95% CrI) with any of the three influenza subtypes in each of the four modeled years (April 2005–March 2009) was 17% (11%, 22%), 26% (22%, 31%), 19% (16%, 23%), and 13% (9%, 16%), respectively.
Monthly numbers of laboratory-confirmed influenza cases (circles) and model predictions: median (broken line) and 95%, 90%, and 80% (gray shading) prediction intervals for the expected number of cases. Also shown is the estimated value of R0 and associated 95% CrI.
Health Outcome and Cost Models
All vaccination policies considered led to reductions in influenza cases and mortality compared to policy 0 (no childhood vaccination) (Table 5). The largest reductions were seen with policy 3 (vaccinating children aged 2–17 y with LAIV), and the smallest with policy 7 (increasing TIV coverage in those aged ≥60 y to 66%). None of the policies were cost-saving. The largest incremental costs were seen with policy 3, and the lowest with policy 7. Summarizing these results on the cost-effectiveness plane shows that all seven policies have a very high probability of being highly cost-effective at the WHO-recommended threshold (cost per DALY averted less than gross domestic product per capita ) compared with policy 0 (Fig 3A). There was, however, large uncertainty in the health benefits of vaccination. In part, this was explained by large annual variation in influenza dynamics.
(A) Cost-effectiveness plane showing samples from the posterior distributions of DALYs averted and incremental costs for the seven vaccination policies compared with no vaccination under base case assumptions. Points to the right of the solid red line (which corresponds to a threshold of I$10,000 per DALY averted) would be considered highly cost-effective compared with no vaccination in Thailand according to the WHO threshold . (B) CEACs under base case assumptions. (C–K) CEAFs under base case assumptions and for eight sensitivity analyses.
Under base case assumptions, policies using LAIV are likely to have the highest INB provided willingness to pay to avert one DALY is not very low. The specific LAIV policy giving the greatest net benefit, however, depends on the precise cost-effectiveness threshold (Fig 3B). Increasing the cost-effectiveness threshold leads to increasing chances that progressively more costly LAIV policies have the highest INB. These more costly policies are those that include coverage in children 5 y and under, with costs increasing in line with added coverage for children in older age groups. Under base case assumptions, policy 6 (vaccinating those aged 12–17 y with LAIV, the least costly LAIV policy) was the most likely to have the highest INB for cost-effectiveness thresholds between about I$3,000 and I$15,000 per DALY averted, while policy 4 (LAIV for those aged 2–5 y) and policy 3 (LAIV for those aged 2–17 y) were the most likely to have the highest INB at higher thresholds. The CEAF shows that policy 3 becomes optimal only at a threshold above I$25,000 per DALY averted (Fig 3C). Under the base case assumptions, any of policies 1–7 is always preferred to policy 0 if the threshold is above I$2,000 per DALY averted.
Sensitivity analyses show that the finding that LAIV policies are cost-effective is robust to changes in assumptions about contact patterns (Fig 3D), assumptions about immunity (Fig 3E, 3I and 3J), studies used to estimate VE (Fig 3F), vaccine coverage in target age groups (Fig 3G), prior assumptions about reproduction numbers (Fig 3H), and the proportion of infections that are symptomatic (Fig 3K). In all of these sensitivity analyses, all increased vaccination policies were found to be likely to be cost-effective compared to no increased vaccination at a threshold value of I$10,000 per DALY averted, and LAIV policies were preferred to the TIV policy. The optimal age groups to vaccinate for a given threshold ceiling, however, were sensitive to the assumptions modified in the sensitivity analyses. Alternative assumptions also led to different estimates of epidemiological parameters. When baseline immunity was assumed to be considerably higher than that derived from the expert elicitation exercise (sensitivity analyses 2, 6, and 7), estimated reproduction numbers substantially increased, with estimates ranging from 1.3 to 2.2 for influenza A (except for A/H1N1 in 2005–2006), and from 1.3 to 1.6 for influenza B (S11, S17 and S19 Tables within S1 Text).
Effectiveness of LAIV with large-scale deployment may differ substantially from efficacy estimates from trials . There is also large uncertainty concerning likely LAIV costs in Thailand. For these reasons we performed a threshold analysis to determine the optimal policy over a grid of values for LAIV effectiveness, LAIV unit cost, and cost-effectiveness threshold values (Fig 4). This analysis shows that for a threshold of I$1,000 per DALY averted, vaccination is cost-effective only if the unit cost of LAIV is below about I$10. In this case, under base case assumptions, vaccination of those aged 12–17 y (policy 6, the least costly LAIV policy) would be preferred to no vaccination if LAIV effectiveness is sufficiently high. If the threshold is I$5,000 or more, increased vaccination with TIV (policies 1 and 7) can become optimal if LAIV effectiveness is sufficiently low. For higher LAIV effectiveness values, policies 2, 3, 4, and 6 can all be optimal depending on vaccine effectiveness and cost values. Generally, the range of values for LAIV cost and effectiveness at which high-cost (and high-coverage) LAIV policies are optimal increases in line with the cost-effectiveness threshold. Interestingly, however, for threshold values of I$10,000 or more, at a given LAIV unit cost, as LAIV effectiveness increases, less costly LAIV vaccination policies are sometimes optimal. Sensitivity analysis using an alternative contact matrix (derived from only physical contacts) gives the same general picture, and LAIV and TIV policies are optimal over a similar range of parameter values, though in many cases the optimal age groups to vaccinate with LAIV differ (Fig 4B).
Figure shows how the optimal policy (defined as the policy that maximizes the INB) changes with LAIV effectiveness, unit cost of LAIV, and willingness to pay (WTP) per DALY averted (cost-effectiveness threshold). (A) Base case mixing matrix. (B) Contact matrix based on physical contacts only.
In the base case analysis, the EVPI reaches a maximum of about I$60 million at a cost-effectiveness threshold value of about I$25,000 per DALY averted (S7 Fig within S1 Text). This finding reflects the large uncertainty as to whether policy 2, 3, or 4 is optimal at this threshold value. At higher threshold values the EVPI declines, reflecting increased certainty that policy 3 is optimal. The EVPPI analysis shows that under base case assumptions and with a cost-effectiveness threshold value of about I$10,000 per DALY averted, perfect information about most parameters would not lead to improved decisions (S8 Table within S1 Text).
Direct benefits from vaccination represent only a small proportion of the total health benefits of vaccination, even when coverage extends to all children aged 2–17 y (Fig 5). Most of the health benefit comes from DALYs averted in older age groups. To gain further insight into these indirect effects, we consider how the effective reproduction number, R (the expected number of secondary infections caused by a typical infective individual), changes with different vaccination scenarios and model assumptions (Fig 6). This analysis shows that under base case mixing assumptions (Fig 6, columns A–C), vaccination alone is unlikely to reduce R to below one (achieving herd immunity) unless transmissibility is particularly low and both coverage and vaccine effectiveness are high. At intermediate levels of transmissibility (R = 1.3) under policy 3, vaccination can come close to reducing R to below one (the herd-immunity threshold below which major epidemics will not occur). While this would not prevent influenza epidemics, it would greatly curtail them, giving large indirect benefits. In contrast, if contact patterns between age groups are derived from physical contacts (Fig 6, columns D–F), we estimate much larger effects of vaccinating children and a much higher chance of achieving herd immunity. Under both mixing assumptions, vaccinating only those aged 2–5 y (policy 4) or only the elderly (policy 7) does not appreciably change R.
The width of bars corresponds to the probability density, the central black line within each bar represents the interquartile range of the DALYs averted, and the white circle represents the median value. Note that all DALYs averted in those 18 y and over or under 2 y are by definition indirect in policies 1–6.
Color indicates effective reproduction number after vaccination. Columns A, B, and C use a contact matrix derived from all contacts recorded. Columns D, E, and F use a contact matrix derived from physical contacts only. In both cases, baseline immunity assumptions at the start of each influenza season are taken as the mean estimated for each of the six age groups when fitting to data under base case assumptions (21%, 25%, 33%, 33%, 38%, and 37%). R values in column headings indicate the assumed effective reproduction number prior to vaccination.
We found that, under plausible assumptions, an influenza vaccination program for children can represent good value for money in Thailand. All childhood vaccination policies considered would meet WHO criteria for being classed as highly cost-effective compared to no vaccination, and the LAIV was consistently preferred. This conclusion held even if LAIV effectiveness was assumed to be much lower than estimated from clinical trials. Most of the health benefits resulted from reduced mortality in older age groups, a finding in accordance with a previous evaluation of the impact of childhood influenza vaccination in England and Wales . This finding contrasts with recent economic evaluations of other possible large-scale pediatric vaccination efforts, which found that neither pneumococcal conjugate vaccine nor rotavirus vaccine are likely to be cost-effective in Thailand [46,47].
The optimal age range of children to vaccinate was, however, sensitive both to assumptions about which there is considerable uncertainty and to the cost-effectiveness threshold. Under our base case assumptions, the policy of immunizing those aged 2–17 y with LAIV became cost-effective at a threshold value of approximately I$26,000 per DALY averted. This was also the only policy able to consistently attain herd immunity at levels of vaccine effectiveness estimated from clinical trials. The optimal LAIV policy was particularly sensitive to the data used to derive contact matrices describing interactions between age groups. In humid countries, such as Thailand, there are some reasons for thinking that droplet and contact transmission of influenza may be more important than aerosol transmission , suggesting that physical contacts (as used in sensitivity analysis 1) might be the most relevant. For now, however, this remains unclear.
Estimates of reproduction numbers for different influenza subtypes at the start of each season and under base case assumptions were mostly between 1.1 and 1.3, lower than typically reported in temperate countries . The model gave generally good fits to surveillance data, and the model estimates of annual serological attack rates (17%, 26%, 19%, and 13% for the four influenza seasons of April 2005–March 2009) are consistent with estimates obtained from a recent sero-epidemiological study in Viet Nam which estimated that, over three successive influenza seasons (2007–2010), 21%, 26%, and 17% of people aged over 5 y acquired at least one influenza infection . These findings provide reassurance that a simple age-structured transmission model is able to capture essential features of influenza dynamics in tropical Southeast Asia.
We are not aware of other studies evaluating the cost-effectiveness of childhood influenza vaccination in low- or middle-income countries. While there have been cost-effectiveness studies of childhood seasonal influenza vaccination in high-income countries, most have used only static models, neglecting the important indirect effects [1,30,49]. An important exception is a recent study by Pitman et al. which suggested that offering LAIV to all children aged 2–18 y is a very cost-effective policy in England and Wales, with an incremental cost-effectiveness ratio of less than £300 per quality-adjusted life year, a finding broadly in agreement with our own . Our analysis, however, suggests that similar policies have the potential to have a particularly large impact on influenza epidemiology in Thailand and, potentially, other tropical developing countries. This is a consequence of the much higher proportion of the population represented by children in typical developing countries and the apparently lower levels of transmission in predominantly rural tropical populations. These two factors mean that by vaccinating children it might be possible to approach coverage levels necessary to prevent sustained person-to-person transmission of influenza. However, whether such a herd-immunity threshold can be achieved with mass influenza vaccination in practice is unclear. First, vaccine effectiveness may be lower in tropical Southeast Asia than in temperate countries, possibly as a result of greater antigenic diversity . Second, a large-scale vaccination campaign has the potential to alter the competitive landscape between influenza subtypes, potentially resulting in selection for subtypes against which the vaccine has poor effectiveness. The chances of this happening depend on the circulating strains, the degree of cross-protection to these offered by the vaccine, the degree of prior immunity to circulating strains, and the importance of strain-transcending immunity in influenza dynamics . These considerations suggest that vaccine effectiveness against influenza when used as part of a mass immunization campaign might be much lower than observed efficacy in randomized trials. At present we do not have a good enough theoretical understanding of the forces shaping influenza strain dynamics to make robust predictions of how important such considerations are .
The assumption that some proportion of those vaccinated are fully protected against infection and the rest fully unprotected is also a simplification, and variation between individuals in protection due to vaccination is an important determinant of the population-level impact of vaccination . Vaccines may also have several components of effectiveness (reducing susceptibility, transmissibility, and progression to symptomatic infection) . In the absence of reliable data to inform a model accounting for these complexities, we performed a threshold analysis where LAIV effectiveness ranged from 0% to 100%. This analysis showed that even with much lower vaccine effectiveness than assumed in the base case, childhood vaccination with LAIV would be likely to represent good value for money.
The new quadrivalent seasonal influenza vaccine with protection against two lineages of influenza B would be likely to provide somewhat greater health benefits than TIV in elderly people. Two modeling studies indicated that this vaccine has the potential to be cost-effective compared to TIV in high-income settings [55,56]. Currently, however, reliable efficacy data to inform an analysis in a middle-income setting are lacking, though in Thailand between 2004 and 2008, influenza B viruses of both Victoria and Yamagata lineages co-circulated, and about half of the circulating influenza B viruses may have been mismatched with the influenza B component of the annual vaccine . This suggests that benefits from using the quadrivalent vaccine are likely. However, unless the difficulties in achieving even moderate vaccine coverage levels in the elderly in Thailand can be overcome, the impact of using a slightly more efficacious vaccine in the elderly is likely to be small.
Strengths of our study include the detailed accounting for health and economic impacts, the integrated, dynamic age-structured model, the coherent propagation of different sources of uncertainty through the model, and extensive sensitivity analyses. There are also a number of limitations. First, we did not explicitly account for waning immunity and antigenic drift: both are implicitly accounted for in the proportion initially immune. Similarly, we assumed that vaccination in one year confers protection against influenza strains circulating only that year, not subsequent years (though since this is a conservative assumption, it should not affect our conclusion that LAIV is likely to be cost-effective). We also neglected explicit consideration of births and deaths unrelated to influenza because we ran the model only over short time periods. More importantly, we lacked data concerning prior immunity to influenza in different age groups, and in our base case analysis, we relied on expert judgment. However, we performed additional sensitivity analyses that show that our conclusions are robust to alternative immunity assumptions. Another limitation is the assumption that influenza A/H1N1, A/H3N2, and B epidemics proceed independently. This is unlikely to be strictly true, but modeling such interactions would require either a detailed mechanistic understanding of the interactions between influenza subtypes or longer time series data to allow us to make inferences about such interactions. Both are currently lacking. Other potential refinements to the modeling approach include accounting for spatial and seasonal effects. Again, both would require much richer datasets than those currently available.
A further consequence of our imperfect understanding of the genetic and immunological forces shaping influenza evolution is that we cannot make reliable predictions about the long-term effects of vaccination. If prior immunity to circulating influenza strains in a given season is low (as our elicitation exercise suggested and previous modeling studies have assumed), then even an immunization program that achieves herd immunity would not be expected to have a large effect on the immunological profile in the unvaccinated population. Conversely, if there is significant cross-protection between even distantly related influenza strains, as other models of the evolutionary dynamics of influenza have posited , then immunization programs could result in large long-term reductions in immunity levels in unvaccinated age groups, which might have long-term consequences. Thus, apparently quite theoretical and unresolved questions about the forces shaping influenza strain dynamics could have large practical consequences for vaccination programs. Encouragingly, we note that in Japan, where most school children were vaccinated against influenza between 1962 and 1987, the policy was associated with a large sustained reduction in mortality attributed to influenza and has been estimated to have prevented between 30 and 50 deaths per 100,000 annually .
It is also unknown whether less frequent influenza infections in the elderly will lead to increased disease severity from influenza infections or other respiratory pathogens (such interactions between different respiratory pathogens have been reported in children ). If this is the case, our analysis (and all others we are aware of) may overestimate the reduction in burden of disease associated with influenza vaccination.
In summary, our findings suggest that seasonal influenza vaccination of children with LAIV is likely to represent good value for money in the Thai setting and potentially in many other developing economies. Fundamental uncertainties about influenza remain, however, and for this reason we believe proposals for large-scale community-based controlled trials of policies to vaccinate children against influenza are as relevant to low- and middle-income settings as they are to high-income countries . The results of the present study were used to inform the development of the Health Promotion and Disease Prevention Benefit Package under the universal health coverage in Thailand. It was proposed that a school-based seasonal influenza vaccination program should be piloted in a few selected provinces in fiscal year 2016 before considering scale-up to a nationwide program. The design and evaluation of such pilot studies will need careful consideration, but prospective community-based household cohort studies in vaccinated and unvaccinated populations may be particularly valuable as part of this work .
Conceived and designed the experiments: AM NP SK WK WP BSC YT. Performed the experiments: AM NP SK WK WP BSC. Analyzed the data: AM NP SK WK WP BSC. Contributed reagents/materials/analysis tools: AM WP BSC. Wrote the first draft of the manuscript: AM BSC. Contributed to the writing of the manuscript: AM NP SK WK BSC YT. Agree with manuscript results and conclusions: AM NP SK WK WP BSC YT. All authors have read, and confirm that they meet, ICMJE criteria for authorship.
- 1. Jit M, Newall AT, Beutels P. Key issues for estimating the impact and cost-effectiveness of seasonal influenza vaccination strategies. Hum Vaccin Immunother 2013;9:834–840. pmid:23357859
- 2. Baguelin M, Flasche S, Camacho A, Demiris N, Miller E, Edmunds WJ. Assessing optimal target populations for influenza vaccination programmes: an evidence synthesis and modelling study. PLoS Med 2013;10:e1001527. pmid:24115913
- 3. Longini IM Jr. A theoretic framework to consider the effect of immunizing schoolchildren against influenza: implications for research. Pediatrics 2012;129 Suppl 2:S63–S67. pmid:22383483
- 4. Ndeffo Mbah ML, Medlock J, Meyers LA, Galvani AP, Townsend JP. Optimal targeting of seasonal influenza vaccination toward younger ages is robust to parameter uncertainty. Vaccine 2013;31:3079–3089. pmid:23684837
- 5. Basta NE, Chao DL, Halloran ME, Matrajt L, Longini IM Jr. Strategies for pandemic and seasonal influenza vaccination of schoolchildren in the United States. Am J Epidemiol 2009;170:679–686. pmid:19679750
- 6. Vynnycky E, Pitman R, Siddiqui R, Gay N, Edmunds WJ. Estimating the impact of childhood influenza vaccination programmes in England and Wales. Vaccine 2008;26:5321–5330. pmid:18647634
- 7. Pitman RJ, White LJ, Sculpher M. Estimating the clinical impact of introducing paediatric influenza vaccination in England and Wales. Vaccine. 2012;30:1208–1224. pmid:22178725
- 8. Reichert TA, Sugaya N, Fedson DS, Glezen WP, Simonsen L, Tashiro M. The Japanese experience with vaccinating schoolchildren against influenza. N Engl J Med 2001;344:889–896. pmid:11259722
- 9. Dawood FS, Prapasiri P, Areerat P, Ruayajin A, Chittaganpitch M, Muangchana C, et al. Effectiveness of the 2010 and 2011 Southern Hemisphere trivalent inactivated influenza vaccines against hospitalization with influenza-associated acute respiratory infection among Thai adults aged ≥ 50 years. Influenza Other Respir Viruses 2014;8:463–468. pmid:24490684
- 10. Osterholm MT, Kelley NS, Sommer A, Belongia EA. Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12:36–44. pmid:22032844
- 11. Briggs AH. A Bayesian approach to stochastic cost-effectiveness analysis. Health Econ 1999;8:257–261. pmid:10348420
- 12. Barton GR, Briggs AH, Fenwick EA. Optimal cost-effectiveness decisions: the role of the cost-effectiveness acceptability curve (CEAC), the cost-effectiveness acceptability frontier (CEAF), and the expected value of perfection information (EVPI). Value Health 2008;11:886–897. pmid:18489513
- 13. Sadatsafavi M, Bansback N, Zafari Z, Najafzadeh M, Marra C. Need for speed: an efficient algorithm for calculation of single-parameter expected value of partial perfect information. Value Health 2013;16:438–448. pmid:23538197
- 14. Cauchemez S, Bhattarai A, Marchbanks TL, Fagan RP, Ostroff S, Ferguson NM, et al. Role of social networks in shaping disease transmission during a community outbreak of 2009 H1N1 pandemic influenza. Proc Natl Acad Sci U S A 2011;108:2825–2830. pmid:21282645
- 15. Carrat F, Vergu E, Ferguson NM, Lemaitre M, Cauchemez S, Leach S, et al. Time lines of infection and disease in human influenza: a review of volunteer challenge studies. Am J Epidemiol 2008;167:775–785. pmid:18230677
- 16. Chittaganpitch M, Supawat K, Olsen SJ, Waicharoen S, Patthamadilok S, Yingyong D, et al. Influenza viruses in Thailand: 7 years of sentinel surveillance data, 2004–2010. Influenza Other Respir Viruses 2012;6:276–283. pmid:22074057
- 17. Breteler JK, Tam JS, Jit M, Ket JC, De Boer MR. Efficacy and effectiveness of seasonal and pandemic A (H1N1) 2009 influenza vaccines in low and middle income countries: a systematic review and meta-analysis. Vaccine 2013;31:5168–5177. pmid:24012574
- 18. Jefferson T, Rivetti A, Di Pietrantonj C, Demicheli V, Ferroni E. Vaccines for preventing influenza in healthy children. Cochrane Database Syst Rev. 2012; 8:CD004879. pmid:22895945
- 19. McKenzie J, Ryan R, Di Tanna GL. Cochrane Consumer and Communication Review Group: cluster randomised controlled trials. Available: http://cccrg.cochrane.org/sites/cccrg.cochrane.org/files/uploads/ClusterRCTs.pdf. Accessed 23 April 2015.
- 20. Saha S, Chadha M, Al Mamun A, Rahman M, Sturm-Ramirez K, Chittaganpitch M, et al. Influenza seasonality and vaccination timing in tropical and subtropical areas of southern and south-eastern Asia. Bull World Health Organ 2014; 92:318–330. pmid:24839321
- 21. Cooper BS, Kotirum S, Kulpeng W, Praditsitthikorn N, Chittaganpitch M, Limmathurotsakul D, et al. Mortality attributable to seasonal influenza A and B infections in Thailand, 2005–2009: a longitudinal study. Am J Epidemiol 2015 Apr 20.
- 22. Zhou Y, Lau EH, Ip DK, Nishiura H, Leung GM, Seto WH, et al. Years of life lost in the first wave of the 2009 influenza A(H1N1) pandemic in Hong Kong. Am J Epidemiol 2013;178:1313–1318. pmid:23978528
- 23. Lugner AK, van Boven M, de Vries R, Postma MJ, Wallinga J. Cost effectiveness of vaccination against pandemic influenza in European countries: mathematical modelling analysis. BMJ 2012;345:e4445. pmid:22791791
- 24. Prosser LA, Bridges CB, Uyeki TM, Rego VH, Ray GT, Meltzer MI, et al. Values for preventing influenza-related morbidity and vaccine adverse events in children. Health Qual Life Outcomes 2005;3:18. pmid:15780143
- 25. Program for Appropriate Technology in Health, World Health Organization, Health Systems Research Institute, Mahidol University. An assessment of vaccine supply chain and logistics systems in Thailand. Program for Appropriate Technology in Health; 2011. Available: http://www.path.org/publications/files/TS_opt_vac_sup_thai.pdf. Accessed 23 April 2015.
- 26. Riewpaiboon A. Standard cost lists for health technology assessment. Nonthaburi (Thailand): Health Intervention and Technology Assessment Program; 2011. Available: http://www.hitap.net/costingmenu/. Accessed 23 April 2015.
- 27. Simmerman JM, Lertiendumrong J, Dowell SF, Uyeki T, Olsen SJ, Chittaganpitch M, et al. The cost of influenza in Thailand. Vaccine 2006;24:4417–4426. pmid:16621187
- 28. Dieleman J, Romio S, Johansen K, Weibel D, Bonhoeffer J, Sturkenboom M, et al. Guillain-Barre syndrome and adjuvanted pandemic influenza A (H1N1) 2009 vaccine: multinational case-control study in Europe. BMJ. 2011;343:d3908. pmid:21750072
- 29. Centers for Disease Control and Prevention. Vaccines for Children Program (VFC): CDC vaccine price list. Centers for Disease Control and Prevention; 2014. Available: http://www.cdc.gov/vaccines/programs/vfc/awardees/vaccine-management/price-list/. Accessed 23 April 2015.
- 30. Luce BR, Nichol KL, Belshe RB, Frick KD, Li SX, Boscoe A, et al. Cost-effectiveness of live attenuated influenza vaccine versus inactivated influenza vaccine among children aged 24–59 months in the United States. Vaccine. 2008;26:2841–2848. pmid:18462851
- 31. Tarride J-E, Burke N, Von Keyserlingk C, O’Reilly D, Xie F, Goeree R. Cost-effectiveness analysis of intranasal live attenuated vaccine (LAIV) versus injectable inactivated influenza vaccine (TIV) for Canadian children and adolescents. Clinicoecon Outcomes Res. 2012;4:287–298. pmid:23055756
- 32. Damm O, Eichner M, Rose MA, Knuf M, Wutzler P, Liese JG, et al. Public health impact and cost-effectiveness of intranasal live attenuated influenza vaccination of children in Germany. Eur J Health Econ. 2014 May 25.
- 33. Thai Ministry of Commerce Bureau of Trade and Economic Indices. Report for consumer price index of Thailand year 2007: base year 2011. Available: http://www.indexpr.moc.go.th/price_present/TableIndexG_region.asp?nyear=2550&Province_code=5&table_name=cpig_index_country&type_code=g&check_f=i&comm_code=0&Submit=+%B5%A1%C5%A7+. Accessed 23 April 2015.
- 34. International Monetary Fund. World economic outlook database, October 2012: Thailand—national currency per current international dollar. Available: http://www.imf.org/external/pubs/ft/weo/2012/02/weodata/weorept.aspx?sy=2010&ey=2017&scsm=1&ssd=1&sort=country&ds=.&br=1&pr1.x=21&pr1.y=9&c=578&s=PPPEX&grp=0&a=. Accessed 23 April 2015.
- 35. Oakley J, O’Hagan A. SHELF: the Sheffield Elicitation Framework (version 2.0). University of Sheffield School of Mathematics and Statistics; 2014. Available: http://tonyohagan.co.uk/shelf. Accessed 23 April 2015.
- 36. Horby P, Mai le Q, Fox A, Thai PQ, Thi Thu Yen N, Thanh le T, et al. The epidemiology of interpandemic and pandemic influenza in Vietnam, 2007–2010: the Ha Nam household cohort study I. Am J Epidemiol. 2012;175:1062–1074. pmid:22411862
- 37. Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS—a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000;10:325–337. pmid:10902901
- 38. Clover RD, Crawford S, Glezen WP, Taber LH, Matson CC, Couch RB. Comparison of heterotypic protection against influenza A/Taiwan/86 (H1N1) by attenuated and inactivated vaccines to A/Chile/83-like viruses. J Infect Dis. 1999;163:300–4. pmid:1988512
- 39. Loeb M, Russell ML, Moss L, Fonseca K, Fox J, Earn DJ, et al. Effect of influenza vaccination of children on infection rates in Hutterite communities: a randomized trial. JAMA. 2010;303:943–950. pmid:20215608
- 40. Belshe RB, Mendelman PM, Treanor J, King J, Gruber WC, Piedra P, et al. The efficacy of live attenuated, cold-adapted, trivalent, intranasal influenzavirus vaccine in children. N Engl J Med. 1998;338:1405–1412. pmid:9580647
- 41. Belshe RB, Gruber WC, Mendelman PM, Cho I, Reisinger K, Block SL, et al. Efficacy of vaccination with live attenuated, cold-adapted, trivalent, intranasal influenza virus vaccine against a variant (A/Sydney) not contained in the vaccine. J Pediatr. 2000;136:168–75. pmid:10657821
- 42. Tam JS, Capeding MR, Lum LC, Chotpitayasunondh T, Jiang Z, Huang LM, et al. Efficacy and safety of a live attenuated, cold-adapted influenza vaccine, trivalent against culture-confirmed influenza in young children in Asia. Pediatr Infect Dis J. 2007;26:619–28. pmid:17596805
- 43. Lum LC, Borja-Tabora CF, Breiman RF, Vesikari T, Sablan BP, Chay OM, et al. Influenza vaccine concurrently administered with a combination measles, mumps, and rubella vaccine to young children. Vaccine. 2010;28:1566–1574. pmid:20003918
- 44. World Health Organization. Cost effectiveness and strategic planning (WHO-CHOICE): Cost-effectiveness thresholds. Available: http://www.who.int/choice/costs/CER_thresholds/en/. Accessed 23 April 2015.
- 45. Clemens J, Brenner R, Rao M, Tafari N, Lowe C. Evaluating new vaccines for developing countries. Efficacy or effectiveness? JAMA. 1996;275:390–397. pmid:8569019
- 46. Kulpeng W, Leelahavarong P, Rattanavipapong W, Sornsrivichai V, Baggett HC, Meeyai A, et al. Cost-utility analysis of 10- and 13-valent pneumococcal conjugate vaccines: protection at what price in the Thai context? Vaccine. 2013;31:2839–2847. pmid:23588084
- 47. Muangchana C, Riewpaiboon A, Jiamsiri S, Thamapornpilas P, Warinsatian P. Economic analysis for evidence-based policy-making on a national immunization program: a case of rotavirus vaccine in Thailand. Vaccine. 2012; 30:2839–2847. pmid:22387220
- 48. Lowen AC, Mubareka S, Steel J, Palese P. Influenza virus transmission is dependent on relative humidity and temperature. PLoS Pathog 2007;3:1470–1476. pmid:17953482
- 49. Savidan E, Chevat C, Marsh G. Economic evidence of influenza vaccination in children. Health Policy 2008;86:142–152. pmid:18054109
- 50. Pitman RJ, Nagy LD, Sculpher MJ. Cost-effectiveness of childhood influenza vaccination in England and Wales: Results from a dynamic transmission model. Vaccine 2013;31:927–942. pmid:23246550
- 51. Russell CA, Jones TC, Barr IG, Cox NJ, Garten RJ, Gregory V, et al. The global circulation of seasonal influenza A (H3N2) viruses. Science 2008; 320:340–346. pmid:18420927
- 52. Ferguson NM, Galvani AP, Bush RM. Ecological and immunological determinants of influenza evolution. Nature 2003; 422:428–433. pmid:12660783
- 53. Wikramaratna PS, Sandeman M, Recker M, Gupta S. The antigenic evolution of influenza: drift or thrift? Philos Trans R Soc Lond B Biol Sci 2013;368:20120200. pmid:23382423
- 54. Gomes MG, Lipsitch M, Wargo AR, Kurath G, Rebelo C, Medley GF, et al. A missing dimension in measures of vaccination impacts. PLoS Pathog 2014;10:e1003849. pmid:24603721
- 55. Van Bellinghen LA, Meier G, Van Vlaenderen I. The potential cost-effectiveness of quadrivalent versus trivalent influenza vaccine in elderly people and clinical risk groups in the UK: a lifetime multi-cohort model. PLoS ONE 2014;9:e98437. pmid:24905235
- 56. You J, Ming WK, Chan P. Cost-effectiveness analysis of quadrivalent influenza vaccine versus trivalent influenza vaccine for elderly in Hong Kong. BMC Infect Dis 2014;14:618. pmid:25420713
- 57. Cowling BJ, Fang VJ, Nishiura H, Chan KH, Ng S, Ip DK, et al. Increased risk of noninfluenza respiratory virus infections associated with receipt of inactivated influenza vaccine. Clin Infect Dis 2012;54:1778–1783. pmid:22423139