Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Evaluation of the indirect impact of the 10-valent pneumococcal Haemophilus influenzae protein D conjugate vaccine in a cluster-randomised trial

  • Hanna Rinta-Kokko ,

    Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    rintakokko.hanna@gmail.com

    Current address: IQVIA, Global Database Studies, Espoo, Finland

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Helsinki, Finland

  • Arto A. Palmu,

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Tampere, Finland

  • Esa Ruokokoski,

    Roles Conceptualization, Data curation, Writing – review & editing

    Affiliation Department of Information Services, Finnish Institute for Health and Welfare, Helsinki, Finland

  • Heta Nieminen,

    Roles Conceptualization, Data curation, Writing – review & editing

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Tampere, Finland

  • Marta Moreira,

    Roles Formal analysis, Supervision, Writing – review & editing

    Current address: NIHDI National Institute for Health and Disability Insurance, Brussels, Belgium

    Affiliation GSK, Wavre, Belgium

  • Lode Schuerman,

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliation GSK, Wavre, Belgium

  • Dorota Borys,

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliation GSK, Wavre, Belgium

  • Jukka Jokinen

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Information Services, Finnish Institute for Health and Welfare, Helsinki, Finland

Abstract

Background

In the nation-wide double-blind cluster-randomised Finnish Invasive Pneumococcal disease trial (FinIP, ClinicalTrials.gov NCT00861380, NCT00839254), we assessed the indirect impact of the 10-valent pneumococcal Haemophilus influenzae protein D conjugate vaccine (PHiD-CV10) against five pneumococcal disease syndromes.

Methods

Children 6 weeks to 18 months received PHiD-CV10 in 48 clusters or hepatitis B/A-vaccine as control in 24 clusters according to infant 3+1/2+1 or catch-up schedules in years 2009―2011. Outcome data were collected from national health registers and included laboratory-confirmed and clinically suspected invasive pneumococcal disease (IPD), hospital-diagnosed pneumonia, tympanostomy tube placements (TTP) and outpatient antimicrobial prescriptions. Incidence rates in the unvaccinated population in years 2010―2015 were compared between PHiD-CV10 and control clusters in age groups <5 and ≥5 years (5―7 years for TTP and outpatient antimicrobial prescriptions), and in infants <3 months. PHiD-CV10 was introduced into the Finnish National Vaccination Programme (PCV-NVP) for 3-month-old infants without catch-up in 9/2010.

Results

From 2/2009 to 10/2010, 45398 children were enrolled. Vaccination coverage varied from 29 to 61% in PHiD-CV10 clusters. We detected no clear differences in the incidence rates between the unvaccinated cohorts of the treatment arms, except in single years. For example, the rates of vaccine-type IPD, non-laboratory-confirmed IPD and empyema were lower in PHiD-CV10 clusters compared to control clusters in 2012, 2015 and 2011, respectively, in the age-group ≥5 years.

Conclusions

This is the first report from a clinical trial evaluating the indirect impact of a PCV against clinical outcomes in an unvaccinated population. We did not observe consistent indirect effects in the PHiD-CV10 clusters compared to the control clusters. We consider that the sub-optimal trial vaccination coverage did not allow the development of detectable indirect effects and that the supervening PCV-NVP significantly diminished the differences in PHiD-CV10 vaccination coverage between the treatment arms.

Introduction

The indirect effects of a vaccination programme are the protective or detrimental effects that are mediated by the intervention-induced changes in transmission [1]. Herd immunity develops due to reduced transmission of the causative pathogen in the population, either by lowering the number of sick subjects transmitting the disease or by reducing the number of subjects carrying the causative pathogen and the subsequent opportunities for further transmission and progression to disease [2]. While the immunological direct effect in the vaccinated population develops within a couple of weeks, the indirect effects develop more slowly after dynamic transmission cascades.

Streptococcus pneumoniae has about 100 circulating serotypes [3] and the currently available pneumococcal conjugate vaccines (PCVs) contain capsular polysaccharides of 10 to 13 serotypes [4]. The protective effects usually apply only to the serotypes included in the vaccines, while non-vaccine serotypes may replace the vaccine types in nasopharyngeal carriage and at least partly in disease [5]. Thus, PCV indirect effects are composed of both herd immunity and serotype replacement that affect both the vaccinated and unvaccinated population [2, 6].

Given the documented efficacy of PCVs on vaccine-type nasopharyngeal carriage [7], it was expected to see some degree of indirect effects also on pneumococcal disease outcomes [6]. Some indirect effects on the unvaccinated populations were detected in observational studies after the large-scale introduction of the 7-valent PCV (PCV7) in infant programmes in 2000s [810], and later after the introduction of the higher valent PCVs [1118]. As observational studies with historical reference incidence are prone to many sources of bias, such as secular trends, indirect effects may be difficult to assess. The cluster-randomised design mimics vaccination programmes and enables the evaluation of the indirect impact in unvaccinated populations when all children within a cluster are vaccinated with the study vaccine and compared to unvaccinated populations in control clusters in parallel [19, 20]. However, to our knowledge there have been no clinical trial data to demonstrate the development and extent of the indirect effects of the PCVs on pneumococcal clinical outcomes.

We planned and conducted the cluster-randomised nation-wide double-blind Finnish Invasive Pneumococcal disease (FinIP) trial enabling the evaluation of the indirect effects in addition to the total effects of the 10-valent pneumococcal Haemophilus influenzae protein D conjugate vaccine (PHiD-CV10, Synflorix, GSK) [21]. Here, we present the evaluation of the indirect impact in the unvaccinated population from 2010 to 2015 following vaccination of 6-week-old to 18-month-old children in the PHiD-CV10 clusters compared to the control clusters. Although we observed some signals of indirect effects, we did not observe consistent indirect impact in this clinical trial setting.

Materials and methods

Study design

The FinIP trial was a phase III/IV cluster-randomised double-blind trial (ClinicalTrials.gov NCT00861380). The study design has been published previously [21]. Briefly, children 6 weeks to 18 months of age received PHiD-CV10 in 52 clusters or control hepatitis vaccines in 26 clusters. Infants 6 weeks to 6 months of age at the first vaccination received either a 3+1 or a 2+1 vaccination schedule, while children 7 to 11 and 12 to 18 months of age received 2+1 and 2-dose catch-up schedules, respectively. The control clusters used the same vaccination schedules as above with hepatitis B vaccine (Engerix-B, GSK) as control for infants 6 weeks to 11 months of age and hepatitis A vaccine (Havrix 720 Junior, GSK) as control for children 12 to 18 months of age. From February 18, 2009, to October 5, 2010, 47366 children were enrolled in 651 local well-baby clinics, including 15 Tampere University Vaccine Research Centre (TAUVRC) clinics, and vaccinated during routine visits. TAUVRC contributed to study enrolment in a parallel trial, nested within the FinIP trial design (ClinicalTrials.gov NCT00839254) [22]. The trial enrolment ended, as planned, when PHiD-CV10 was introduced into the Finnish National Vaccination Programme (PCV-NVP) for 3-month-old infants in September 2010 in a 2+1 schedule without catch-up vaccinations of older children. Last trial vaccine doses were administered in September 2011. Written informed consent was obtained from a parent or legal guardian. Participants could be enrolled provided they had not received and were not anticipated to receive any of the study vaccines, nor had any study-vaccine-specific or general contraindications to immunisations. The trial profile is presented in Fig 1. The demographic details of the study participants have been described previously [21].

thumbnail
Fig 1. Trial profile of 78 clusters.

The 3+1 and 2+1 clusters differed only for the infant schedules. Catch-up schedules were identical for the 3+1 and 2+1 clusters and were always combined for the analyses. For the indirect effect analysis, 72 clusters were included. * = Includes one subject withdrawn from the register follow-up during the blinded follow-up period. The figure has been presented previously [23].

https://doi.org/10.1371/journal.pone.0261750.g001

For the indirect impact assessment, we included 72 study clusters based on geographical areas of the participating health centers (S1 Fig). TAUVRC contributed to the study enrolment in 44 of these clusters in the biggest cities [22]. The six additional clusters where the enrolment was conducted only through TAUVRC clinics were not included in the evaluation of the indirect impact due to low enrolment proportions. The 72 clusters were randomised (2:2:1:1) into PHiD-CV10 3+1, PHiD-CV10 2+1, control 3+1 and control 2+1 groups.

The population of the 72 clusters that was not vaccinated in the FinIP trial was included in the evaluation of the indirect impact. The use of PCVs (PCV7, PHiD-CV10 and 13-valent PCV [PCV13] licensed in 2001, 2009, and 2009 respectively in the European Union) was negligible (<1%) among infants and children before the FinIP trial. With regard to adults, the vaccination coverage of the 23-valent polysaccharide vaccine (PPV23) has been low over years: data from the Health 2011 [24] obtained by personal interviews indicate that <2% of the elderly population 65 years or older have ever received PPV23 in Finland. The cumulative vaccination coverage of PCV13, which was licensed for use in adults in November 2011, was 8.9% in 2015 in the age group ≥65 years [25]. PCV13-vaccinated individuals were not excluded from the analysis, because they were assumed to be randomly allocated to PHiD-CV10 and control clusters.

Outcomes

The outcomes and case definitions are summarised in Table 1 and have been presented in detail previously [21, 23, 2628]. All outcome data were collected from established national health registers in routine use (Table 1). The Personal Identity Code was used to identify the cases for the current analysis and to exclude the cases in vaccinated FinIP participants. For each disease syndrome, a new episode was considered to start if a specific number of days had elapsed from the beginning of the previous one (see Table 1).

Study cohorts

The population of Finland was 5.3 million in 2010 out of whom 4.0 million (76%) lived in the 72 study cluster areas. For the evaluation of the indirect impact, the population of the 72 clusters that was not vaccinated in the FinIP trial was included in the analysis. For tympanostomy tube placements (TTPs) and outpatient antimicrobial prescriptions, children ≤7 years of age were included in the analysis.

Children vaccinated within the FinIP trial (including both PHiD-CV10 and control vaccine recipients) were excluded from the analyses starting from the date of the first vaccination. However, children eligible for PHiD-CV10 in the PCV-NVP (born June 1, 2010 or later) were not excluded in order to keep the age distributions similar in successive calendar years and because PHiD-CV10 coverage (first dose range 93.5―95.6% in birth cohorts of 2012―2015 [25], S2 Fig) was considered to be similar between the randomised study clusters.

The unvaccinated population of the study clusters was divided into three age groups (S2 Fig). Population ≥5 years of age (5―7 years for TTPs and outpatient antimicrobial prescriptions) and children <5 years of age were mutually exclusive. Children <3 months of age, a subgroup who were too young to be vaccinated during the PCV-NVP, were evaluated separately. For additional analyses, population was further split into five-year age groups (0―4, 5―9, etc. in Figs 2A, 2B, 3A, 3B, 4A and 4B).

thumbnail
Fig 2. Incidence of IPD by age group (in years) in PHiD-CV10 and control clusters, average over years 2010―2015.

(A) Incidence of all IPD. (B) Incidence of vaccine-type IPD.

https://doi.org/10.1371/journal.pone.0261750.g002

thumbnail
Fig 3. Rates of clinically suspected IPD by age group (in years) in PHiD-CV10 and control clusters, average over years 2010―2015.

(A) Incidence of hospital-diagnosed non-laboratory-confirmed IPD or unspecified sepsis. (B) Incidence of hospital-diagnosed non-laboratory-confirmed IPD.

https://doi.org/10.1371/journal.pone.0261750.g003

thumbnail
Fig 4. Incidence of pneumonia by age group (in years) in PHiD-CV10 and control clusters, average over years 2010―2015.

(A) Incidence of hospital-diagnosed pneumonia. (B) Incidence of hospital-diagnosed empyema.

https://doi.org/10.1371/journal.pone.0261750.g004

Follow-up

Per year, follow-up time was calculated as the number of Finnish population in study clusters in each year and age strata. The follow-up time of the children vaccinated within the FinIP trial was removed.

Relocations between clusters or abroad were not estimated during single calendar-years because we assumed they were similar between treatment arms. Follow-up time was aggregated by cluster (1―72), calendar-year (2010―2015) and age-group.

Ethics statement

The study protocols were approved by the independent ethics committee at the hospital district of Helsinki and Uusimaa and the competent authorities prior to trial start. The study was conducted in accordance with Good Clinical Practice principles and the Declaration of Helsinki. Study protocols are available at https://thl.fi/en/web/thlfi-en/research-and-development/research-and-projects/finip-trial and https://www.gsk-studyregister.com/.

Statistical analysis

Incidence rates were calculated as arithmetic means for each study year separately, except those of age group <3 months which were calculated for the six follow-up years combined. To increase precision, we combined all ages 5 years and above and analysed PHiD-CV10/control 2+1 and 3+1 clusters combined. For illustration, incidence rates were calculated for 5-year age groups over the whole follow-up period.

The indirect vaccine impact was defined as (1-incidence rate ratio [IRR]) * 100%. To estimate IRRs and consider the possible overdispersion in the cluster-specific incidences, a negative binomial model was used. The cases were grouped by cluster, and the cluster-specific person-years were used as an offset in the model. The factors used in the stratified randomisation (urban vs. rural clusters, cluster size below vs. above average, and TAUVRC trial enrolment in the cluster) were included as explanatory variables. Results are presented as point estimates and 95% confidence intervals (CIs). Relative rate reduction was considered statistically significant if the 95% CI did not include 0%. Bold font indicates statistical significance in tables. No correction for multiple testing was applied.

Wide variations in the incidence rates of several outcomes in the trial clusters were observed. Therefore, we obtained historical aggregate data for the Finnish population in years 2004―2008 to perform explorative post-hoc analyses. We used the incidence of selected outcomes (all IPD, vaccine-type [VT]-IPD, hospital-diagnosed pneumonia [HDP], hospital-treated primary pneumonia [HTPP], TTP, and outpatient antimicrobial purchase) by cluster from these years as an additional explanatory variable to adjust for the background variation between clusters. The statistical program R version 3.4.4 [29] was used in the analyses. The analyses were also performed using Statistical Analysis System (SAS) [30]. The results of PHiD-CV10 impact for years from 2009 till 2012 on probable or culture-confirmed IPD and on HDP in the unvaccinated population, as well as on TTP and on outpatient antimicrobial prescriptions in unvaccinated children ≤7 years of age can be found at ClinicalTrials.gov (NCT00861380, NCT00839254).

Results

In the 72 clusters considered for the indirect impact analysis, 41188 children were enrolled in the FinIP trial and 4210 in the TAUVRC trial from February 2009 to October 2010 with a total of 45398 children.

The annual number of episodes in 2010―2015 in the unvaccinated population across age groups ranged from 572 to 628 for laboratory-confirmed IPD, from 10100 to 14961 for non-laboratory-confirmed IPD or unspecified sepsis, from 35103 to 42223 for HDP, from 7966 to 9455 for TTPs (children ≤7 years of age), and from 216971 to 255554 for outpatient antimicrobial purchases (children ≤7 years of age). The annual follow-up time ranged from 187065 to 223950 person-years in children <5 years of age, and from 3981437 to 4032499 person-years in age-group ≥5 years. The numbers of episodes in age groups <5, 5―7 and ≥5 years as well as the corresponding person-years are presented in (S1S3 Tables).

Vaccination coverage

The trial vaccination coverage increased steadily in time up to 38% in the trial eligible cohort (a 30-month birth cohort from December 2007 through May 2010, S2 and S3 Figs). The final vaccination coverage varied from 29 to 61% in the individual PHiD-CV10 clusters. After the introduction of PHiD-CV10 in the PCV-NVP in September 2010, the vaccination coverage in the population aged <5 years increased to 95% in 2015 (S2 Fig).

Laboratory-confirmed IPD

The annual incidence of all IPD decreased in PHiD-CV10 and control clusters in children <5 years of age during follow-up (S4 Table) but remained stable in the older population ≥5 years (Table 2). There were no clear differences in all IPD incidence rates between the treatment arms in any of the age groups (Fig 2A, Table 2, S4 and S5 Tables).

thumbnail
Table 2. Incidence rates of laboratory-confirmed IPD and the corresponding relative rate reductions in the unvaccinated population ≥5 years of age in PHiD-CV10 vs. control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.t002

The incidence of VT-IPD decreased from 2010 to 2015 in both PHiD-CV10 and control clusters in <5 and ≥5 age groups with a faster decline in PHiD-CV10 clusters (Table 2 and S4 Table). The incidence was lower in PHiD-CV10 clusters compared to control clusters in age group ≥5 years in 2012 (Table 2) mainly due to reductions in serotype 23F, 19F, 4 and 9V IPD. The incidence of VT-IPD was lower in PHiD-CV10 clusters also in years 2013 and 2014 in age group ≥5 years, although CIs included 0%. In children <5 years, a lower incidence of VT-IPD was seen in PHiD-CV10 clusters compared to control clusters in 2013 (S4 Table). Also in infants <3 months of age, the incidence of VT-IPD was lower in PHiD-10 clusters compared to control clusters in years 2010―2015, but the 95% CI included 0% (S5 Table). When aggregating study years, there was a trend for lower VT-IPD incidence rates between the treatment arms in the population older than 70 years of age (Fig 2B).

The incidence rates of vaccine-related and non-vaccine-related IPD increased during follow-up in both PHiD-CV10 and control clusters in age group ≥5 years. There were no clear differences in the incidence rates of these serotype groups between the treatment arms: all 95% CIs included 0% (Table 2). However, in 2014 the incidence of vaccine-related IPD in children aged <5 years was 7.7 per 100000 person-years in the PHiD-CV10 clusters, while there were no cases in the control clusters (S4 Table). In infants <3 months of age the incidence of vaccine-related IPD was higher in PHiD-CV10 clusters compared to control clusters in years 2010―2015, but the CI was wide and included 0% (S5 Table).

Clinically suspected IPD

No clear differences were observed in the incidence rates of non-laboratory-confirmed IPD or unspecified sepsis between the treatment arms in any of the age groups (Fig 3A, Table 3, S4 and S5 Tables). Instead, there was a notable increasing trend in the incidence in population ≥5 years from 2010 to 2015 in both PHiD-CV10 and control clusters which was not observed in <5 years (Table 3 and S4 Table).

thumbnail
Table 3. Incidence rates of clinically suspected IPD without laboratory confirmation and the corresponding relative rate reductions in the unvaccinated population ≥5 years of age in PHiD-CV10 vs. control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.t003

There were no clear differences in the incidence rates of the more specific outcome, non-laboratory-confirmed IPD, between the treatment arms (Fig 3B, Table 3, S4 and S5 Tables). All 95% CIs included 0% except for non-laboratory confirmed IPD in 2015 in age group ≥5 years that was borderline statistically significant. During that year, the incidence was lower in the PHiD-CV10 clusters compared to the control clusters. In children <5 years, there was a clear decreasing trend in both treatment arms (S4 Table).

Pneumonia

No indirect impact was seen on HDP or HTPP during the follow-up, neither for children <5 years nor the population ≥5 years (Fig 4A, Table 4 and S6 Table). All 95% CIs included 0%. Only in the age group <3 months the rates of HDP and HTPP were lower in the PHiD-CV10 clusters compared to the control clusters, but CIs were wide and included 0% (S5 Table). Interestingly, the incidence of empyema was lower in PHiD-CV10 clusters compared to control clusters in age group ≥5 years in 2011 (Table 4). In younger age groups, no differences in incidence between the treatment arms were seen (Fig 4B and S6 Table).

thumbnail
Table 4. Incidence rates of pneumonia and the corresponding relative rate reductions in the unvaccinated population ≥5 years of age in PHiD-CV10 vs. control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.t004

Tympanostomy tube placements and outpatient antimicrobial purchases

Among older children 5―7 years of age, there was an initial increase in the incidence of both TTP and antimicrobial consumption in PHiD-CV10 and control clusters from 2010 to 2011, but a decline after that (Table 5). No indirect impact was seen against neither TTP nor antimicrobial consumption in age groups <5 and 5―7 years (Table 5, S6 Table, Figs 5 and 6). All 95% CIs included 0%. In infants <3 months the rates of TTP and antimicrobial consumption were lower in the PHiD-CV10 clusters compared to the control clusters, but CIs were wide and included 0% (S5 Table).

thumbnail
Fig 5. Incidence of tympanostomy tube placements by age year in PHiD-CV10 and control clusters, average over years 2010―2015.

https://doi.org/10.1371/journal.pone.0261750.g005

thumbnail
Fig 6. Incidence of outpatient antimicrobial prescriptions by age year in PHiD-CV10 and control clusters, average over years 2010―2015.

https://doi.org/10.1371/journal.pone.0261750.g006

thumbnail
Table 5. Incidence rates of tympanostomy tube placements and outpatient antimicrobial prescriptions and the corresponding relative rate reductions in the unvaccinated population 5―7 years of age in PHiD-CV10 vs. control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.t005

Additional analyses

We noted substantial variation in the incidence of several outcomes between the study clusters. Therefore, we conducted post-hoc analyses of vaccine impact in population ≥5 years of age to adjust for pre-trial incidence data from years 2004―2008. These cluster-specific historical data highly correlated with the trial data. The post-hoc analyses with pre-trial data did not affect our vaccine impact estimates, although the CIs were narrower in the adjusted analyses (S7 Table). According to this analysis, the reduction in VT-IPD was statistically significant also in 2013, in addition to year 2012.

Discussion

In our clinical trial setting, we observed reductions in several disease outcomes in the unvaccinated study populations in the PHiD-CV10 clusters compared to the control clusters, although mostly in single follow-up years. The incidence rates of VT-IPD, non-laboratory-confirmed IPD and empyema were lower in PHiD-CV10 clusters compared to control clusters in 2012, 2015 and 2011, respectively, in the age-group ≥5 years. In children <5 years, a lower incidence of VT-IPD was seen in PHiD-CV10 clusters compared to control clusters in 2013. However, consistent indirect impact in the PHiD-CV10 clusters throughout the follow-up years was not observed. It is plausible that the lower than optimal vaccination coverage in the PHiD-CV10 clusters was not high enough for a rapid development of indirect effects. Also the supervening infant PCV-NVP since fall 2010 diluted the vaccine exposure contrasts and reduced the disease burden in both PHiD-CV10 and control clusters within a couple of years.

While we could observe limited indirect impact in the older unvaccinated population, our assessment of the indirect impact on children under 5 years of age was complicated. First, we excluded the children vaccinated within the FinIP trial. This leads to the exclusion of different age strata during consecutive calendar years (S2 Fig). This exclusion does not affect the parallel time comparison of the PHiD-CV10 and control clusters, however it may bias the comparison of incidence rates between calendar years, as the incidence of pneumococcal infection varies by age. Second, children eligible for PCV-NVP were not excluded from the follow-up. The vaccination coverage of PCV-NVP was equally high in the PHiD-CV10 and control clusters and therefore the comparison of the treatment arms should be valid. However, children under 3 months of age were unvaccinated as the first PCV-NVP dose was scheduled at 3 months of age. Interestingly, all point estimates of this age group, except for the vaccine-related and non-vaccine-related type IPD, have positive point estimates, yet the CIs are wide due to the short period of observation.

There is a large number of observational studies showing evidence for indirect impact on unvaccinated populations. Most studies report indirect impact on culture-confirmed IPD after PCV introduction [814, 16, 18, 3139] with varying degrees of replacement disease, but there are also several reports on pneumonia [15, 17, 4045]. Furthermore, there is an abundance of data showing changes in nasopharyngeal vaccine-type and non-vaccine type carriage prevalence not only in vaccinated, but also in unvaccinated populations [4651].

Observational studies are, however, prone to many sources of bias: secular trends, changes in diagnostics and treatment, changes in background factors and other interventions relevant to the outcome, patient and physicians’ expectations that change the care-seeking and diagnostics behavior, publication bias, etc. [52]. The corresponding trial design that accounts for most types of bias and allows the estimation of population-level vaccine effects is the cluster-randomised design. Specifically, indirect impact can be estimated by comparing the unvaccinated population in the intervention clusters to the unvaccinated population in the control clusters in parallel follow-up (cf. 19,20). To our knowledge, there are no clinical pneumococcal vaccine trials that have previously reported the indirect impact on disease outcomes.

A specific limitation to assess indirect impact from clinical trials is that the proportion of the target population enrolled and the vaccination coverage achieved are often much lower than in routine vaccination programmes. In our study the vaccination coverage was low during the trial (estimated on average at 38% in the PHiD-CV10 clusters) and the trial enrolment needed to be stopped when the universal immunisations in PCV-NVP started in September 2010. Therefore, the trial vaccination coverage may not have been high enough to induce detectable differences in indirect effects against most of the disease outcomes between the treatment arms. However, our trial setting can be considered representative for the whole population due to the large regional coverage of the clusters and the use of nation-wide health registers.

A small proportion of older adults were concomitantly administered individual pneumococcal vaccinations [24, 25]. However, the uptake of both PCV13 and PPV23 in adults >65 years of age was low during the study follow-up. The randomised study design should take care of any potential confounding related to other pneumococcal vaccinations as the vaccinated individuals were considered randomly distributed between the treatment arms.

Our results should be considered exploratory. We performed statistical testing including several outcomes, multiple calendar years, and several age groups, but did not correct for multiple testing. Only a few findings were considered statistically significant according to the descriptive criterium. However, they all point towards positive indirect impact against vaccine-type disease and none towards negative impact. This suggests true herd effects rather than chance findings that would be expected to be even in either direction, i.e. either positive or negative. On the other hand, replacement by some non-vaccine serotypes was observed. Our results are compatible with those of the two satellite carriage studies conducted in the context of the FinIP trial [53]. In those studies, a reduction of vaccine-type carriage was seen in 2011 in the older unvaccinated siblings of the PHiD-CV10―vaccinated children compared to the siblings of the control children, but the difference was attenuated by 2013.

According to WHO Expert Committee on Biological Standardization, randomisation of groups or clusters, rather than individuals, is preferable when the indirect effects of vaccination are of interest [20]. The FinIP trial was originally designed to assess the total effects in the vaccinated and the indirect effects in the unvaccinated population. Unfortunately, high vaccination coverage was not reached thereby hampering the possibility to develop indirect effects before the supervening PCV-NVP. This also suggests that our previous results from the trial regarding the total effects are predominantly due to the direct effects of the vaccine [21, 23, 2628]. With regard to the indirect effects, despite many sources of bias, long-term observational studies during PCV-NVP better describe the indirect impact of pneumococcal vaccinations than the results from our trial design. As an example, we observed a marked reduction in HTPP in young unvaccinated children three years after the introduction of PHiD-CV10 in PCV-NVP [41], yet we saw no indirect impact within the trial setting against this outcome. Neither were we able to show consistent indirect impact against most other pneumococcal disease outcomes in the PHiD-CV10 clusters, although some trends towards decreasing incidence were observed e.g. in VT-IPD in 2012―2013. PHiD-CV10 has been shown to reduce vaccine-type carriage and IPD, non-laboratory-confirmed IPD, and pneumonia in unvaccinated populations subject to the infant vaccination programmes [12, 41, 49, 5355], as well as to decrease the transmission of vaccine-type carriage within families [50].

In conclusion, although no consistent evidence of the indirect impact was seen in this clinical trial setting, several observational studies have shown that PCVs induce herd effects in unvaccinated populations. The development of the indirect effects takes a few years, and high vaccination coverage with catch-up vaccinations speeds up the development. Not all of these prerequisites were fulfilled in this trial because the average vaccination coverage reached only 38% in the PHiD-CV10 clusters. Moreover, PCV-NVP started right after the trial enrolment with high vaccination coverage among infants. It caused strong indirect effects, levelled out the possible differences between the treatment arms, and eliminated the potential to observe indirect impact in the trial setting. Nevertheless, our study contributes to the evidence for the overall impact of PHiD-CV10 against several pneumococcal disease syndromes.

Supporting information

S1 Checklist. CONSORT 2010 checklist of information to include when reporting a randomised trial*.

https://doi.org/10.1371/journal.pone.0261750.s001

(PDF)

S1 Fig. Map of Finland with trial municipalities and treatment arms.

Treatment arms are indicated with different colours and the lines represent the boundaries of Finnish municipalities, the number of which ranged from 1 to 12 per cluster. Six biggest cities included several clusters. In the trial, there were altogether 78 clusters which all are presented in the Figure. For the indirect effect analysis, 72 clusters were included.

https://doi.org/10.1371/journal.pone.0261750.s002

(TIFF)

S2 Fig. Age groups that were evaluated in this study, the FinIP participant cohort, and the infant cohort eligible for PHiD-CV10 in the PCV-NVP.

Age groups of the study were children less than 5 years and population 5 years or older (5―7 years for TTPs and outpatient antimicrobial prescriptions). Children under 3 months of age, a subgroup who were too young to be vaccinated during the PCV-NVP, were evaluated separately.

https://doi.org/10.1371/journal.pone.0261750.s003

(TIFF)

S3 Fig. FinIP trial enrolment by calendar month (February 2009 through October 2010).

Solid line: all children; dashed line: infants 6 weeks to 6 months of age; dotted line: catch-up children 7 to 18 months of age.

https://doi.org/10.1371/journal.pone.0261750.s004

(TIFF)

S1 Table. Number of episodes of laboratory-confirmed and clinically suspected IPD, pneumonia, tympanostomy tube placements and outpatient antimicrobial purchases, and the corresponding person-time in the unvaccinated population <5 years of age in PHiD-CV10 and control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.s005

(DOCX)

S2 Table. Number of episodes of tympanostomy tube placements and outpatient antimicrobial purchases, and the corresponding person-time in the unvaccinated population 5―7 years of age in PHiD-CV10 and control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.s006

(DOCX)

S3 Table. Number of episodes of laboratory-confirmed and clinically suspected IPD and pneumonia, and the corresponding person-time in the unvaccinated population ≥5 years of age in PHiD-CV10 and control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.s007

(DOCX)

S4 Table. Incidence rates of laboratory-confirmed and clinically suspected IPD, and the corresponding relative rate reductions in the unvaccinated population <5 years of age in PHiD-CV10 vs. control clusters in years 2010 through 2015, Finland.

Results obtained from explorative post-hoc analyses using data from year 2004―2008 to adjust the impact analyses for the background variation detected in the study clusters.

https://doi.org/10.1371/journal.pone.0261750.s008

(DOCX)

S5 Table. Incidence rates of all outcomes and the corresponding relative rate reductions in the unvaccinated population <3 months of age in PHiD-CV10 vs. control clusters, average over years 2010―2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.s009

(DOCX)

S6 Table. Incidence rates of pneumonia, tympanostomy tube placements and outpatient antimicrobial purchases, and the corresponding relative rate reductions in the unvaccinated population <5 years of age in PHiD-CV10 vs. control clusters in years 2010 through 2015, Finland.

https://doi.org/10.1371/journal.pone.0261750.s010

(DOCX)

S7 Table. Incidence rates of all IPD, vaccine-type IPD, hospital-diagnosed pneumonia, hospital-treated primary pneumonia, tympanostomy tube placements and outpatient antimicrobial purchases, and the corresponding relative rate reductions in the unvaccinated population ≥5 years of age (5―7 years of age for tympanostomy tube placements and outpatient antimicrobial purchases) in calendar years 2010 through 2015, Finland.

Results obtained from explorative post-hoc analyses using data from year 2004―2008 to adjust the impact analyses for the background variation detected in the study clusters.

https://doi.org/10.1371/journal.pone.0261750.s011

(DOCX)

Acknowledgments

We thank all the children and families who participated in this trial. We owe our special gratitude to all the health care centre and well-baby clinic personnel, who made the practical conduct of this study possible. The Finnish Care Register at THL and the Benefits Register of the Social Insurance Institution of Finland are acknowledged for collecting high-quality register data suitable for scientific purposes.

THL personnel contributing to the study: the study physicians Susanna Pihlman, Ulla-Maija Rautakorpi, and Ritva Syrjänen; the study nurses Päivi Sirén (head nurse), Sanna Huovari, Anni Huttunen, Susanna Jääskeläinen, Satu Karjalainen, Maila Kyrölä, Eija Lahtinen, Sanna Laine, Sini Lang, Anu-Riikka Markkanen, Seija Nieminen, Aune Niittyvuopio, Kaisu Riikonen, Tanja Trygg, Paula Vuorenniemi, and Mari Vuorijärvi; Piia Peltola and Jonas Sundman for data management; Saila Pitkänen for media activities; Ulla Johansson at secretariat; Terhi Kilpi for study conceptualisation and methodology and the THL Steering committee members Kari Auranen, Tarja Kaijalainen, Helena Käyhty, Hanna Nohynek, and Petri Ruutu.

GSK personnel contributing to the study: Liesbet de Cock, Paulo Négrier da Cunha, Satu Sumanen, Minna Neulasalmi, Markku Pulkkinen, and Kaisa Kaitila for study clinical operations, Javier Ruiz-Guiñazú for study supervision and formal analysis, Patricia Lommel and Magali Traskine for formal analysis and the medical writers Liliana Manciu (protocol development), Kristel Vercauteren (protocol and clinical study report development, Modis c/o GSK) and Stéphanie Deroo (manuscript coordination, Modis c/o GSK).

Trademark statement

Synflorix, Engerix-B, and Havrix 720 Junior are trademarks owned by the GSK group of companies.

References

  1. 1. Halloran ME, Haber M, Longini IM Jr., Struchiner CJ. Direct and indirect effects in vaccine efficacy and effectiveness. Am J Epidemiol. 1991;133(4):323–331. pmid:1899778
  2. 2. Simell B, Auranen K, Käyhty H, Goldblatt D, Dagan R, O’Brien KL. The fundamental link between pneumococcal carriage and disease. Expert Rev Vaccines. 2012;11(7):841–855. pmid:22913260
  3. 3. Ganaie F, Saad J, McGee L, van Tonder A, Bentley S, Lo S, et al. A new pneumococcal capsule type, 10D, is the 100th serotype and has a large cps fragment from an oral Streptococcus. mBio. 2020;11(3):e00937–20 pmid:32430472
  4. 4. World Health Organization. Pneumococcal conjugate vaccines in infants and children under 5 years of age: WHO position paper–February 2019. Wkly Epidemiol Rec. 2019;94(8):85–104
  5. 5. Weinberger D, Malley R, Lipsitch M. Serotype replacement in disease after pneumococcal vaccination. Lancet 2011;378:1962–73. pmid:21492929
  6. 6. Käyhty H, Auranen K, Nohynek H, Dagan R, Mäkelä H. Nasopharyngeal colonization: a target for pneumococcal vaccination. Expert Rev Vaccines. 2006;5(5):651–667. pmid:17181439
  7. 7. Cohen O, Knoll M, O’Brien K, Ramakrishnan M, Constenla D, Privor-Dumm L, et al. Pneumococcal conjugate vaccine (PCV) product assessment. 2017; [Accessed 2021 May 29]. Available at: https://www.jhsph.edu/ivac/wpcontent/uploads/2018/05/pcv-product-assessment-april-25-2017.pdf
  8. 8. Whitney C, Farley M, Hadler J, Harrison L, Bennett N, Lynfield R, et al. Decline in invasive pneumococcal disease after the introduction of protein–polysaccharide conjugate vaccine. N Engl J Med. 2003;348(18):1737–1746. pmid:12724479
  9. 9. Lepoutre A, Varon E, Georges S, Gutmann L, Lévy-Bruhl D. Impact of infant pneumococcal vaccination on invasive pneumococcal diseases in France, 2001–2006. Euro Surveill 2008;13(35):18962. pmid:18761883
  10. 10. Ardanuy C, Tubau F, Pallares R, Calatayud L, Dominguez M, Rolo D, et al. Epidemiology of invasive pneumococcal disease among adult patients in Barcelona before and after pediatric 7-valent pneumococcal conjugate vaccine introduction, 1997–2007. Clin Infect Dis. 2009;48(1):57–64. pmid:19035779
  11. 11. Harboe Z, Dalby T, Weinberger D, Benfield T, Mølbak K, Slotved H, et al. Impact of 13-valent pneumococcal conjugate vaccination in invasive pneumococcal disease incidence and mortality. Clin Infect Dis. 2014;59(8):1066–1073. pmid:25034421
  12. 12. Jokinen J, Rinta-Kokko H, Siira L, Palmu AA, Virtanen MJ, Nohynek H, et al. Impact of ten-valent pneumococcal conjugate vaccination on invasive pneumococcal disease in Finnish children—a population-based study. PLoS One. 2015;10(3):e0120290. pmid:25781031
  13. 13. Moore MR, Link-Gelles R, Schaffner W, Lynfield R, Lexau C, Bennet NM, et al. Effect of use of 13-valent pneumococcal conjugate vaccine in children on invasive pneumococcal disease in children and adults in the USA: analysis of multisite, population-based surveillance. Lancet Infect Dis. 2015;15(3):301–309. pmid:25656600
  14. 14. Knol MJ, Wagenvoort GHJ, Sanders EAM, Elberse K, Vlaminckx BJ, de Melker HE, et al. Invasive pneumococcal disease 3 years after introduction of 10-valent pneumococcal conjugate vaccine, the Netherlands. Emerg Infect Dis. 2015;21(11):2040–2044. pmid:26488415
  15. 15. Rodrigo C, Bewick T, Sheppard C, Greenwood S, Mckeever TM, Trotter CL, et al. Impact of infant 13-valent pneumococcal conjugate vaccine on serotypes in adult pneumonia. Eur Respir J 2015;45(6):1632–1641. pmid:25792633
  16. 16. Guevara M, Barricarte A, Torroba L, Herranz M, Gil-Setas A, Gil F, et al. Direct, indirect and total effects of 13-valent pneumococcal conjugate vaccination on invasive pneumococcal disease in children in Navarra, Spain, 2001 to 2014: cohort and case–control study. Euro Surveill. 2016;21(14):pii = 30186. pmid:27103428
  17. 17. Andrade AL, Afonso ET, Minamisava R, Bierrenbach AL, Cristo EB, Morais-Neto OL, et al. Direct and indirect impact of 10-valent pneumococcal conjugate vaccine introduction on pneumonia hospitalizations and economic burden in all age-groups in Brazil: A time-series analysis. PLoS One. 2017;12(9):e0184204. pmid:28880953
  18. 18. Hanquet G, Krizova P, Valentiner-Branth P, Ladhani SN, Nuorti JP, Lepoutre A, et al. Effect of childhood pneumococcal conjugate vaccination on invasive disease in older adults of 10 European countries: implications for adult vaccination. Thorax. 2019;74(5):473–482. pmid:30355641
  19. 19. Kahn R, Rid A, Smith PG, Eyal N, Lipsitch M. Choices in vaccine trial design in epidemics of emerging infections. Plos Med 2018;15(8):e1002632. pmid:30086139
  20. 20. WHO Expert Committee on Biological Standardization. Guidelines on clinical evaluation of vaccines: regulatory expectations. Replacement of Annex 1 of WHO Technical Report Series, No. 924; [Accessed 2021 May 29]. Available at: https://www.who.int/biologicals/vaccines/clinical_evaluation/en/.
  21. 21. Palmu AA, Jokinen J, Borys D, Nieminen H, Ruokokoski E, Siira L, et al. Effectiveness of the ten-valent pneumococcal Haemophilus influenzae protein D conjugate vaccine (PHiD-CV10) against invasive pneumococcal disease: a cluster randomised trial. Lancet. 2013;381(9862):214–222. pmid:23158882
  22. 22. Vesikari T, Forsten A, Seppä I, Kaijalainen T, Puumalainen T, Soininen A, et al. Effectiveness of the 10-valent pneumococcal nontypeable Haemophilus influenzae protein D–conjugated vaccine (PHiD-CV) against carriage and acute otitis media—a double-blind randomized clinical trial in Finland. J Pediatric Infect Dis Soc. 2016;5(3):237–248. pmid:27125273
  23. 23. Kilpi TM, Jokinen J, Puumalainen T, Nieminen H, Ruokokoski E, Rinta-Kokko H, et al. Effectiveness of pneumococcal Haemophilus influenzae protein D conjugate vaccine against pneumonia in children: a cluster-randomised trial. Vaccine. 2018;36(39):5891–5901. pmid:30145098
  24. 24. Finnish Institute for Health and Welfare (THL), Finland. Health 2011 survey. Helsinki: THL; [Accessed 27 Jan 2020]. Available at: https://thl.fi/en/web/thlfi-en/research-and-expertwork/projects-and-programmes/health-2000-2011
  25. 25. Finnish Institute for Health and Welfare (THL), Finland. The vaccination register. Helsinki: THL; [Accessed 27 Jan 2020]. Available from: https://thl.fi/en/web/vaccination/vaccination-coverage/national-vaccination-register
  26. 26. Palmu AA, Jokinen J, Nieminen H, Rinta-Kokko H, Ruokokoski E, Puumalainen T, et al. Effect of pneumococcal Haemophilus influenzae protein D conjugate vaccine (PHiD-CV10) on outpatient antimicrobial purchases: a double-blind, cluster randomised phase 3–4 trial. Lancet Infect Dis. 2014;14(3):205–212. pmid:24287186
  27. 27. Palmu AA, Jokinen J, Nieminen H, Syrjänen R, Ruokokoski E, Puumalainen T, et al. Vaccine effectiveness of the pneumococcal Haemophilus influenzae protein D conjugate vaccine (PHiD-CV10) against clinically suspected invasive pneumococcal disease: a cluster-randomised trial. Lancet Respir Med. 2014;2(9):717–727. pmid:25127244
  28. 28. Palmu AA, Jokinen J, Nieminen H, Rinta-Kokko H, Ruokokoski E, Puumalainen T, et al. Effectiveness of the ten-valent pneumococcal conjugate vaccine against tympanostomy tube placements in a cluster-randomized trial. Pediatr Infect Dis J. 2015;34(11):1230–1235. pmid:26284652
  29. 29. R: A Language and Environment for Statistical Computing. R Core Team. R Foundation for Statistical Computing, Vienna, Austria; [Accessed 29 May 2021]. Available at: https://www.R-project.org.
  30. 30. The Statistical Analysis System (SAS). Cary, NC, USA; [Accessed 29 May 2021]. Available at: https://www.sas.com/en_us/home.html. Lexau CA, Lynfield R, Danila R, Pilishvili T, Facklam R, Farley MM, et al. Changing epidemiology of invasive pneumococcal disease among older adults in the era of pediatric pneumococcal conjugate vaccine. JAMA. 2005;294(16):2043–2051. pmid:16249418
  31. 31. Vestrheim DF, Høiby EA, Bergsaker MR, Rønning K, Aaberge IS, Caugant DA. Indirect effect of conjugate pneumococcal vaccination in a 2+1 dose schedule. Vaccine. 2010;28(10):2214–2221. pmid:20056192
  32. 32. Feikin DR, Kagucia EW, Loo JD, Link-Gelles R, Puhan MA, Cherian T, et al. Serotype-specific changes in invasive pneumococcal disease after pneumococcal conjugate vaccine introduction: a pooled analysis of multiple surveillance sites. PLoS Med. 2013;10(9):e1001517. pmid:24086113
  33. 33. van der Linden M, Falkenhorst G, Perniciaro S, Imöhl M. Effects of infant pneumococcal conjugate vaccination on serotype distribution in invasive pneumococcal disease among children and adults in Germany. PLoS One. 2015;10(7):e0131494. pmid:26132078
  34. 34. Ladhani SN, Collins S, Djennad A, Sheppard CL, Borrow R, Fry NK, et al. Rapid increase in non-vaccine serotypes causing invasive pneumococcal disease in England and Wales, 2000–17: a prospective national observational cohort study. Lancet Infect Dis 2018;18(4):441–451. pmid:29395999
  35. 35. Corcoran M, Vickers I, Mereckiene J, Murchan S, Cotter S, Fitzgerald M, et al. The epidemiology of invasive pneumococcal disease in older adults in the post-PCV era. Has there been a herd effect? Epidemiol. Infect. 2017;145(11):2390–2399. pmid:28712384
  36. 36. Naucler P, Galanis I, Morfeldt E, Darenberg J, Örtqvist A, Henriques-Normark B. Comparison of the impact of pneumococcal conjugate vaccine 10 or pneumococcal conjugate vaccine 13 on invasive pneumococcal disease in equivalent populations. Clin Infect Dis. 2017;65(11):1780–1789. pmid:29020171
  37. 37. De Wals P, Lefebvre B, Deceuninck G, Longtin J. Incidence of invasive pneumococcal disease before and during an era of use of three different pneumococcal conjugate vaccines in Quebec. Vaccine. 2018;36(3):421–426. pmid:29224962
  38. 38. Richter L, Schmid D, Kanitz EE, Zwazl I, Pöllabauer E, Jasinska J, et al. Invasive pneumococcal diseases in children and adults before and after introduction of the 10-valent pneumococcal conjugate vaccine into the Austrian national immunization program. PLoS One. 2019;14(1):e0210081. pmid:30629620
  39. 39. Menzies RI, Jardine A, McIntyre PB. Pneumonia in elderly Australians: reduction in presumptive pneumococcal hospitalizations but no change in all-cause pneumonia hospitalizations following 7-valent pneumococcal conjugate vaccination. Clin Infect Dis. 2015;61(6):927–933. pmid:26066319
  40. 40. Nair H, Watts AT, Williams LJ, Omer SB, Simpson CR, Willocks LJ, et al. Pneumonia hospitalisations in Scotland following the introduction of pneumococcal conjugate vaccination in young children. BMC Infect Dis. 2016;16:390. pmid:27506837
  41. 41. Palmu AA, Rinta-Kokko H, Nohynek H, Nuorti JP, Kilpi TM, Jokinen J. Impact of ten-valent pneumococcal conjugate vaccine on pneumonia in Finnish children in a nation-wide population-based study. PLoS One. 2017:12(3):e0172690. pmid:28249015
  42. 42. Thorrington D, Andrews N, Stowe J, Miller E, van Hoek AJ. Elucidating the impact of the pneumococcal conjugate vaccine programme on pneumonia, sepsis and otitis media hospital admissions in England using a composite control. BMC Medicine 2018;16(1):13. pmid:29415741
  43. 43. Okasha O, Rinta-Kokko H, Palmu AA, Ruokokoski E, Jokinen J, Nuorti JP. Population-level impact of infant 10-valent pneumococcal conjugate vaccination on adult pneumonia hospitalisations in Finland. Thorax. 2018;73(3):262–269. pmid:28988217
  44. 44. Kislaya I, Rodrigues AP, Sousa-Uva M, Gómez V, Gonçalves P, Froes F, et al. Indirect effect of 7-valent and 13-valent pneumococcal conjugated vaccines on pneumococcal pneumonia hospitalizations in elderly. PLoS One. 2019;14(1):e0209428. pmid:30650091
  45. 45. Givon-Lavi N, Fraser D, Dagan R. Vaccination of day-care center attendees reduces carriage of Streptococcus pneumoniae among their younger siblings. Pediatr Infect Dis J. 2003;22(6):524–531. pmid:12799509
  46. 46. Hammitt LL, Bruden DL, Butler JC, Baggett HC, Hurlburt DA, Reasonover A, et al. Indirect effect of conjugate vaccine on adult carriage of Streptococcus pneumoniae: an explanation of trends in invasive pneumococcal disease. J Infect Dis. 2006;193(11):1487–1494. pmid:16652275
  47. 47. Flasche S, Van Hoek AJ, Sheasby E, Waight P, Andrews N, Sheppard C, et al. Effect of pneumococcal conjugate vaccination on serotype-specific carriage and invasive disease in England: a cross-sectional study. PLoS Med. 2011;8(4):e1001017. pmid:21483718
  48. 48. van Hoek AJ, Sheppard CL, Andrews NJ, Waight PA, Slack MPE, Harrison TG, et al. Pneumococcal carriage in children and adults two years after introduction of the thirteen valent pneumococcal conjugate vaccine in England. Vaccine. 2014;32(34):4349–4355. pmid:24657717
  49. 49. Sigurdsson S, Erlendsdóttir H, Quirk SJ, Kristjánsson J, Hauksson K, Andrésdóttir BDI, et al. Pneumococcal vaccination: direct and herd effect on carriage of vaccine types and antibiotic resistance in Icelandic children. Vaccine. 2017;35(39):5242–5248. pmid:28823621
  50. 50. Dunne EM, Satzke C, Ratu FT, Neal EFG, Boelsen LK, Matanitobua S, et al. Effect of ten-valent pneumococcal conjugate vaccine introduction on pneumococcal carriage in Fiji: results from four annual cross-sectional carriage surveys. Lancet Glob Health. 2018;6(12):e1375–1385. pmid:30420033
  51. 51. Usuf E, Bottomley C, Bojang E, Cox I, Bojang A, Gladstone R, et al. Persistence of nasopharyngeal pneumococcal vaccine serotypes and increase of nonvaccine serotypes among vaccinated infants and their mothers 5 years after introduction of pneumococcal conjugate vaccine 13 in the Gambia. Clin Infect Dis. 2019;68(9):1512–1521. pmid:30165376
  52. 52. Lewnard J, Hanage WP. Making sense of differences in pneumococcal serotype replacement. Lancet Infect Dis 2019;19(6):E213–20. pmid:30709666
  53. 53. Palmu AA, Toropainen M, Kaijalainen T, Siira L, Lahdenkari M, Nieminen H, et al. Direct and indirect effectiveness of the 10-valent pneumococcal conjugate vaccine against carriage in a cluster randomized trial. Pediatr Infect Dis J. 2017;36(12):1193–1200. pmid:28737627
  54. 54. Hammitt LL, Akech DO, Morpeth SC, Karani A, Kihuha N, Nyongesa S, et al. Population effect of 10-valent pneumococcal conjugate vaccine on nasopharyngeal carriage of Streptococcus pneumoniae and non-typeable Haemophilus influenzae in Kilifi, Kenya: findings from cross-sectional carriage studies. Lancet Glob Health. 2014;2(7):e397–405. pmid:25103393
  55. 55. Palmu AA, Rinta-Kokko H, Nuorti JP, Nohynek H, Jokinen J. A pneumococcal conjugate vaccination programme reduced clinically suspected invasive disease in unvaccinated children. Acta Pædiatr. 2018;107(9):1610–1615. pmid:29577411