Figures
Abstract
Background
Despite high vaccination coverage, pertussis incidence in the Netherlands is amongst the highest in Europe with a shifting tendency towards adults and elderly. Early detection of outbreaks and preventive actions are necessary to prevent severe complications in infants. Efficient pertussis control requires additional background knowledge about the determinants of testing and possible determinants of the current pertussis incidence. Therefore, the aim of our study is to examine the possibility of locating possible pertussis outbreaks using space-time cluster detection and to examine the determinants of pertussis testing and incidence using geographically weighted regression models.
Methods
We analysed laboratory registry data including all geocoded pertussis tests in the southern area of the Netherlands between 2007 and 2013. Socio-demographic and infrastructure-related population data were matched to the geo-coded laboratory data. The spatial scan statistic was applied to detect spatial and space-time clusters of testing, incidence and test-positivity. Geographically weighted Poisson regression (GWPR) models were then constructed to model the associations between the age-specific rates of testing and incidence and possible population-based determinants.
Results
Space-time clusters for pertussis incidence overlapped with space-time clusters for testing, reflecting a strong relationship between testing and incidence, irrespective of the examined age group. Testing for pertussis itself was overall associated with lower socio-economic status, multi-person-households, proximity to primary school and availability of healthcare. The current incidence in contradiction is mainly determined by testing and is not associated with a lower socioeconomic status.
Discussion
Testing for pertussis follows to an extent the general healthcare seeking behaviour for common respiratory infections, whereas the current pertussis incidence is largely the result of testing. More testing would thus not necessarily improve pertussis control. Detecting outbreaks using space-time cluster detection is feasible but needs to adjust for the strong impact of testing on the detection of pertussis cases.
Citation: Kauhl B, Heil J, Hoebe CJPA, Schweikart J, Krafft T, Dukers-Muijrers NHTM (2017) Is the current pertussis incidence only the results of testing? A spatial and space-time analysis of pertussis surveillance data using cluster detection methods and geographically weighted regression modelling. PLoS ONE 12(3): e0172383. https://doi.org/10.1371/journal.pone.0172383
Editor: Daniela Flavia Hozbor, Universidad Nacional de la Plata, ARGENTINA
Received: August 15, 2016; Accepted: February 3, 2017; Published: March 9, 2017
Copyright: © 2017 Kauhl et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Due to the Dutch law of protection of personal information (wet bescherming personengegevens Wbp or Personal Data Protection Act: http://wetten.overheid.nl/BWBR0011468/geldigheidsdatum_13-07-2015), it is not allowed to distribute or share any personal data that can be traced back (direct or indirect) to an individual. Although the pertussis data used in our study are third-party data, which cannot be traced back to an individual, interested researchers are required to provide their name and institution to avoid misuse of this sensitive data and to align with the Dutch law of protection of personal information. All six medical microbiology laboratories in the province of Limburg provided test data. We collected these data by a data request to the data-analysts and/or head of the laboratories, including all variables needed for our analyses: Maastricht University Medical Centre (MUMC+), VieCuri Medical Centre Venlo), Atrium Medical Centre (Heerlen), Orbic Medical Centre (Sittard-Geleen), Laurentius Hospital (Roermond), St. Jans Gasthuis (Weert), Atrium and Orbis are now called Zuyderland Medical Centre. All determinants of testing were obtained from Statistics Netherlands (CBS). Therefore, interested researchers may contact the head of the data-archiving (Helen Sijstermans: Helen.sijstermans@ggdzl.nl) to receive the data.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Pertussis is a highly infectious respiratory disease caused by Bordetella Pertussis and is especially severe in unvaccinated and incomplete vaccinated children [1]. Despite the implementation of extensive vaccination schemes, the incidence of pertussis is increasing in many countries with a shifting tendency towards adults and elderly [2–7]. In fully vaccinated children and adults with waning immunity, the symptoms are often mild and indistinguishable from other respiratory diseases [5]. The clinical diagnosis of pertussis is challenging, not only because symptoms are often unspecific, but also because co-infection with respiratory diseases complicates diagnosis [5,8,9]. Additionally, sensitivity and specificity of the applied laboratory tests are influenced by vaccination coverage, frequency of mild cases within the population, exposure to pertussis and age of the patient so that no single laboratory test can be considered as “gold standard” for confirming pertussis cases [10]. The lack of universal standards to confirm pertussis infections thus further facilitates the spread of undiagnosed infections.
This is problematic, as transmission through infected, but undiagnosed members of the same household are held responsible for most transmissions to not or incomplete vaccinated infants [11]. To further reduce transmission, several countries such as France, USA and Australia have incorporated adult booster doses in their respective vaccination schemes [12–15] and the Dutch health council recently recommended the introduction of maternal vaccination to the national vaccination program [16].
In the Netherlands, the pertussis incidence is amongst the highest in Europe and rates have increased since 1996 [17]. The underlying reasons of this increase are not fully conclusive. Several studies attribute the increase of pertussis to a waning immunity in adults [2,17] and new emerging strains of Bordetella Pertussis [18,19]. Other studies suggest that an increase of detected pertussis infections occurs mainly because of an increased awareness of the population and general practitioners (GPs) [20–22] and enhanced notification systems [21–23].
According to current general practitioner guidelines in the Netherlands, a clinical pertussis diagnosis is considered in patients having typical symptoms such as severe coughing who had contact with a proven pertussis case. Additional testing for pertussis is only recommended for patients in a household with an unvaccinated or incomplete vaccinated child younger than one year old and in households with a woman, which is more than 34 weeks pregnant [24]. For all other groups, testing is rather induced by the patient than the GP [25].
As pertussis is a notifiable disease in the Netherlands [26] and many other countries, the resulting surveillance data on testing and infections is used to monitor changes over space and time [27–29]. Despite previous findings that pertussis is highly heterogeneously distributed in space as well as in space-time [30,31], a substantial amount of current surveillance activities on pertussis is still restricted to a temporal analysis only [7,28,29,32], masking important regional variations and thus complicating an effective public health response.
Geographic Information Systems (GIS) and cluster detection methods–both, purely spatial as well as in time and space have proven useful to locate possible outbreaks of infectious diseases [33–35], including pertussis [30], resulting in a timely and effective response in affected areas. Such an approach might ultimately help to minimize the spread of pertussis at an early stage when the risk of transmission is highest [36].
Efficient pertussis control however, requires additional background knowledge about the determinants of pertussis testing and the determinants of the current pertussis incidence. However, personal patient information such as occurrence of infections within the same household, household composition, vaccination status and socio-demographic characteristics are mostly unavailable on an individual level due to privacy restrictions of surveillance data [37]. Detailed population information on household composition, socio-economic variables and information on available healthcare and infrastructure is in the Netherlands only available on an aggregated level such as neighbourhoods or municipalities [38,39].
In this context, spatial regression models at the ecological level have been increasingly applied in epidemiological studies of infectious diseases in recent years as regression modelling based on aggregated population data allows an analysis of possible risk factors that are unavailable on an individual level [39–41].
Geographically weighted regression modelling (GWR) is an extension of traditional global spatial regression models and measures how the association between disease risk and socio-demographic population characteristics varies over space. This approach often led to the conclusion that the key populations for certain diseases depend largely on the place of residence, resulting in more cost-effective, targeted public health interventions aimed at those groups who are most at risk in specific locations [39,42,43].
This approach has shown to be effective in revealing associated determinants of several infectious diseases such as Hepatitis C [39], HIV [44] and Japanese encephalitis [42] but has also been useful to examine determinants of treatment seeking behaviour i.e. for Malaria [45] and could thus provide a feasible basis to examine the determinants of pertussis testing and the associated determinants of the current pertussis incidence.
The aim of our article is therefore (i) to examine spatial and space-time clustering of pertussis testing, incidence and test-positivity and (ii) to model the associations between socio-demographic, healthcare and infrastructure related determinants and pertussis testing and incidence using geographically weighted regression models.
Data and methods
Ethics statement
The medical ethics committee of the Maastricht University Medical Centre (Maastricht, the Netherlands) approved the study (11-4-136) and waived the need for consent to be collected from participants. Since retrospective data originated from standard care (in which one can opt-out for the use of their data for scientific research) and were analysed anonymously, no further informed consent for data analysis was obtained.
Laboratory data
Pertussis laboratory data were collected between Jan. 1st 2007 and Dec. 31st 2013 in the province Limburg, the Netherlands, comprising a population of 1,121,820 inhabitants [46]. Testing for pertussis was performed by GPs and hospitals in the area and the test-samples were then sent to the six laboratories in the region, which are capable of analysing the collected samples. The data for this study were therefore retrieved from the registries of these six laboratories in the province and included all pertussis tests requested by health care providers. In total, the data consisted of 15,429 tested persons of which 3,312 (21.5%) persons were tested positive. Positivity was either based on the test result of the PCR (5.5% of tests), culture (2.4% of tests) or serology (IgG, 92.2% of tests); for the latter the international standard cut-off value of IgG≥62.5 IU/ml or IgG≥13 VU/ml was used to be a sensitive and specific indicator of a pertussis infection in the past year [47,48]. This standardisation was made, instead of using the laboratory interpretation, because laboratories used test cut-offs that differed between the laboratories and over time. When multiple serology was applied to test a person and test results were inconsistent, the standardised test result was positive when seroconversion occurred from a negative test to a positive test result. In 8.8% (1,361) of the tested persons, standardisation was not possible because IgG-titres were unavailable for the serological test. We were able to filter the laboratory result for most of these tests, but for a total of 1.0% (151) the test result remained missing.
Besides the results of the laboratory diagnosis, the available information included the four-digits postal code, sex, age and date of testing. In total 14,810 tested persons (96.0%) and 3,150 positive persons (95.1%) had valid postal codes assigned and were therefore included in our analyses.
Outcomes
As outcomes, we examined three different rates: (i) the proportion of tested persons per inhabitants (testing); (ii) the incidence of pertussis expressed as proportion of positive tested persons per inhabitants (incidence) and (iii) the proportion of positive to tested persons (test-positivity). Due to the different vulnerability between age groups [7], four demographic strata were used to calculate the rates outlined above: (i) children aged 0–14, (ii) adults between 15–64, (iii) persons aged 65 and older and (iv), total population. Although infants display the highest vulnerability to pertussis [1], an analysis of pertussis testing and incidence among 0–5 year olds was not advisable due to the low number of tests and infections in this age group.
Explanatory variables
We assessed several socio-demographic, infrastructure and healthcare-related variables for their association with the proportion of tested persons and pertussis incidence among the different age strata. The data and map sources were available from Statistics Netherlands [49]. The data were available per neighbourhood and had to be aggregated to the four-digits postal codes to match the pertussis laboratory data. In the Netherlands, a neighbourhood is an administrative area within a municipality with a homogenous socio-economic structure [38,39,49]. Due to privacy restrictions of statistics Netherlands, data for each variable is only reported for a minimum of inhabitants or households. For example, the number of persons in a specific age group is only reported for neighbourhoods with more than 50 persons, while average income is only reported for neighbourhoods with more than 100 persons [38,39,49]. The population-weighted aggregation was therefore only based on the neighbourhoods, for which data were made available. The age stratified population data, which were used for the calculation of the proportion of tested persons and the Pertussis incidence, was only available for 2013 from the Central Bureau for statistics Netherlands. As transmission occurs mainly between members of the same households [11], testing between different demographic strata is expected to follow a comparable pattern. We therefore included testing among the other age groups as independent variables in a regression analysis for testing in a specific age group. To analyse the determinants of the incidence, we included the rate of tested persons within the same age group and the rates of infected persons in the other age groups as independent variables. This should in a later stage confirm through GWR in which areas the effect of testing and potential intra-household transmission is stronger than in other areas.
Exploratory disease mapping
As our study aimed to highlight geographic heterogeneity among different demographic strata and different epidemiological outcomes on a small spatial scale, the numbers in the numerator for each examined demographic strata and epidemiological outcome can be considered as fairly low. This leads to a large variance of the respective rate simply due to varying population densities of relatively arbitrary administrative boundaries. As pertussis testing and infections are highly depending on local characteristics, neighbouring areas can therefore be expected to display similar rates and abrupt changes are more likely to occur due to the effect of relatively arbitrary administrative boundaries—also referred to as the modifiable area unit Problem (MAUP) [50]. We therefore applied a local empirical Bayesian smoothing approach where the respective rates are smoothed towards a local mean. The neighbours were defined as an area sharing a common edge or boundary [51]. The analysis was carried out in GeoDa 1.2.0 [52]. The resulting rates were then imported in ESRI ArcGIS 10.2.
Local cluster detection
Purely spatial cluster detection.
The spatial scan statistic is a local cluster test, which identifies the geographic location and statistical significance of local clusters [39,53,54]. The rationale behind a cluster analysis in our study was to detect significant local clusters of high rates within one demographic stratum and compare the location of clusters within the other demographic strata. In this study, we used two different models in SaTScan: For the proportion of tested persons and the incidence of pertussis, we used a purely spatial Poisson model [39,55]. The input data for this model consisted of the number of tested persons / positive tested persons and the population per demographic stratum as well as the centroid coordinates of each postal code [56]. For the proportion of positive tested persons, we used a purely spatial Bernoulli model [54,57]. For this model, the input data consisted of the number of positive tested persons, the number of negative tested persons per demographic stratum and the centroid coordinates for each postal code [56]. The spatial scan statistic then uses a circular scanning window, which is flexible in size up to a user-specified maximum or the standard setting of including up to 50% of the population inside a cluster. The scanning window gradually moves over the coordinates over the study area, evaluating all possible cluster locations and sizes. The statistical significance is evaluated by computing 999 Monte-Carlo replications [58]. In our study, we set the maximum population at risk to be included in a possible cluster not to exceed 5%. This was done since the default settings in SaTScan are more likely to produce very large clusters and therefore contain locations of low relative risk simply because of the circular scanning window [59]. The value of 5% of the maximum population at risk was based on the experience of a previous study in the area, which met our criterion of including only locations of elevated risk in a cluster [39].
Space-time cluster detection.
A space-time cluster analysis was employed in this study to evaluate whether testing, incidence and test-positivity occur at the same geographical locations and in the same time periods, providing background information whether space-time clusters of pertussis incidence are correlated in space-time with testing.
The space-time cluster analysis in SaTScan is comparable to a purely spatial model, except that the scanning window may be represented as a cylinder, where the base of the cylinder represents the geographic location and the height of the cylinder represents the time component of the scanning window. The scanning window then moves over all centroid coordinates across the study area and evaluates all possible space-time clusters within the study area and study period [60]. Similar to the purely spatial cluster analysis, we used for both, proportion of tested persons and incidence a space-time Poisson model and for the proportion of positive to tested persons, a space-time Bernoulli model [61]. In this study, we used a scanning window that may contain up to 10% of the background population and up to 12 months of the study period. The calculation of purely spatial and space-time clusters was carried out using SaTScan v9.4.1.
Selection of explanatory variables.
To select a meaningful set of explanatory variables for the regression analysis, we used a data-mining tool called “exploratory regression” in ESRI ArcGIS 10.2. This tool is comparable to a forward step-wise regression. In each step, one additional variable is added to the regression equation and evaluated based on following criteria in our analysis: (i) The regression coefficients are statistically significant (p<0,05) and (ii) do not display multicollinearity (Variance Inflation Factor < 7.5) [62]. We then chose a set of statistically significant explanatory variables as suggested by the exploratory regression that delivered a plausible explanation of the respective outcome (the proportion of tested persons or the pertussis incidence in the respective age group).
Geographically weighted poisson regression.
We constructed spatial regression models based on the variables suggested by the exploratory regression, which delivered a plausible explanation of the respective outcome. Global spatial regression models are often applied to determine the strength of the association between the dependent variable and a set of explanatory variables, but the obtained coefficients are averaged over the whole study area [51,63]. Our study area however, consisted of 258 postal codes and the socio-demographic composition and available infrastructure varies at local level. It is therefore unlikely that one single coefficient per explanatory variable would be a good estimator of the strength of the association for the whole study area. We therefore favoured a geographically weighted regression (GWR) approach over a global approach. Geographically weighted regression modelling measures how the relationship between a set of explanatory variables and an epidemiological outcome varies over space, resulting in more detailed understanding of the spatially varying key populations and local characteristics of the study area for different epidemiological outcomes [39,41,43,45,64].
The Poisson distribution among the available GWR models is most suitable for diseases, especially if observed counts of cases are low in certain areas [39,65–67]. The dependent variable was in the analysis for testing specified as the number of tests and in the analysis for incidence as positive cases per postal code. The offset variable was specified as the number of inhabitants per postal code. The centroids of each postal code area were used as input coordinates. The geographically weighted Poisson regression (GWPR) calculates an additional global Poisson model to allow a comparison between a global and a local approach. The GWPR uses a kernel function to fit a regression equation for each postal code area, where the centre of the kernel is the regression point. The kernel function assigns decreasing weights to the observations, depending on the distance (bandwidth) of the respective observation to the centre. The bandwidth of the kernel in GWPR can be either fixed or adaptive and the shape of the kernel can follow a Gaussian or a bi-square distribution. The optimization of the bandwidth in a GWPR model can be based on one of the three available criteria: (i) Akaikes Information Criterion (AIC); (ii) Akaikes corrected Information Criterion (AICc) and (iii) Bayesian Information Criterion (BIC) [63,68]. We thus evaluated all 12 possible combinations of kernel shape, bandwidth type and bandwidth optimization method for the eight different dependent variables. The models without clustered residuals were further considered and out of those, the models with the lowest AICc value and highest adjusted R2 were then chosen as the final models. The statistical significance of each coefficient per postal code was calculated using pseudo t-values [63]. The statistic behind GWPR is described in detail elsewhere [63].
We assessed clustering of the residuals of the GWPR using the global Moran`s I test in ESRI ArcGIS 10.2. The computation of GWPR was carried out in the GWR4 software [68]. The coefficients were standardized to allow a direct comparison of the strength of association among the examined explanatory variables. To enhance visualization of the spatially varying coefficients, we used the software`s “prediction at non-sample points” function and calculated the predicted values for a grid of Limburg based on a cell size of 100m x 100m. The obtained values were then interpolated using ordinary kriging in ESRI ArcGIS 10.2.
Results
Purely spatial analysis
Testing.
The spatial distribution of the proportion of tested persons among the different demographic strata displayed strong local variations and local clustering (Fig 1). The proportion of tested persons differed widely between the examined age groups and is highest in children (Table 1).
Spatial distribution of a) pertussis testing, b) incidence and c) test-positivity, 2007–2013.
SD = standard deviation.
All demographic groups displayed strong local clustering. Despite the differences in the proportion of tested persons, local clustering displayed similar patterns among the different demographic strata. Local clusters were observed especially in the central and northern parts of the study area. In the southern part in contradiction, no clusters could be observed.
Incidence.
The incidence of pertussis varied between the different demographic groups and was also highest in children (Table 1). Overall, the clusters of the pertussis incidence followed closely the locations of the observed clusters for testing (Fig 1), reflecting a strong spatial correlation to the patterns of testing. The clusters of pertussis incidence among children partially overlapped with clusters among adults and the clusters among adults overlapped in certain areas with those for seniors.
Test-positivity.
Test-positivity was again highest in children, but the positivity rate did not differ much between adults and seniors (Table 1). Test-positivity in children was the only rate that did not display any local clusters (Fig 1). Among adults, seniors and the total tested persons, only a small number of clusters were observed. Except for one cluster in the southwestern part of the study area for the total tested persons, the clusters observed for test-positivity overlapped with the clusters for testing and incidence.
Space-time analysis
Testing.
In all demographic groups, space-time clustering started generally in the beginning of 2012 and lasted partially until the beginning of 2013 (Fig 2). Only in children, one cluster in 2007 and one cluster starting in 2011 could be observed. Space-time clustering for testing thus started relatively uniform across the study area in the beginning of 2012.
Space-time clusters of a) testing, b) incidence and c) test-positivity, 2007–2013.
Incidence.
In adults, seniors and among the total population, the space-time distribution of clusters for the pertussis incidence followed closely the space-time distribution of clusters for testing (Fig 2). The majority of clusters were observed in the beginning of 2012, lasting partially until the beginning of 2013 and were located in the same locations as space-time clusters for testing. In children however, space-time clusters were also observed in 2007 and 2009, for which no space-time clusters for testing were observed.
Test-positivity.
The distribution of space-time clusters for positivity differed strongly from the observed clusters from testing and pertussis incidence (Fig 2). In children, a cluster observed in 2009 in the centre of the study area overlapped with a cluster for pertussis incidence. In seniors, a cluster observed in 2012 in the northwestern part overlapped with the clusters for testing and pertussis incidence. The other clusters were scattered over the entire study area and study period.
Geographically weighted poisson regression
Determinants of testing.
For pertussis testing, the Gaussian kernel type using a fixed, AICc optimized bandwidth fulfilled the requirements of the residuals not displaying spatial autocorrelation among all evaluated demographic groups (Table 2). The local models generally outperformed the global models, reflecting important local differences in the associations between testing and the examined explanatory variables.
Significance levels: * = 0.05; ** = 0.01; *** = 0.001. Only significant predictors are reported.
Testing in children: For testing in children, testing in adults was the strongest predictor, followed by a moderate association to testing in seniors. The negative association to unmarried persons reflects that parents, which have ever been married, are a determinant for testing in children. The negative association to mean property value indicates that children in deprived neighbourhoods are more likely to get tested for pertussis.
Testing in adults: Testing in children and seniors had the strongest impact on testing in adults. The positive association to household size indicates that adults in multi-person households are more likely to get tested. Similar to testing in children, mean property value was negatively associated. Additionally, testing in adults was associated with proximity to primary schools and GPs, but was also associated with increasing distance to pharmacies.
Testing in seniors: Testing in adults had the strongest impact on testing in seniors. The strength of the association to testing in children was relatively weak. Additionally, testing in seniors was negatively associated with proportion of households with high income.
Testing in the total population: The strongest predictor for testing among the total population was the positive association to household size, followed by the negative associations to mean property value, proximity to GPs and primary schools. The proportion of children and distance to pharmacies were overall positively associated. However, none of the predictors was significant in the entire study area. The results of the GWPR model additionally point out important local variations of the association between testing among the total population and the examined explanatory variables (Fig 3).
Determinants of pertussis incidence.
For modelling the pertussis incidence, the Gaussian kernel type using a fixed, AIC optimized bandwidth fulfilled the requirements of the residuals not displaying spatial autocorrelation among all evaluated demographic groups (Table 3). The local models outperformed the global models, although the difference was not as pronounced as the difference between global and local models in testing.
Significance levels: * = 0.05; ** = 0.01; *** = 0.001. Only significant predictors are reported.
Incidence in children: In children, testing was the only significant predictor for the pertussis incidence.
Incidence in adults: In adults, testing was by far the strongest predictor. The strength of the association to the incidence in children and seniors was comparably small. One-person households were–similar to testing in adults–negatively associated. A significant association to proximity to hospitals could also be observed.
Incidence in seniors: Testing was also the strongest predictor in seniors, followed by the incidence in adults.
Incidence in the total population: Among the incidence for the total population, testing had again the strongest impact on the pertussis incidence. The strength of the negative association to households with low income and proximity to hospitals was comparatively weak. The visualized results of the GWPR model point out that testing was significant in the total study area, despite strong local differences in the strength of this association. The negative association to households with low income and proximity to hospitals was only significant in specific areas (Fig 4).
Discussion
The main findings of this study are: (i) The determinants of pertussis testing reflect to a certain extent the healthcare seeking behaviour of the general population for common respiratory infections; (ii) the current pertussis incidence is mainly determined by testing and (iii) outbreak detection for pertussis is feasible using surveillance data but needs to adjust for the strong impact of testing.
Determinants of pertussis testing
Pertussis testing follows to an extent the healthcare seeking behaviour of the general population for common respiratory infections. This can be seen by the associations of proximity to GPs and distance to pharmacies as both compliment each other. Especially in areas where distance to GPs was negatively associated, distance to pharmacies was positively associated. Self-medication for common respiratory infections resulting in coughing is typical in countries where over the counter medication is available [69]. Our results thus could indicate that in areas, where a pharmacy is easily accessible, self-medication for coughing is the first option to choose, whereas in areas where a physician is close, patients with symptoms related to coughing are more likely to consult a GP [70]. As a result, testing for pertussis is to an extent related to treatment-seeking behaviour for common respiratory infections. The association to proximity to primary schools in certain areas indicates potentially an increased awareness of pertussis vulnerability among parents and GPs for children enrolled in primary schools [71]. An overall positive association of pertussis testing among the general population to the proportion of children within the study area was expected as the incidence of pertussis in children is generally higher than in other age groups [72]. The negative association to unmarried persons and mean property value both display a comparable spatial pattern. This could indicate that in families, where the parents have ever been married and are located in a more deprived area are tested more frequently for pertussis, at least in the areas where both associations were significant. Previous studies noted a lower participation rate in childhood immunization schemes among persons with a lower socio-economic status [73]. These associations could therefore be seen as an indicator for an increased awareness of a higher vulnerability to pertussis among this population group, although it has to be noted that the vaccination coverage in the Netherlands is generally very high with approximately 95% [74]. Additionally, higher healthcare use is typical for persons living in deprived areas [75].
When analysing the determinants of pertussis testing in specific age groups, we found that testing in the adjacent age group had the strongest impact on testing in the examined age group. This strong association between the examined age groups corresponds well to previous studies suggesting that intra-household transmission is the most likely route of infection [11,76] and thus logically leads to testing among the same households.
Determinants of pertussis incidence
The spatial and space-time distribution of clusters for pertussis incidence followed closely the spatial and space-time distribution of pertussis testing, reflecting a strong spatial and space-time correlation between testing and incidence.
We found evidence that space-time clustering of testing for pertussis and the pertussis incidence itself increased across the total study area in the first quarter of 2012, irrespective of the examined demographic group. An increase of diagnosed pertussis cases between 2011 and 2012 has also been noted by the US [77], Great Britain [78] and Spain [79]. When we searched for newspaper articles related to pertussis in the Netherlands within the NexisLexis database (www.nexislexis.com), we found that the number of newspaper articles related to pertussis increased sharply in 2012 as compared to the previous years.
Other studies also suggest a “positive feedback loop” where an increase of diagnosed pertussis cases subsequently causes an increase in testing, which in turn results in an increase of diagnosed pertussis cases again [80,81]. In our study area, the strong increase of testing and pertussis incidence in 2012 could be the result of a combination of several factors; an increased awareness of GPs due to the noted increase in other countries [77–79], stronger media attention and the noted “positive feedback loop” [80,81]. The effect of the “positive feedback loop” is indicated by the fact that space-time clusters for testing and incidence occurred mostly in the same areas and time periods across all evaluated age groups. These findings highlight the importance of monitoring changes in pertussis testing in addition to monitoring the pertussis incidence.
The GWPR analyses confirmed what became already apparent during the spatial and space-time analyses. Regardless of age group, testing was the most important predictor of the pertussis incidence. The second most important predictor for the pertussis incidence in a specific age group was the incidence of pertussis in the adjacent age groups. As our analysis is based on aggregated data, we see these associations as an indicator for intra-household transmission [11,76].
In children, testing was the only predictor for pertussis. No other variables were found to be significant in a regression analysis. Thus, the current incidence among the most vulnerable group does not exhibit any socio-economic associations and can be explained by testing only. In adults, we found an additional association to proximity to hospitals. Increased exposure to pertussis and outbreaks among persons employed in hospitals has been previously noted in several countries such as the US [82] and France [83]. The results of our analysis for adults thus indicate a possible exposure to pertussis in our study area. The positive association to household-size indicates, that for adults living in multi-person households, intra-household transmission might be an important risk factor as well, despite the findings of previous studies that intra-household transmission occurs mainly from parents to children [11,76].
The results of the GWPR model for the pertussis incidence among the total population confirm that testing is the most important predictor for pertussis, despite local differences in the strength of this association. The negative association to households with low income in a small part of the study area was the only significant variable related to socio-economic status. An overall assumption that pertussis is related to specific socio-economic characteristics is therefore not possible. Similar to adults, an association to proximity to hospitals was observed in a small part of the study area. However, further research on an individual level would be necessary to confirm whether an increased pertussis exposure in hospitals exists in this area.
Outbreak detection using space-time cluster detection
Our results clearly demonstrate that space-time cluster detection is feasible using surveillance data and the methods described in this study. However, in light of the similar increase in testing and incidence in 2012 and its potential association to an increased awareness of the population and GPs, it is necessary to adjust for the impact of testing. This is reflected by the fact that we mostly detected space-time clusters for pertussis incidence in 2012, where the majority of clusters overlap with those for testing. We found only in children clusters in earlier years in 2007–2009, which did not overlap with clusters for testing. It is clear that the incidence of pertussis has to be strongly correlated to testing, no matter which algorithm is used. Logically, pertussis incidence is not suitable in our study area to detect outbreaks. By using test-positivity as indicator however, we could locate space-time clusters within the whole study area and study period, which were not the results of testing only. Test-positivity as indicator is to a certain extent adjusted for testing in a space-time analysis as a similar increase in positive cases and tested persons would not increase the ratio of positive cases to tested persons in the three-dimensional cylindrical scanning window used by the spatial scan statistic. Our results clearly demonstrate that test-positivity could be a better indicator for locating outbreaks, which are not the results of testing only. This conclusion is supported by previous studies, which evaluated the temporal correlation of pertussis incidence to testing behaviour over time [80,81].
When surveillance data–as in our study—are used to locate outbreaks, a prospective space-time cluster analysis using daily updated surveillance data would allow a detection of recent outbreaks in an automated surveillance system as early as possible. Prospective space-time cluster detection has been widely applied in syndromic surveillance [84,85] and an automated, space-time analysis could be implemented for pertussis as well [86].
Implications for pertussis surveillance
The surveillance data for pertussis in our study were collected by the respective local laboratories and had to merged manually for our study area to allow a retrospective analysis for a whole province. Surveillance of pertussis would thus greatly benefit from an automated near real-time data transfer of each respective laboratory to a centralized institution to allow a detailed, prospective analysis of possible disease outbreaks as early as possible. However, such an approach should focus on a day-wise analysis rather than a month-wise analysis as employed in this study to capture possible outbreaks as precisely as possible [35].
Strengths and limitations of this study
Strengths.
First, a major strength of this study is that the design of this study can be repeated for the whole country to confirm whether testing is also in the whole of the Netherlands the most important predictor of pertussis.
Second, the majority of studies on pertussis focus on a purely temporal analysis [7,28,29,32]. Our approach of analysing the spatial and space-time distribution of pertussis therefore provides a novel level of detail as our approach of detecting clusters in space as well as in space-time could allow a more focused detection of outbreaks, resulting in a more timely and cost-effective response.
Third, we analysed the spatial distribution of pertussis testing and incidence at the smallest possible spatial scale, for which surveillance data and population data can be combined without violating privacy restrictions of surveillance data. The four-digit postal code areas are very suitable for small-scale spatial-epidemiological analyses in the Netherlands [38] and thus allow a very detailed analysis of the determinants of pertussis testing and incidence.
Fourth, the use of GWPR allowed us to examine the spatially varying associations between the evaluated outcomes (testing and incidence) and the examined predictor variables. We could therefore clearly see in which areas several predictors such as distance to GPs, pharmacies and hospitals were significant. Our results can therefore be used to allow more targeted investigations—for example—if working in hospitals in the areas outlined in our study comprises an exposure factor on an individual level as well.
Fifth, our study highlighted that the detection of outbreaks using space-time cluster detection is feasible, when using test-positivity as indicator.
Limitations.
First, we used the international standard IgG cut-off value of 62.5 to consider a diagnosed pertussis infection. As a consequence, the incidence in our study does not necessarily reflect the notification data, which is based on laboratory interpretation.
Second, our analysis was based on aggregated data. The associations detected in our study may not necessarily reflect determinants of pertussis testing and incidence on an individual level. Given the current privacy protection of surveillance data [37], the ecological analysis employed here allowed us to analyse potential determinants that are unavailable on an individual level. Therefore, further research is necessary to confirm whether the associations captured in the ecological analysis really reflect associations on an individual level as well.
Third, we may have missed associations simply because several variables were not available within the data of Statistics Netherlands such as educational level. Lower educational level has been shown to be an important risk factor for poorer health outcomes [87] and could thus also be a possible risk factor for pertussis as well.
Fourth, the GWR4 software currently allows only a purely spatial geographically weighted regression but does not account for space-time differences [63]. Given the strong temporal component of Pertussis testing and infections, a geographically weighted temporal regression might yield more detailed results. However, given the mathematical complexity of such a model [88], this approach could not be implemented in this study.
Fifth, we could not account for the role of vaccinations in our study, as this information is not available in the examined surveillance data. Potentially, data on vaccination among children and booster doses among adults could have a strong impact on the serological test results presented here and could be of additional value for future analyses.
Sixth, we could not verify whether the space-time clusters detected for pertussis incidence or test-positivity capture true outbreaks. However, we think it is reasonable to assume that space-time clusters for the pertussis incidence, which are the results of testing only, are not of interest for the detection of outbreaks. Ultimately, verifying the detected space-time clusters with known outbreaks should be discussed with public health officials residing in the area.
Seventh, we performed a month-wise space-time cluster analysis because a day-wise analysis did consume considerable computation time [35]. Our results are therefore not as temporally precise as it would be technically possible with the surveillance data of our study.
Eight, it would be useful to compare both approaches to detect outbreaks–purely temporal algorithms with the results of the space-time cluster analysis—to evaluate (i) which method allows a more focused outbreak detection and (ii), to evaluate whether the purely temporal algorithms or the space-time cluster detection delivers fewer false alarms. However, such a comparison was beyond the scope of this paper.
Conclusion
We found empirical evidence that testing for pertussis and the current pertussis incidence in our study area increased similar to other countries in 2012. Testing was higher in deprived areas and was also associated with proximity to primary schools and availability of healthcare. Testing for pertussis thus reflects to an extent the overall healthcare seeking behaviour for common respiratory infections. The pertussis incidence in our study area is largely the result of testing and does not display a specific socio-economic association. The main population at risk for pertussis remains therefore still unknown. Given the strong association of detected pertussis cases to testing, it is questionable whether more testing would enhance pertussis control.
The detection of outbreaks using space-time cluster detection is feasible and could help to facilitate an early and appropriate public health response. However, this approach has to be adjusted for the strong dependency to testing and is probably most efficient when using test-positivity as indicator.
Acknowledgments
We wish to thank Peter Jacobs (North Limburg Public Health Service, Venlo), Inge van Loo (Maastricht University Medical Centre, Maastricht), Jos Bus (Zuyderland Medical Centre, Heerlen), Dick van Dam (Zuyderland Medical Centre, Sittard-Geleen), Thera Trienekens (VieCuri Medical Centre, Venlo) and Trix van Dijke (Laurentius Hospital, Roermond and St. Jans Gasthuis, Weert) for involvement in data collection. We would like to thank Inge van Loo (Maastricht University Medical Centre, Maastricht), Alexandra Ziemann (Maastricht University), Jochen Cals (Maastricht University) and Henriëtte ter Waarbeek (South Limburg Public Health Service, Geleen) for their contribution to the study proposal.
Author Contributions
- Conceptualization: BK NDM JH CH TK.
- Data curation: JH.
- Formal analysis: BK.
- Methodology: BK.
- Supervision: NDM TK JS CH.
- Validation: NDM JH CH.
- Visualization: BK.
- Writing – original draft: BK JH NDM.
- Writing – review & editing: BK JH NDM TK JS CH.
References
- 1. Parkhill J, Sebaihia M, Preston A, Murphy LD, Thomson N, et al. (2003) Comparative analysis of the genome sequences of Bordetella pertussis, Bordetella parapertussis and Bordetella bronchiseptica. Nature genetics 35: 32–40. pmid:12910271
- 2. Sizaire V, Garrido-Estepa M, Masa-Calles J, Martinez de Aragon MV (2014) Increase of pertussis incidence in 2010 to 2012 after 12 years of low circulation in Spain. Euro Surveill 19.
- 3. Jenkinson D (2012) Increase in pertussis may be due to increased recognition and diagnosis. BMJ 345: e5463. pmid:22915721
- 4. Vitek CR, Pascual FB, Baughman AL, Murphy TV (2003) Increase in deaths from pertussis among young infants in the United States in the 1990s. Pediatr Infect Dis J 22: 628–634. pmid:12867839
- 5. Barlow RS, Reynolds LE, Cieslak PR, Sullivan AD (2014) Vaccinated children and adolescents with pertussis infections experience reduced illness severity and duration, Oregon, 2010–2012. Clinical Infectious Diseases 58: 1523–1529. pmid:24633685
- 6. Rozenbaum MH, De Cao E, Postma MJ (2012) Cost-effectiveness of pertussis booster vaccination in the Netherlands. Vaccine 30: 7327–7331. pmid:22749838
- 7. van der Maas NA, Mooi FR, de Greeff SC, Berbers GA, Spaendonck MA, et al. (2013) Pertussis in the Netherlands, is the current vaccination strategy sufficient to reduce disease burden in young infants? Vaccine 31: 4541–4547. pmid:23933365
- 8. Zouari A, Smaoui H, Kechrid A (2012) The diagnosis of pertussis: which method to choose? Critical reviews in microbiology 38: 111–121. pmid:22103249
- 9. Nuolivirta K, Koponen P, He Q, Halkosalo A, Korppi M, et al. (2010) Bordetella pertussis infection is common in nonvaccinated infants admitted for bronchiolitis. The Pediatric infectious disease journal 29: 1013–1015. pmid:21046700
- 10. Tozzi AE, Celentano LP, degli Atti MLC, Salmaso S (2005) Diagnosis and management of pertussis. Canadian Medical Association Journal 172: 509–515. pmid:15710944
- 11. Te Beest DE, Henderson D, van der Maas NA, de Greeff SC, Wallinga J, et al. (2014) Estimation of the serial interval of pertussis in Dutch households. Epidemics 7: 1–6. pmid:24928663
- 12. Rozenbaum MH, De Vries R, Le HH, Postma MJ (2012) Modelling the impact of extended vaccination strategies on the epidemiology of pertussis. Epidemiol Infect 140: 1503–1514. pmid:22115361
- 13. Wendelboe AM, Njamkepo E, Bourillon A, Floret DD, Gaudelus J, et al. (2007) Transmission of Bordetella pertussis to young infants. The Pediatric infectious disease journal 26: 293–299. pmid:17414390
- 14. de Greeff SC, Mooi FR, Westerhof A, Verbakel J, Peeters MF, et al. (2010) Pertussis disease burden in the household: how to protect young infants. Clinical Infectious Diseases 50: 1339–1345. pmid:20370464
- 15. Coudeville L, Van Rie A, Andre P (2008) Adult pertussis vaccination strategies and their impact on pertussis in the United States: evaluation of routine and targeted (cocoon) strategies. Epidemiology and infection 136: 604–620. pmid:17612417
- 16.
Gezondheidsraad (2015) Vaccinatie tegen kinkhoest: doel en strategie. The Hague.
- 17. de Greeff SC, de Melker HE, van Gageldonk PG, Schellekens JF, van der Klis FR, et al. (2010) Seroprevalence of pertussis in The Netherlands: evidence for increased circulation of Bordetella pertussis. PLoS One 5: e14183. pmid:21152071
- 18.
He Q, Mertsola J (2008) Factors contributing to pertussis resurgence.
- 19. Mooi FR (2010) Bordetella pertussis and vaccination: the persistence of a genetically monomorphic pathogen. Infection, Genetics and Evolution 10: 36–49. pmid:19879977
- 20. Cherry JD (2003) The science and fiction of the “resurgence” of pertussis. Pediatrics 112: 405–406. pmid:12897292
- 21. Greenberg DP (2005) Pertussis in adolescents: increasing incidence brings attention to the need for booster immunization of adolescents. The Pediatric infectious disease journal 24: 721–728. pmid:16094229
- 22. Cherry JD (2012) Epidemic pertussis in 2012—the resurgence of a vaccine-preventable disease. New England Journal of Medicine 367: 785–787. pmid:22894554
- 23. Galanis E, King AS, Varughese P, Halperin SA (2006) Changing epidemiology and emerging risk groups for pertussis. Canadian Medical Association Journal 174: 451–452. pmid:16477052
- 24. Verheij TJM, Hopstaken RM, Prins JM, Salomé PL, Bindels PJ, et al. (2011) Acuut hoesten Samenvattingskaart M78. Huisarts Wet 2011: 2.
- 25. Heil J, ter Waarbeek HLG, Hoebe CJPA, Jacobs PHA, van Dam DW, Trienekens TAM, Cals JWL, van Loo IHM, Dukers-Muijrers NHTM. Pertussis surveillance and control in the Netherlands, 2010–2013: exploring variations and delays in healthcare provider testing, laboratory diagnostics and public health service notifications. Eurosurveillance. In press (2017)
- 26. de Melker HE, Schellekens J, Neppelenbroek S, Mooi F, Rümke H, et al. (2000) Reemergence of pertussis in the highly vaccinated population of the Netherlands: observations on surveillance data. Emerging infectious diseases 6: 348. pmid:10905967
- 27. Guimaraes LM, Carneiro EL, Carvalho-Costa FA (2015) Increasing incidence of pertussis in Brazil: a retrospective study using surveillance data. BMC Infect Dis 15: 442. pmid:26498058
- 28. Choe YJ, Park YJ, Jung C, Bae GR, Lee DH (2012) National pertussis surveillance in South Korea 1955–2011: epidemiological and clinical trends. Int J Infect Dis 16: e850–854. pmid:22921258
- 29. Wymann MN, Richard JL, Vidondo B, Heininger U (2011) Prospective pertussis surveillance in Switzerland, 1991–2006. Vaccine 29: 2058–2065. pmid:21251904
- 30. Omer SB, Enger KS, Moulton LH, Halsey NA, Stokley S, et al. (2008) Geographic clustering of nonmedical exemptions to school immunization requirements and associations with geographic clustering of pertussis. Am J Epidemiol 168: 1389–1396. pmid:18922998
- 31. Choisy M, Rohani P (2012) Changing spatial epidemiology of pertussis in continental USA. Proc Biol Sci 279: 4574–4581. pmid:23015623
- 32. Fathima S, Ferrato C, Lee BE, Simmonds K, Yan L, et al. (2014) Bordetella pertussis in sporadic and outbreak settings in Alberta, Canada, July 2004-December 2012. BMC Infect Dis 14: 48. pmid:24476570
- 33. Dhewantara PW, Ruliansyah A, Fuadiyah ME, Astuti EP, Widawati M (2015) Space-time scan statistics of 2007–2013 dengue incidence in Cimahi city, Indonesia. Geospat Health 10: 373. pmid:26618319
- 34. Ndiath M, Faye B, Cisse B, Ndiaye JL, Gomis JF, et al. (2014) Identifying malaria hotspots in Keur Soce health and demographic surveillance site in context of low transmission. Malar J 13: 453. pmid:25418476
- 35. Van Den Wijngaard CC, Van Asten L, Van Pelt W, Doornbos G, Nagelkerke NJ, et al. (2010) Syndromic surveillance for local outbreaks of lower-respiratory infections: would it work? PLoS One 5: e10406. pmid:20454449
- 36. Control CfD Prevention (2007) Outbreaks of respiratory illness mistakenly attributed to pertussis—New Hampshire, Massachusetts, and Tennessee, 2004–2006. MMWR Morbidity and mortality weekly report 56: 837. pmid:17717512
- 37. Regidor E (2004) The use of personal data from medical records and biological materials: ethical perspectives and the basis for legal restrictions in health research. Social science & medicine 59: 1975–1984.
- 38. Dijkstra A, Janssen F, De Bakker M, Bos J, Lub R, et al. (2013) Using spatial analysis to predict health care use at the local level: a case study of type 2 diabetes medication use and its association with demographic change and socioeconomic status. PLoS One 8: e72730. pmid:24023636
- 39. Kauhl B, Heil J, Hoebe CJ, Schweikart J, Krafft T, et al. (2015) The Spatial Distribution of Hepatitis C Virus Infections and Associated Determinants-An Application of a Geographically Weighted Poisson Regression for Evidence-Based Screening Interventions in Hotspots. PLoS One 10: e0135656. pmid:26352611
- 40. Kauhl B, Pilot E, Rao R, Gruebner O, Schweikart J, et al. (2015) Estimating the spatial distribution of acute undifferentiated fever (AUF) and associated risk factors using emergency call data in India. A symptom-based approach for public health surveillance. Health Place 31: 111–119. pmid:25463924
- 41. Shoff C, Yang TC (2012) Spatially varying predictors of teenage birth rates among counties in the United States. Demogr Res 27: 377–418. pmid:23144587
- 42. Robertson C, Pant DK, Joshi DD, Sharma M, Dahal M, et al. (2013) Comparative spatial dynamics of Japanese encephalitis and acute encephalitis syndrome in Nepal. PLoS One 8: e66168. pmid:23894277
- 43. Weisent J, Rohrbach B, Dunn JR, Odoi A (2012) Socioeconomic determinants of geographic disparities in campylobacteriosis risk: a comparison of global and local modeling approaches. Int J Health Geogr 11: 45. pmid:23061540
- 44. Feldacker C, Emch M, Ennett S (2010) The who and where of HIV in rural Malawi: Exploring the effects of person and place on individual HIV status. Health Place 16: 996–1006. pmid:20598623
- 45. Haque U, Scott LM, Hashizume M, Fisher E, Haque R, et al. (2012) Modelling malaria treatment practices in Bangladesh using spatial statistics. Malar J 11: 63. pmid:22390636
- 46.
Netherlands S (2015) http://www.cbs.nl/nl-NL/menu/themas/dossiers/nederland-regionaal/publicaties/geografische-data/archief/2014/2013-wijk-en-buurtkaart-art.htm.
- 47. Giammanco A, Chiarini A, Maple P, Andrews N, Pebody R, et al. (2003) European Sero-Epidemiology Network: standardisation of the assay results for pertussis. Vaccine 22: 112–120. pmid:14604578
- 48. De Melker H, Versteegh F, Conyn-van Spaendonck M, Elvers L, Berbers G, et al. (2000) Specificity and sensitivity of high levels of immunoglobulin G antibodies against pertussis toxin in a single serum sample for diagnosis of infection with Bordetella pertussis. Journal of clinical microbiology 38: 800–806. pmid:10655388
- 49.
Statistiek CBvd (2010) Toelichting Wijk- en Buurtkaart 2010. Update 2. Den Haag/Heerlen,: Centraal Bureau voor de Statistiek.
- 50. Lawson AB, Biggeri AB, Boehning D, Lesaffre E, Viel JF, et al. (2000) Disease mapping models: an empirical evaluation. Disease Mapping Collaborative Group. Stat Med 19: 2217–2241. pmid:10960849
- 51.
Waller LA, Gotway CA (2004) Applied spatial statistics for public health data: John Wiley & Sons.
- 52.
Anselin L (2005) Exploring Spatial Data with GeoDaTM: A Workbook. Urbana, Illinois, USA: Spatial Analysis Laboratory, Department of Geography, University of Illinois at Urbana-Champaign.
- 53. Kulldorff M, Feuer EJ, Miller BA, Freedman LS (1997) Breast cancer clusters in the northeast United States: a geographic analysis. Am J Epidemiol 146: 161–170. pmid:9230778
- 54. Tanser F, Barnighausen T, Cooke GS, Newell ML (2009) Localized spatial clustering of HIV infections in a widely disseminated rural South African epidemic. Int J Epidemiol 38: 1008–1016. pmid:19261659
- 55. Wang T, Xue F, Chen Y, Ma Y, Liu Y (2012) The spatial epidemiology of tuberculosis in Linyi City, China, 2005–2010. BMC Public Health 12: 885. pmid:23083352
- 56.
Kulldorff M (2011) SaTScan user guide for version 9.0.
- 57. Coleman M, Coleman M, Mabuza AM, Kok G, Coetzee M, et al. (2009) Using the SaTScan method to detect local malaria clusters for guiding malaria control programmes. Malar J 8: 10.1186.
- 58.
Kulldorff M (2013) SaTScanTM User Guide for version 9.2.
- 59. Chen J, Roth RE, Naito AT, Lengerich EJ, Maceachren AM (2008) Geovisual analytics to enhance spatial scan statistic interpretation: an analysis of U.S. cervical cancer mortality. Int J Health Geogr 7: 57. pmid:18992163
- 60. Kulldorff M, Heffernan R, Hartman J, Assunçao R, Mostashari F (2005) A space-time permutation scan statistic for disease outbreak detection. PLoS medicine 2: 216.
- 61.
Kulldorff M (2010) SaTScan-Software for the spatial, temporal, and space-time scan statistics. Boston: Harvard Medical School and Harvard Pilgrim Health Care.
- 62.
ESRI Interpreting Exploratory Regression results. ESRI.
- 63.
Fotheringham AS, Brunsdon C, Charlton M (2003) Geographically weighted regression: the analysis of spatially varying relationships: John Wiley & Sons.
- 64. Hu M, Li Z, Wang J, Jia L, Liao Y, et al. (2012) Determinants of the incidence of hand, foot and mouth disease in China using geographically weighted regression models. PLoS One 7: e38978. pmid:22723913
- 65. Nakaya T, Fotheringham AS, Brunsdon C, Charlton M (2005) Geographically weighted Poisson regression for disease association mapping. Stat Med 24: 2695–2717. pmid:16118814
- 66. Lovett AA, Bentham C, Flowerdew R (1986) Analysing geographic variations in mortality using poisson regression: the example of ischaemic heart disease in England and Wales 1969–1973. Social Science & Medicine 23: 935–943.
- 67. Lovett A, Flowerdew R (1989) Analysis of count data using poisson regression*. The Professional Geographer 41: 190–198.
- 68.
Nakaya T (2012) GWR4 user manual. WWW document, http://www.st-andrews.ac.uk/geoinformatics/wp-content/uploads/GWR4manual_201311.pdf.
- 69. Smith SM, Schroeder K, Fahey T (2008) Over-the-counter (OTC) medications for acute cough in children and adults in ambulatory settings. Cochrane Database Syst Rev 1.
- 70. Campbell SM, Roland MO (1996) Why do people consult the doctor? Family practice 13: 75–83. pmid:8671107
- 71. Centers for Disease C, Prevention (2004) School-associated pertussis outbreak—Yavapai County, Arizona, September 2002-February 2003. MMWR Morb Mortal Wkly Rep 53: 216–219. pmid:15029116
- 72. Chuk LM, Lambert SB, May ML, Beard FH, Sloots TP, et al. (2008) Pertussis in infants: how to protect the vulnerable? Commun Dis Intell Q Rep 32: 449–456. pmid:19374274
- 73. van Lier A, van de Kassteele J, de Hoogh P, Drijfhout I, de Melker H (2013) Vaccine uptake determinants in The Netherlands. The European Journal of Public Health: ckt042.
- 74. Van Lier E, Oomen P, Oostenbrug M, Zwakhals S, Drijfhout I, et al. (2009) [High vaccination coverage of the National Immunization Programme in the Netherlands]. Nederlands tijdschrift voor geneeskunde 153: 950–957. pmid:19490720
- 75. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, et al. (2012) Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. The Lancet 380: 37–43.
- 76. Terry JB, Flatley CJ, van den Berg DJ, Morgan GG, Trent M, et al. (2015) A field study of household attack rates and the effectiveness of macrolide antibiotics in reducing household transmission of pertussis. Commun Dis Intell Q Rep 39: E27–33. pmid:26063095
- 77. From C (2012) Pertussis epidemic—Washington, 2012. Morbidity and Mortality Weekly Report (MMWR) 61: 517–522.
- 78.
Service NH (2012) Sharp rise in whooping cough cases. NHS.
- 79. Sizaire V, Garrido-Estepa M, Masa-Calles J, Martinez de Aragon M (2014) Increase of pertussis incidence in 2010 to 2012 after 12 years of low circulation in Spain. Euro Surveill 19.
- 80. Fisman DN, Tang P, Hauck T, Richardson S, Drews SJ, et al. (2011) Pertussis resurgence in Toronto, Canada: a population-based study including test-incidence feedback modeling. BMC public health 11: 1.
- 81. Kaczmarek MC, Valenti L, Kelly HA, Ware RS, Britt HC, et al. (2013) Sevenfold rise in likelihood of pertussis test requests in a stable set of Australian general practice encounters, 2000–2011. Med J Aust 198: 624–628. pmid:23919712
- 82. Calugar A, Ortega-Sánchez IR, Tiwari T, Oakes L, Jahre JA, et al. (2006) Nosocomial pertussis: costs of an outbreak and benefits of vaccinating health care workers. Clinical infectious diseases 42: 981–988. pmid:16511764
- 83. Ward A, Caro J, Bassinet L, Housset B, O'Brien JA, et al. (2005) Health and economic consequences of an outbreak of pertussis among healthcare workers in a hospital in France. Infection Control 26: 288–292.
- 84. Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, et al. (2004) Syndromic surveillance in public health practice, New York City. Emerg Infect Dis 10: 858–864. pmid:15200820
- 85. Ziemann A, Riesgo LG-C, Boris K, Schrell S, Rosenkötter N, et al. (2012) Added value of routine emergency medical data for detecting clusters of acute gastrointestinal illness in Europe. Resuscitation 83: e30.
- 86. Robertson C, Nelson TA (2010) Review of software for space-time disease surveillance. International Journal of Health Geographics 9: 1.
- 87.
Cutler DM, Lleras-Muney A (2006) Education and health: evaluating theories and evidence. National Bureau of Economic Research.
- 88. Huang B, Wu B, Barry M (2010) Geographically and temporally weighted regression for modeling spatio-temporal variation in house prices. International Journal of Geographical Information Science 24: 383–401.