In Poland, primary care physicians are the most used and most trusted source of information on immunisation. We aimed to explore factors influencing support for vaccinations among physicians employed in the childhood immunisation programme, in order to inform education of healthcare workers and programme organization. In June-July 2017, we carried out a national cross-sectional survey of physicians working in randomly selected primary healthcare practices, and interviewed them by telephone. We assessed support for vaccinations using an ordinal scale (0–6) comprised of three equally weighted questions on the respondent support of the programme and vaccination of self and family. We also created a scale (0–3) based on correct answers to vaccination myths. We used ordered logistic regression to investigate factors independently influencing support for vaccinations, reporting the proportional odds ratios and 95% confidence intervals for one unit increase in the support score. Of 2,609 respondents contacted, we interviewed 500 (19%). The median vaccination support score (0–6) was 5 (IQR 2). After adjusting for other variables, we did not find significant effects of sex, medical specialty, adhering to recommendations, attending a conference in previous year, using non-scientific sources of information and self-assessed knowledge on vaccination support score. Age over 60 years, correctly addressing vaccination myths and use of one or more than one scientific sources of knowledge, significantly improved support for vaccinations (aOR = 1.97, 1.57, 3.09 and 2.68, respectively). We recommend to increase the amount, quality and accessibility of evidence-based educational materials for primary care physicians working with childhood immunisations.
Citation: Stefanoff P, Sobierajski T, Bulinska-Stangrecka H, Augustynowicz E (2020) Exploring factors improving support for vaccinations among Polish primary care physicians. PLoS ONE 15(5): e0232722. https://doi.org/10.1371/journal.pone.0232722
Editor: Italo Francesco Angelillo, University of Campania, ITALY
Received: January 15, 2020; Accepted: April 20, 2020; Published: May 1, 2020
Copyright: © 2020 Stefanoff et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The full dataset in DTA format, Stata do files are publicly available from Open Science Framework (DOI 10.17605/OSF.IO/KPGU4).
Funding: This research was funded by the grant entitled “Development and better adaptation of health care to demographic and epidemiological trends” within Health Initiatives under the EEA Financial Mechanism and Norwegian Financial Mechanism 2009-2014 (NIPH-NIH no. 001/FWD/13/VI). The funder had no role in the study design, data collection and analysis, decision to publish or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Confidence in vaccination programmes is crucial for maintaining high vaccine uptake [1, 2]. A systematic review of 68 investigations indicated that childhood vaccination coverage was determined by parents’ perception of vaccines as safe, a positive recommendation by the general practitioner, fewer practical barriers to vaccinate and general positive attitude towards vaccination . Vaccine acceptance or refusal are driven to a large degree by vaccine confidence, defined as the trust in the effectiveness and safety of vaccines [1, 2]. Therefore, well informed healthcare professionals can be a reliable and trusted source of information for parents and influence their decision to vaccinate their children [4–9]. In 2015 and 2018, large-scale surveys of vaccine confidence in all 28 EU member states, commissioned by the European Commission, showed that there is a positive correlation between the primary care physicians (PCPs) beliefs about vaccines and vaccine confidence in the general public [2, 10].
In the previous decade, Poland noted a marked increase of public distrust in vaccinations, reflected by an over 13-fold increase in the number of parents refusing any vaccination of their children, from 3,077 in 2009 to 40,342 in 2018 . The previously mentioned large-scale EU investigation of vaccine confidence highlighted that between 2015 and 2018, Poland noted the largest decrease in public confidence in the importance, effectiveness and safety of vaccines. Previous more detailed investigations [12–16] revealed that Polish residents have a positive overall perception of vaccinations, but poor knowledge of vaccines and vaccine-preventable diseases and concerns about vaccine safety. These investigations also highlighted a major role of physicians as the most used and the most trusted source of information on vaccination for parents.
PCPs are pillars of the Polish childhood immunisation programme, which is coordinated at national level. The immunisation schedule includes a list of seven mandatory vaccines, reimbursed by the state, and seven recommended vaccines, that need to be paid by parents. Vaccinations are carried out in 10,365 vaccination clinics, which are PCP practices that have signed a contract with the national insurer to deliver vaccination services. They regularly receive free of charge vaccine doses from regional stockpiles and report vaccines delivery in relation to each eligible child. The recommended vaccines are available at PCP offices, at the pharmacies and in private healthcare. To meet the legal requirements , each vaccination clinic needs to be equipped with anti-shock kit, refrigerator and employ licensed physicians specialised in paediatrics. If there is no paediatrician available, a specialist in family medicine can obtain a license after a vaccinology course or a six-month practice in a vaccination clinic. Only a licensed physician has the right to qualify children for vaccination and prescribe vaccines refunded by the state. The physician is also mandated to inform parents about the possible adverse events following immunisation (AEFI) and inform about recommended vaccines which are not refunded. Following a positive qualification by the physician, a nurse is administering vaccines and completing the documentation. Vaccinations are mandatory by law, which means that parents who refuse are subject to administrative fines. Medical universities in Poland do not offer separate vaccinology modules for students. Medicine and nursing students have vaccinology contents added to relevant courses (ex. Immunology, infectious diseases or paediatrics).
In this investigation, we aimed to assess factors influencing the support for vaccinations among PCPs involved in the childhood immunisation programme, to inform public health policies related to childhood immunisation schedule, as well as education of healthcare workers.
Material and methods
We collected structured interviews from a representative sample of PCPs working in the childhood immunisation programme across Poland.
Between June and July 2017, we carried out a national cross-sectional survey of physicians involved in the qualification and administration of childhood vaccines within the childhood immunisation programme. Because we did not have access to a line list of vaccination clinics, we created a sampling frame of 36,556 PCP practices having at least one specialist in paediatrics and/or family medicine, received from the Chamber of Physicians and Dentists. Subsequently we selected a stratified random sample of practices from this list, with the number of units in each province proportional to the population size of the province. As the next step, we attempted contacting each selected practice to confirm inclusion criteria: (a) Approval of the unit manager for its inclusion; (b) Availability of at least one physician involved in childhood vaccination programme. We included practices until reaching the quota for each province. If necessary, we drew additional samples from the respective provinces sampling frames. We collected a structured telephone interview with one consenting physician in each unit, who was available at the time of the call. The telephone interviews were conducted by a subcontracted marketing research company DSC Research Group.
We calculated the sample size assuming the margin of error to be no more than 5% at the 95% confidence level. We assumed that there were 50,000 physicians specialised in paediatrics or family medicine. Therefore, the minimum required sample was 384 respondents.
Data collection and variable definitions
The interviews were collected using structured, anonymous computer-assisted telephone interviews (CATI). The questionnaire included 35 items in three parts: (a) sociodemographic and professional information (6 items); (b) knowledge on childhood immunisation including self-assessed knowledge level and six questions on common myths about vaccine safety, impact of vaccines on the infant’s immune system and the immune system capacity to handle multiple vaccines (7 items); (c) sources of information on vaccinations (7 items); (d) adherence to recommendations for physicians working in the childhood immunisation programme (3 items); (e) attitudes towards vaccinations including taking a flu shot every year (5 items); (f) barriers encountered in the administration in the childhood vaccination programme (7 items). The original and translated surveys are included in supportive information (S1 and S2 Files).
We pilot tested the telephone survey with 10 randomly called PCP practices and we subsequently adjusted the wording of some questions, and the instructions for the interviewers.
Since we allowed naming up to three sources of information on immunisation, we categorized them into distinct groups, depending if respondents pointed a single source or more than one. We analysed separately all reported combinations and subsequently, re-categorized them into “scientific” and “non-scientific” sources, considering this distinction as potentially important for building up knowledge and attitudes towards immunisation.
We created an ordinal scale reflecting vaccination support, composed of three equally weighted questions (0–2 points each): a. To which extent does the PCP support childhood vaccinations (No/moderately/strongly); b. If having a child in vaccination age, would the PCP vaccine it? (No/selected vaccines/all recommended vaccines); c. Does the PCP take vaccine against seasonal influenza? (Never/not regularly/every season). The exploratory nature of this investigation and the limited number of questions possible to include in a telephone survey, did not permit us to use previously validated diagnostic scales. We therefore assumed that this ordinal scale will not have diagnostic value, but will reflect the degree to which PCP support the childhood immunisation programme.
Additionally, we created an ordinal scale based on the answers to six common myths about vaccinations, the correct answer to each question contributing 1 point. We identified common myths based on our experience working as editors of the Polish national website www.szczepienia.info, and receiving approximately 1,000 questions annually from the general public. After merging the lowest four categories due to low counts, the final scale ranged from 0 to 3. We also created a variable summarizing adherence to recommendations by PCPs: always informing about the recommended vaccines (on top of mandatory, refunded by the state), and always informing about the possible adverse events following immunisations (AEFI). These two actions are required by law from all physicians working in the childhood immunisation programme.
All statistical analyses were conducted using STATA ver. 15.0 software. First, we described the study population. For categorical variables we calculated frequencies and proportions. For ordinal variables we calculated medians and interquartile ranges. For interval/ratio variables, we calculated means and standard deviations. We calculated the correlation between ordinal score variables using Spearman correlation coefficients.
We used the ordered logistic regression to investigate factors independently influencing PCP support for vaccinations. We reported crude and adjusted proportional odds ratios and 95% confidence intervals for one unit increase in the score reflecting vaccination support level, given that the other variables in the model are held constant.
To describe the subgroup of PCP least supporting vaccinations, we used frequencies and proportions. To compare the distribution of categorical variables we used chi-square test and reported Pearson p-values. We assumed a significance level of 5% for reporting results.
Because the survey did not concern patients, was anonymous, and did not contain any sensitive information, the Institutional Review Board of the National Institute of Public Health—National Institute of Hygiene applied an exemption from the full ethical review. The respondents did not receive any incentive to participate. Before the start of the interview, each respondent was informed about the purpose of the study, its confidentiality and was asked for oral consent. If no consent was given, the interview was terminated. The data were collected and analysed anonymously. We assured safe storage of interview recordings for quality assurance purposes.
Of the 2,609 eligible respondents reached, 500 were successfully interviewed, leading to a response rate of 19% (Fig 1). Among the most common reasons for refusal noted by the interviewers were: lack of time, distrust of surveys and polls, sensitive topic and concern about potential consequences of participation.
Of the 500 respondents, 377 (75.4%) were female (Table 1). The mean age was 55 years (median: 56 years). Accordingly, the majority had professional experience exceeding 25 years. The localization of general practices across provinces reflected well the proportional distribution of the Polish population. 403 respondents (81%) were paediatricians, and the remaining 97 (19%) were family doctors.
The most commonly used sources of information on vaccinations were scientific literature and manuals (72%), scientific training courses (53%), internet resources (websites and social media, 23%) and official documents from Public Health institutions (13%). 355 respondents (71%) reported more than one information source. Among the combinations of sources, the most common were the use of both scientific sources (training courses with literature, 51%), literature with internet resources (16%) and training courses with internet resources (8%) (Table 1). 145 (29%) physicians reported a single information source, of which 50% used scientific literature, 22% training courses, 14% official documents, and 10% internet resources.
Four-hundred and sixty-one (92.2%) physicians followed recommendations of the childhood immunisation programme by offering recommended vaccinations and informing about AEFIs. The average self-assessed knowledge (range 0–5) was 4.31 (SD 0.61). The score based on addressing anti-vaccination myths (range 0–3) was 2.34 (SD 0.82). There was no correlation between the self-assessed knowledge and addressing anti-vaccination myths (rs = -0.0006, p = 0.9891).
Physicians support for vaccinations
Fig 2 summarizes answers to the three questions concerning physician’s attitudes used to calculate the scale reflecting PCP support for vaccinations. Eighty-six percent of respondents described themselves as strong supporters of immunisations. Forty-six percent of respondents declared that if confronted with the decision to vaccinate of their own children, they would decide to give them all mandatory (reimbursed by the state) and recommended (paid) vaccinations. Sixty-two percent of respondents took each year the recommended vaccine against seasonal influenza. The median vaccination support score (0–6) among study participants was 5 (IQR 2).
Association of explanatory variables on PCP support for vaccinations
There was no significant effect of sex on vaccination support (Table 2). The effect of paediatric specialisation, self-perceived knowledge, attending a conference or workshop on vaccinations in preceding year and adherence to recommendations, seen in the univariable analysis, was no longer significant, when taking into account other variables in the multivariable analysis. We found a strong effect of increasing age on support for vaccinations. The association was not significant in the univariable analysis, but found to be significant after adjusting to other variables in the multivariable analysis. Working in two provinces, one located in the north-west (Zachodniopomorskie) and one in the south-east of Poland (Malopolskie) had negative effect on vaccination support, but only the former remained significant in the final model. The remaining variables—addressing vaccination myths, and use of different sources of information, were significantly associated with support for vaccinations. Regarding the sources of information, using scientific sources had a strong and significant effect both among respondents using two sources and a single source of information (Table 2).
Characterisation of PCPs who are least supportive for vaccinations
Among 42 physicians whose support for vaccination was lowest (score < = 2), only eight considered themselves strong vaccination supporters, none would vaccinate their children with all recommended vaccines on top of the mandatory ones, and none took the flu shot every year. Compared with remaining respondents, the least supportive PCPs had lower median age (51 vs. 56 years), were more frequently men (29% vs. 24%), and attended a workshop or conference on vaccinations less commonly in the previous year (50% vs. 64%, p = 0.064). Compared with remaining respondents, the least supportive PCPs were using more frequently information from scientific literature (76% vs. 71%, p = 0.491), but less frequently from training courses (31% vs. 55%, p = 0.003).
Compared with remaining respondents, the least supportive PCPs did more frequently agree with vaccination myths, especially those related with vaccine safety. Eight of them agreed that vaccines can cause autism (19% vs. 6%, p = 0.003). Fifteen of the least supportive respondents agreed that MMR vaccine contains thimerosal (36% vs. 11%, p<0.001). Twelve of the least supportive respondents agreed that many antigens in combined vaccines are weakening the child’s immune system (29% vs. 4%, p<0.001). Five of the least supportive respondents agreed that AEFIs are more dangerous than the disease against which vaccines protect (12% vs. 4%, p = 0.032). Addressing of the remaining myths was not significantly different between the two groups.
Compared with remaining respondents, the least supportive PCPs agreed more frequently that the barrier for informing parents about vaccinations was lack of arguments to address parents’ concerns (19% vs. 12%, p = 0.172). The least supportive PCPs identified less frequently as a barrier their own communication skills (2% vs. 9%, p = 0.125). None of the differences in the barriers for informing parents about vaccinations were statistically significant.
We investigated the sources of information and support for vaccinations among PCPs in the period of increasing vaccine skepticism in Poland. Support for vaccinations was associated with increasing age, exclusive use of scientific sources of information, and addressing vaccination myths. We also observed regional variations in PCP vaccination support. Even if we did not aim to study vaccine hesitancy among PCP, we identified a near 10% subgroup of vaccinating physicians who seemed to have doubts about the safety of vaccines. Because it was an exploratory, hypothesis-generating investigation, below we tried to identify areas for future research of vaccine confidence in Poland.
We found significant associations between increasing age and region of practice on PCP support for vaccinations. The effect of age may reflect the lower practical experience of younger physicians who see less infectious disease cases, compared to older colleagues. Surveys in UK and Italy had found that younger, more recently qualified physicians feel less confident and knowledgeable about vaccines and have more problems in addressing parents’ questions and concerns, compared to older colleagues [18, 19]. Furthermore, a survey among PCPs in France showed that they recommended vaccines more frequently when they felt comfortable explaining vaccines benefits and risks to patients or trusted official sources of information . The lower support for vaccinations among younger PCPs can also indicate the influence of anti-vaccination messages in social media. We also found regional differences in PCP support for vaccination, which may be related to differences in post-graduate education and communication on vaccination by the regional public health services. To investigate the regional determinants of vaccine confidence, Poland could follow the example of Italy which is systematically investigated determinants of vaccine hesitancy in parallel national representative samples of the general public, parents and healthcare professionals [18, 21–24].
Exclusive use of scientific sources of information and addressing vaccination myths were most strongly associated with vaccination support. These associations could result both from the positive role of knowledge of vaccines and immunisation, and from the possible ambiguous influence of non-scientific sources of information, like opinions of colleagues, opinions of patients, websites and/or social media. The association between knowledge and vaccine confidence among healthcare workers (HCWs) has been documented previously [25–27]. Physicians working in vaccination clinics should in theory have up to date knowledge on particular vaccines and vaccine-preventable diseases. The legal requirements for vaccinators include obtaining a medical specialty in paediatrics or being a family doctor with at least 6-month practical experience in administering vaccines, and taking a vaccinology course . However, once the physician obtains the license to administer childhood vaccines, there is no formal requirement of continuous education. There is only a requirement to accumulate a minimum number of CME points every 5 years to keep the medical specialty. Thus physicians decide individually whether to use evidence-based materials in their practice and participate in certified vaccinology courses. In our investigation, attending a vaccination module in the preceding year was not significantly associated with PCP vaccination support. However, we found out that PCPs least supportive for vaccinations were less frequently attending vaccinology courses, compared to the remaining physicians. Future research in Poland should therefore address improved accessibility of evidence-based information on vaccines and vaccine-preventable diseases, including both the appropriateness of contents and of communication channels for different healthcare groups.
In 2018, an EU-wide study of PCP vaccine confidence involved 100 practitioners in Poland . The authors found a high overall vaccine confidence among Polish PCPs in the importance, safety, effectiveness of vaccines, not corresponding with decreasing vaccination confidence in the general public. However, Polish PCPs demonstrated highest religious compatibility concerns among all studied countries (29% vs. 12% average in 10 studied countries). It could be a reflection of the perceptions in the general public, noted in a parallel study among 1022 randomly selected respondents. In this survey, 41% representatives of the general public expressed concerns that vaccines were not compatible with their religious beliefs, a figure considerably higher than the EU average of 22%. Based on the above considerations, future vaccine confidence research should address specific determinants of vaccine confidence, including moral and religious beliefs.
We found a signal of low vaccine confidence among a fraction of Polish PCPs. Although the proportion of practitioners least supporting vaccinations was not very high, this is worrying since we focused on the “vaccinology elite”, the best trained professionals who are entrusted with the implementation of the childhood immunisation programme. As highlighted in a recent investigation of Karlsson et al., HCWs confidence in the benefits and safety of vaccines is increasing along with the degree of medical training . Thus, our result may signal a more serious problem among HCWs in Poland. We found that the least supportive PCPs expressed highest concerns about the safety of childhood vaccinations. Previous investigations have linked decreased vaccine confidence with concerns about vaccine safety [9, 20, 25, 28, 29]. Furthermore, only 46% PCPs in our sample declared the (potential) willingness to vaccinate their own children using all mandatory and recommended vaccines. This decision may reflect both the high cost and the perception of lesser importance of recommended vaccines. Divergent attitudes of HCWs regarding immunisation of their relatives and their patients, may reflect the need for autonomy in making personal decisions [30, 31]. Although it is possible that the PCPs decision to not vaccinate their own children will not affect their recommendation to vaccinate their patients, it is indirectly reflecting their overall vaccine confidence. Future research is necessary to understand the determinants of low confidence in both vaccinating physicians and all HCWs.
The problem of vaccine hesitancy among HCWs is increasingly recognized globally. Paterson et al. identified 185 studies on vaccine hesitancy among HCWs from 33 countries . This review pointed out that knowledge about particular vaccines helped building HCWs own vaccine confidence and their willingness to recommend vaccinations to others. According to the review, being vaccinated itself or being trained to give advice, contributed to a better vaccine acceptance among HCWs. To address the problem of vaccine hesitancy, several authors have emphasized designing and evaluating communication tools aimed at different professional groups , as well as strengthening trust between healthcare practitioners and the health authorities . All above mentioned authors stress the need to improve HCW education and increase accessibility of reliable evidence-based information on vaccines and vaccine-preventable diseases. Considering the complexity of the vaccine confidence determinants, future vaccine confidence research should not only focus on vaccinating PCPs, but also on other healthcare professionals, including hospital physicians, nurses, pharmacists, but also address media influencers and politicians.
Our investigation had several limitations. First, the low response ratio could affect the external representativeness of our study population. This would happen if the non-respondents would systematically differ from respondents in terms of support for vaccinations. Indeed, the more busy and younger physicians might have not responded to our telephone calls. On the other hand, the demographic structure of our study participants reflect well the population of physicians with specialisation in paediatrics, whose average age in 2017 was 55.8 years (median 56 years) . We tried to address this potential limitation in the design phase by planning telephone calls at different hours of day and their flexible scheduling, and in the analysis phase by adjusting the multivariable analysis for age. Second, there could be potential information bias related to very short interviews (average duration 9.5 minutes), which were dictated by the telephone conversation restrains and very busy respondents. This means that we had to rely on spontaneous answers without room for clarifications or corrections. This could lead to some imprecision and mistakes in the collected interviews, both from the side of the respondent and the interviewer. We addressed the possible information bias by thorough two-stage quality control, first by the supervisor during the interviews, second by validation 10% recorded interviews by the study coordinator. Third, the questions constituting the vaccination support scale are related to each other and with some explanatory variables, which could influence the multivariable associations. For example, vaccination against seasonal influenza is associated with age, since both age over 55 years and being a healthcare worker constitutes an indication for seasonal influenza vaccination. We cannot disentangle to which extent taking the vaccine each year was related to the respondent’s attitude towards vaccinations or to his/her medical indications for vaccination.
Use of valid psychometric scales needs appropriate conditions and a short telephone conversation is not an appropriate setting for long, carefully controlled interviews. Therefore, our investigation had an exploratory, and hypothesis-generating nature. Hopefully, it will trigger new investigations and evidence based interventions to countermeasure the increasing problem of vaccine hesitancy in Poland.
Increasing age, exclusive use of scientific sources and addressing vaccination myths, were most strongly associated with PCP support for vaccinations. Since we investigated only one subgroup of healthcare professionals, presumably most informed on vaccines and immunisations, more in-depth investigations should be continued, addressing different healthcare professionals. Future research should employ carefully designed and validated psychometric tools and address not only knowledge and basic determinants of vaccine confidence, but also study moral and religious determinants of attitudes towards vaccinations among different stakeholders.
Based on our exploratory investigation, we recommend the improvement of the amount and quality of evidence-based educational materials that should be easily available to PCPs. As a long term measure, we recommend the revision of graduate and post-graduate curricula of healthcare workers training to include more vaccinology contents.
We would like to thank Magdalena Rosińska for her useful comments to the data analysis and data interpretation. We would like to thank Didrik Vesterheim, Marianne Bergsaker and Hanne Nøkleby for their comments on the study protocol.
- 1. Anonymous. Report of SAGE Working Group on Vaccine Hesitancy. Geneva: World Health Organization; 2014 1 October 2014.
- 2. Larson H, Figueireda A, Karafillakis E, Rawal M. State of vaccine confidence in the EU in 2018. Luxembourg: European Union; 2018.
- 3. Smith LE, Amlot R, Weinman J, Yiend J, Rubin GJ. A systematic review of factors affecting vaccine uptake in young children. Vaccine. 2017;35(45):6059–69. pmid:28974409
- 4. Smith PJ, Kennedy AM, Wooten K, Gust DA, Pickering LK. Association between health care providers' influence on parents who have concerns about vaccine safety and vaccination coverage. Pediatrics. 2006;118(5):e1287–92. pmid:17079529
- 5. Stefanoff P, Mamelund SE, Robinson M, Netterlid E, Tuells J, Bergsaker MA, et al. Tracking parental attitudes on vaccination across European countries: The Vaccine Safety, Attitudes, Training and Communication Project (VACSATC). Vaccine. 2010;28(35):5731–7. pmid:20558250
- 6. Weigel M, Weitmann K, Rautmann C, Schmidt J, Bruns R, Hoffmann W. Impact of physicians' attitude to vaccination on local vaccination coverage for pertussis and measles in Germany. Eur J Public Health. 2014;24(6):1009–16. pmid:24599940
- 7. Bricout H, Torcel-Pagnon L, Lecomte C, Almas MF, Matthews I, Lu X, et al. Determinants of shingles vaccine acceptance in the United Kingdom. PLoS One. 2019;14(8):e0220230. pmid:31369608
- 8. Daley MF, Liddon N, Crane LA, Beaty BL, Barrow J, Babbel C, et al. A national survey of pediatrician knowledge and attitudes regarding human papillomavirus vaccination. Pediatrics. 2006;118(6):2280–9. pmid:17142510
- 9. Suryadevara M, Handel A, Bonville CA, Cibula DA, Domachowske JB. Pediatric provider vaccine hesitancy: An under-recognized obstacle to immunizing children. Vaccine. 2015;33(48):6629–34. pmid:26529071
- 10. Larson HJ, de Figueiredo A, Xiahong Z, Schulz WS, Verger P, Johnston IG, et al. The State of Vaccine Confidence 2016: Global Insights Through a 67-Country Survey. EBioMedicine. 2016;12:295–301. pmid:27658738
- 11. Anonymous. Annual Report "Vaccinations in Poland". National Institute of Public Health, Chief Sanitary Inspectorate, Warsaw, Poland; 2007–2018.
- 12. Rogalska J, Augustynowicz E, Gzyl A, Stefanoff P. [Parental attitudes towards childhood immunisations in Poland]. Przegl Epidemiol. 2010;64(1):91–7. pmid:20499667
- 13. Mrożek-Budzyn D, Kiełtyka A, Mróz E. Opinions about vaccination among mothers who delivered newborns in two hospitals in Krakow and Myślenice. Przegl Epidemiol. 2016;70(3):471–8. pmid:27888816
- 14. Rogalska J, Augustynowicz E, Gzyl A, Stefanoff P. [Sources of information and knowledge on childhood immunisations among Polish parents]. Przegl Epidemiol. 2010;64(1):83–90. pmid:20499666
- 15. Kuchar E, Ludwikowska K, Szenborn L, Antczak A, Mastalerz-Migas A, Nitsch-Osuch A. Knowledge Regarding Influenza and Influenza Vaccination in General Population: Results of a National Survey in Poland. Adv Exp Med Biol. 2018;1108:55–61. pmid:29995213
- 16. Braczkowska B, Kowalska M, Baranski K, Gajda M, Kurowski T, Zejda JE. Parental Opinions and Attitudes about Children's Vaccination Safety in Silesian Voivodeship, Poland. Int J Environ Res Public Health. 2018;15(4).
- 17. Anonymous. Announcement of the Minister of Health of 25 May 2016 on the publication of a uniform text of the Regulation on mandatory preventive vaccinations. Journal of Laws;; Dz.U. 2016 poz. 849.
- 18. Filia A, Bella A, D'Ancona F, Fabiani M, Giambi C, Rizzo C, et al. Childhood vaccinations: knowledge, attitudes and practices of paediatricians and factors associated with their confidence in addressing parental concerns, Italy, 2016. Euro Surveill. 2019;24(6).
- 19. Hopkins TG, Wood NJ, West RM, Darling JC. UK health professionals' attitudes and knowledge regarding Human Papillomavirus (HPV) vaccination: a West Yorkshire Study. J Paediatr Child Health. 2009;45(11):652–5. pmid:19903250
- 20. Verger P, Fressard L, Collange F, Gautier A, Jestin C, Launay O, et al. Vaccine Hesitancy Among General Practitioners and Its Determinants During Controversies: A National Cross-sectional Survey in France. EBioMedicine. 2015;2(8):891–7. pmid:26425696
- 21. Napolitano F, Navaro M, Vezzosi L, Santagati G, Angelillo IF. Primary care pediatricians' attitudes and practice towards HPV vaccination: A nationwide survey in Italy. PLoS One. 2018;13(3):e0194920. pmid:29596515
- 22. Napolitano F, D'Alessandro A, Angelillo IF. Investigating Italian parents' vaccine hesitancy: A cross-sectional survey. Hum Vaccin Immunother. 2018;14(7):1558–65. pmid:29641945
- 23. Riccò M, Cattani S, Casagranda F, Gualerzi G, Signorelli C. Knowledge, attitudes, beliefs and practices of Occupational Physicians towards seasonal influenza vaccination: a cross-sectional study from North-Eastern Italy. J Prev Med Hyg. 2017;58(2):E141–E54. pmid:28900354
- 24. Bianco A, Mascaro V, Zucco R, Pavia M. Parent perspectives on childhood vaccination: How to deal with vaccine hesitancy and refusal? Vaccine. 2019;37(7):984–90. pmid:30655175
- 25. Paterson P, Meurice F, Stanberry LR, Glismann S, Rosenthal SL, Larson HJ. Vaccine hesitancy and healthcare providers. Vaccine. 2016;34(52):6700–6. pmid:27810314
- 26. Hollmeyer HG, Hayden F, Poland G, Buchholz U. Influenza vaccination of health care workers in hospitals—a review of studies on attitudes and predictors. Vaccine. 2009;27(30):3935–44. pmid:19467744
- 27. Kahn JA, Rosenthal SL, Tissot AM, Bernstein DI, Wetzel C, Zimet GD. Factors influencing pediatricians' intention to recommend human papillomavirus vaccines. Ambul Pediatr. 2007;7(5):367–73. pmid:17870645
- 28. Karlsson LC, Lewandowsky S, Antfolk J, Salo P, Lindfelt M, Oksanen T, et al. The association between vaccination confidence, vaccination behavior, and willingness to recommend vaccines among Finnish healthcare workers. PLoS One. 2019;14(10):e0224330. pmid:31671115
- 29. Karafillakis E, Dinca I, Apfel F, Cecconi S, Wurz A, Takacs J, et al. Vaccine hesitancy among healthcare workers in Europe: A qualitative study. Vaccine. 2016;34(41):5013–20. pmid:27576074
- 30. Killian M, Detoc M, Berthelot P, Charles R, Gagneux-Brunon A, Lucht F, et al. Vaccine hesitancy among general practitioners: evaluation and comparison of their immunisation practice for themselves, their patients and their children. Eur J Clin Microbiol Infect Dis. 2016;35(11):1837–43. pmid:27488435
- 31. Posfay-Barbe KM, Heininger U, Aebi C, Desgrandchamps D, Vaudaux B, Siegrist CA. How do physicians immunize their own children? Differences among pediatricians and nonpediatricians. Pediatrics. 2005;116(5):e623–33. pmid:16263976
- 32. Yaqub O, Castle-Clarke S, Sevdalis N, Chataway J. Attitudes to vaccination: a critical review. Soc Sci Med. 2014;112:1–11. pmid:24788111
- 33. Balinski P, Krajewski R. Physicians and dentists in Poland—demographic characteristic. The Polish Chamber of Physicians and Dentists, Warsaw, Poland; 2018.