Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Time and labour costs of preventive health care, including vaccinations, in Finnish child health clinics

  • Heta Nieminen ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Project administration, Supervision, Visualization, Writing – original draft

    heta.nieminen@thl.fi

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Tampere, Finland

  • Tuovi Hakulinen,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Helsinki, Finland

  • Taneli Puumalainen,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliation Department for Safety, Security and Health, Ministry of Social Affairs and Health, Helsinki, Finland

  • Päivi Sirén,

    Roles Conceptualization, Investigation, Supervision, Writing – review & editing

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Tampere, Finland

  • Arto A. Palmu

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Department of Public Health and Welfare, Finnish Institute for Health and Welfare, Tampere, Finland

Abstract

In Finland all children are entitled to regular health check-up visits at child health clinics (CHC). During the visits public health nurses and physicians follow-up the growth and development of the child, evaluate the welfare of the family, give health counselling and vaccinate the children. The aim of this study was to measure the time used by the nurses and physicians for different tasks during the visits and evaluate the costs of preventive health care procedures. Special emphasis was on time and costs used for administering vaccinations. The study was conducted in four CHCs. Trained observers measured the time used for predefined tasks with a stopwatch application operating on a tablet computer. Labour costs of visits and vaccinations were evaluated by using the gross average salary costs of health care personnel. Time used for vaccine logistics and other administrative tasks was obtained by interviewing the nurses in charge of the vaccine logistics at each CHC. Altogether 325 CHC visits of children <13 months were followed. Public health nurse used for a visit in average 49 (range 12–101) minutes, and the corresponding labour costs were 17 (4–35) Euros. Vaccines were administered at 183 visits. Children got on average 2.4 (1–4) vaccine doses per visit. The observed time used for vaccinations was 10.2 (1.6–25) minutes and the costs 3.58 (0.57–8.62) Euros per visit. The observed time included guidance, preparation, administration, and documentation of vaccinations. Adding one dose into a visit increased the time spent on vaccination on average 2.8 minutes (0.99 Euros). The mean non-observed time used for vaccine logistics outside the visits was 3.4 minutes and cost 1.19 Euros per dose. Administering of the vaccines of the Finnish vaccination programme is relatively simple and inexpensive because Finnish children have regular scheduled visits to CHCs.

Introduction

Child health clinics (CHC) form the backbone of the preventive child health care in Finland. According to law each child should have at least nine regular scheduled health check-up visits during the first year of life and after that at least six health check-up visits between the ages of 1 and 6 (Fig 1) [1]. During the visits physical and psychosocial development and growth of the child are checked. Also the mental health and psychosocial well-being of the family is assessed by questionnaires and interviewing the parent(s). An essential part of the visits is discussion and health counselling of matters concerning health, for example nutrition and sleeping.

thumbnail
Fig 1. Child-health-clinic visits and vaccination schedule of national vaccination program in autumn 2017.

https://doi.org/10.1371/journal.pone.0270835.g001

The health check-up visits to CHC are mainly conducted by public health nurses (PHN); there are three visits for each child during the first 12 months of life also including also a health check-up, discussions and counselling by a physician (usually general practitioner) [1]. The first PHN visit is often a home visit i.e. the nurse visits the home of the two weeks old child. Another special visit in the schema is a group visit (Fig 1). CHC visits include administering the paediatric vaccines of the national vaccination programme. Vaccines are administered by the PHNs and supervised by physicians.

The overall time which the health care nurse and the physician use for a CHC visit has been previously studied using questionnaires [2] but actual field surveys have not been performed in Finland. By studying the time used by health care personnel (HCP) for different tasks the workflow of the visits can be better understood and it enables the estimation of the actual costs of the various components of the visit. The best way to obtain this kind of data is the time and motion (T&M) method. In the T&M method the action in interest, in this case the CHC visit, is first divided into tasks and after that specially trained observers measure the time used for each predefined task with a stopwatch [3]. The method has been developed for understanding and leaning of industrial work, but as the interest towards effectiveness and efficiency of health care processes has increased the method has been imported from industrial premises to hospitals and health clinics [3]. However, the method is also suitable for assessing the time and costs used for predetermined, fixed tasks without aiming to increase the efficiency of the employees. Previously the T&M method has been used in evaluating the time saved by using combination vaccines [4], fully liquid vaccines [5] or barcode scanning technology for documentation [6].

The costs of vaccination (and vaccine) are needed for the assessment of cost-effectiveness of immunizations. Often the costs of vaccination have been assessed by multiplying the total hourly costs of the regular working time of vaccinators (physician or nurse) with an educated guess, based on questionnaires, of the time used for administering a vaccine. In previous reports the costs of vaccination have ranged widely [710]. Previously the accurate time used for administering the vaccines of national vaccination program in a real-world setting has been measured in a T&M study conducted in six General Practitioner practices in the United Kingdom [9].

The aim of this study was to measure the time HCP used for different tasks during the CHC visits with a special emphasis on time used for administering vaccines.

Methods

This T&M study was conducted in four CHCs in Finland during a three-month period (September to November 2017). We selected CHCs with at least 100 births per year. Two CHCs from eastern Finland and two from western Finland. From both sides of Finland we chose one bigger and one smaller town with rural areas. Furthermore, the CHC personnel interest in participation and availability of local study staff was required for the site selection. Data was gathered by two study nurses specially trained for the study conduct. After theoretical instruction they trained in the CHCs and observed a few visits prior to study start. Study focused on measuring the time required to perform pre-specified tasks as defined in Table 1. The pre-specified tasks were first gathered from the CHC statute [1] and then split to smaller tasks based on our experience on CHC work. The list of tasks was evaluated and approved by the CHC nurses before the observations began.

The observed visits were scheduled check-up visits during the first year of life. Details of the visits are presented in Fig 1. We aimed to observe 10 visits per each age group in each CHC to be able to see the possible differences in administering different kind of vaccines. As the visits available for observation was hard to predict it was allowed to observe more than 10 visits per age group per CHC to be able to get altogether around 40 observed visits per age group. All the visits observed after observation training visits were included in the study. In two age groups we were able to observe only round 20 visits: 2–4 weeks olds visits were observed if the visit took place in CHC and the 2 months visit was mainly a group visit in two CHCs and we did not observe those (Fig 1).

The whole process of a CHC visit involves a series of activities prior to the visit day (e.g. managing appointments to the visits, ordering vaccines and brochures, and cold-chain management), which should also be considered for a complete assessment of the resource use and cost implications of current CHC visits and vaccinations. The estimates of time used for these tasks were collected by interviewing selected PHNs who were responsible for the vaccine logistics in the CHC.

The visit could be chosen to be observed if at least one of the parents spoke fluent Finnish. Visits of children with congenital conditions or chronic diseases that required special attention were excluded from study. Observation of several consecutive visits of one child was allowed.

Trained observers recorded the time used for each pre-specified task using a stopwatch application (Ultimate Watch) on a tablet computer. The stopwatch application allowed the observers to measure time for more than one task at a time. Only one discussion and only one action stopwatch (see the table of tasks, Table 1) was allowed to be on simultaneously. The measurements began when the HCP invited the family in; at that moment the stopwatch measuring the total time HCP used for the visit (“nurse total” or “physician total”) and the “invitation to the room” stopwatch were started. The visit ended either when the family left the room or when the HCP finished the documentation tasks of the visit. The monitoring-after-vaccination stopwatch was started when the child got her/his first vaccine dose and was stopped when the family left the room. Thus, at most there could be four stopwatches on at the same time (PHN total, one action, one discussion, and monitoring after vaccination).

Time used for vaccination was separated to observed and non-observed time. The observed time included guidance, preparation and administering of vaccine, waste disposal and documentation. The non-observed time included vaccine logistics, taking care of cold chain, preparation of vaccination room and checking the patient file of the child. The time for preparing and administering of each vaccine dose was observed separately.

Labour costs were calculated by using the gross average labour costs of a public health nurse and physician (general practitioner) which were 20.80 and 49.70 Euros per hour, respectively [11]. Labour costs included social security contributions, holiday and sick leave pays.

Prices of consumables, presented in Table 2, were taken from publicly available sources [12].

The measured times were analysed in three groups: time used by PHN, time used by physician and the time PHN used at vaccination visits for different vaccination tasks. The vaccination visit was defined as a visit, where child got at least one vaccine dose. For each task and task group the used times are presented as means with 95% confidential limits (Cl) and range.

To describe the differences in the mean times used for each task in different CHCs (i.e. sites), we present the site range for task (or group of tasks). For comparison of observed time used for vaccination in different CHCs we present the mean values in each CHC with 95% CI. If the Cls did not overlap, the differences between the sites were considered statistically significant.

The Mann-Whitney U Test for independent -samples was used for analysis of the significance of the difference of the times of preparing and administering vaccines. Statistical analysis was made with IPM SPSS Statistics 27.

The study was approved by the Institutional Review Board of the Finnish Institute for Health and Welfare. For the T&M data collection the HCPs gave a written consent for the observations before the study began in the CHC and the families gave oral consent before the visit they attended. We did not gather personal data of the children or the personnel.

Results

Altogether 325 CHC visits of under 13-month-old children conducted by 23 public health nurses were observed. The time reserved for visits was 20 to 60 minutes. On average, one visit took 49 (range 12–101) minutes of nurse’s time (Table 3). The average labour costs of a visit were 17 Euros. Among those 325 visits there were 122 visits including physician’s visits. We observed visits of 16 different physicians. The time reserved for physician was 20 minutes, but on average 23 (range 13–44) minutes were used. The labour costs of physicians were 19 (range 11–36) Euros per visit. Visits included different tasks which could be divided into five main groups: health check-up, health counselling and discussions, family matters, vaccination and documentation (Table 1). The mean time used for task groups varied slightly between the CHCs observed (Fig 2).

thumbnail
Fig 2. The observed time used for different task during 3, 5 and 12 month visits.

The tasks belonging to each task group are shown in Table 1. Note: recording patient file is included in the documentation task group.

https://doi.org/10.1371/journal.pone.0270835.g002

thumbnail
Table 3. Time used and cost of the visits observed.

Time used for vaccinations during all visits.

https://doi.org/10.1371/journal.pone.0270835.t003

Documentation tasks took a lot of time, about one quarter of the overall visit time (Fig 3). Furthermore, in the interview the PHNs reported that some of the documentation tasks, most often the patient file recording, cannot be done within the time reserved for the visit, but it’s left to be done later on. The second most time-consuming task group was health counselling and discussions about the matters concerning, for example, nutrition and sleeping (Fig 3).

thumbnail
Fig 3. The time public health nurses (PHN) and physicians (GP) used for different task during the child’s visit to child-health-clinic.

The tasks belonging to each task group are shown in Table 1. Note: recording patient file is included in the documentation task group.

https://doi.org/10.1371/journal.pone.0270835.g003

Vaccines were administered at 183 visits. Most of the vaccines were given by the recommended schedule. Only a few vaccines were not given either because the child was ill or the parent(s) declined or postponed the administration of certain vaccines. Some doses were postponed due to the PHN’s recommendation, as some PHNs did not want to give four injections at one visit which would have been needed during influenza vaccination season at the 12-month visit (Fig 1).

Vaccination guidance was given additionally at 94 visits during which vaccinations were not given. Thus, some time was used for vaccination topic at least at 277 visits, which was 85% of all visits. Of the 48 visits during which vaccination topics were not addressed, 41 were physician visits. Actually, vaccine guidance was given by a physician only during 3 of the 122 observed physician visits (Table 3).

During the vaccination visits children got on average 2.4 (range 1–4) vaccine doses. The mean time used for vaccinations was 10.2 (range: 1.6–25, site range 9–12) minutes (Table 4). The time included guidance, preparation and administration of vaccine(s), waste disposal, and entering vaccination(s) to patient file, but not vaccine logistics or administrative tasks. Most vaccine doses in Finland were given at the age of 2, 3, 5 and 12 months, but some vaccines were given during other visits, especially during influenza vaccination season (end of October to January) (Table 3). During the 3, 5 and 12 months visits, which include 3 vaccine doses, the vaccinations took 11 to 13 minutes (Fig 2).

thumbnail
Table 4.

The time and cost used for vaccination (A) and the effect of adding a vaccination dose to visit (B).

https://doi.org/10.1371/journal.pone.0270835.t004

The average labour costs of vaccine administration were 3.58 (range 0.57–8.62) Euros per visit. Adding one vaccination dose for a visit increased the time spent on vaccination on average 2.8 minutes; and costs 0.99 Euros (Table 4).

The mean observed time used for administering one vaccine dose was 4.9 (range 4.2–5.2; site range 4.2–6.0) minutes per dose. Nurses in site Fin-1 used significantly less time for vaccination when compared to nurses in sites Fin-2 and Fin-3 (Fig 4). No obvious reason for this difference could be found, but the difference was seen both in vaccination (which includes preparation and administration of vaccine(s) and waste disposal) and documentation. However, vaccination guidance took as much time and cost in every site (Fig 5). The non-observed time was on average 3.4 (site range 2.7–4.5) minutes per dose (Fig 4). Thus, the overall time used for vaccination was 8.3 (site range 7.1–9.0) minutes per dose. The observed labour costs of giving one vaccine dose were 1.73 Euros, and the total costs were 2.98 Euros including non-observed labour costs and consumables (Fig 5).

thumbnail
Fig 4. The observed and non-observed time used for one vaccination dose in different child health clinics.

https://doi.org/10.1371/journal.pone.0270835.g004

thumbnail
Fig 5. The total costs of giving one vaccine dose in Finnish CHC.

https://doi.org/10.1371/journal.pone.0270835.g005

The time used for vaccination depended on the type of vaccine. The preparation and administration of oral vaccines (i.e. rota vaccine) took more time than giving injections. The mean time used for giving oral vaccine was 2.15 minutes (95%CL 1.94–2.36, range 0.4–10.2) and for injected vaccines the time used was 1.34 (95%CL 1.21–1.36, range 0.21–1.75) minutes (Table 5). Of the injected vaccines, the fully liquid vaccines (pneumococcal conjugate, hepatitis B and seasonal influenza vaccines) were quicker to prepare when compared to vaccines that needed reconstitution (diphteria-tetanus-pertussis-polio-Haemophilus influenzae type B and measles-mumps-rubella -vaccines) (Table 5).

thumbnail
Table 5.

Observed time in minutes (A) and labour costs in Euros (B) used for preparing and administering different vaccines.

https://doi.org/10.1371/journal.pone.0270835.t005

The children vaccinated were monitored after vaccination on average 14.7 (range 13.7–15.7) minutes.

Discussion

In this unique study we measured the time used for different tasks included in the scheduled CHC visits in Finland. Using the observed times and the average salary of health care personnel we were able to calculate the labour costs for the different tasks. The observed labour costs of a nurse were 17 Euros for the whole visit lasting on average one hour. The physician used for all the tasks on average 23 minutes per visit and the mean labour costs were 19 Euros. During the visits the growth and physical and psychosocial development of the child were checked, the mental health and psychosocial well-being of the family was assessed and health counselling was given to the family. Furthermore, the paediatric vaccines were administered according to the National Vaccination Programme. Administering one vaccine dose cost 3 Euros including observed and non-observed time. When only the observed time used for the vaccinations is included in the evaluation, adding one vaccine dose to a visit without other vaccinations would add costs two Euros and if a dose would be added to a visit with other vaccines the costs would be about one Euro.

In the Finnish CHCs the physicians are in charge of the vaccinations, but in practice PHNs take care of the vaccines and administer them. In this study, physicians gave vaccination guidance at only 3 out of 122 physician visits. If physicians would have given the vaccines the costs of vaccination would have been more expensive because of the considerably higher labour costs.

This study was the first one to measure the times used for different tasks at the Finnish CHC visits. With the T&M method the actual costs of the various parts of the visit could be estimated. This study revealed that HCP use the time reserved for the predefined tasks. Documentation of the visit was time-consuming as reported also in a T&M study evaluating the time and costs of different number of vaccinations given to child [4].

The costs of administering the vaccines of the National Vaccination Programme have been previously evaluated in United Kingdom (UK) by the T&M method [9] and with activity logs [13]. The observed times used by nurses for vaccinations were quite similar, about 10 minutes, in Finland and the UK, even though the systems are different. In Finland, children visit CHCs 9 times during the first year of life and the visits include many other topics in addition to vaccination. In the UK the vaccination is the actual reason for visiting the clinic.

The whole process of CHC visits involves also a series of activities prior to the visit day (e.g. reserving the visit, ordering vaccines and brochures, cold-chain management), which were also considered for a complete assessment of the resource use and cost implications of the CHC visits. Unfortunately, we were not able to observe and measure the time used for those tasks, thus the time and costs of those were evaluated by interviews. The time used for the vaccine logistics varied in the CHCs because some clinics were responsible for all the vaccines given in the health station (including vaccines to adults) and others took care of the vaccines they needed themselves at CHC.

The CHC clinic visits in Finland have not been previously studied by T&M methods, but the time and costs of vaccinations have been assessed for the use of cost-effectiveness studies [14] by using total hourly cost of regular working time of a nurse [11]. Previously, 10 minutes per dose have been used as the time used for vaccination in Finnish cost-benefits calculations [14]. A T&M study on paediatric vaccination in the UK reported mean health care professional time for a vaccination process of 19.6 minutes, of which 9.5 minutes during the vaccination day (T&M data) and 10.1 minutes prior to the vaccination day (based on interviews) [9]. Other literature estimates for a single vaccine dose administration ranged between 17.3 minutes in the United States (US) (activities prior to and on the vaccination day) [7] and 23.8 minutes in New Zealand (vaccination day only) [8] based on the use of time diaries and questionnaires, respectively. Both studies suggested that their main limitation was the small sample size. In the US study it was also identified that self-reported, even though diary data, time estimates were not as accurate as observed times would have been [7]. In New Zealand there was a big variability in the results among practices [8]. We had four CHCs in the study and the number of observations was quite high. We got quite uniform results, because the subject matters of the visits have been regulated in a statute, leading to similar practises in the CHCs.

We found two T&M studies made in New York, USA. In both studies observations were done in 7 clinics. In a study where 164 vaccination visits of children were observed, the median time the HCP used for a visit was 21.4 minutes. In that study most children got three vaccinations and the time included only the observed time [15]. In another T&M study 102 seasonal influenza vaccination visits were observed. The median observed time used for the visit was 14 minutes [16].

The time estimates from the afore-mentioned studies are not easily comparable due to different definitions and methods used. Also, the fact that vaccination is a part of routine health check-up visits makes the Finnish system different from other studies [79, 13, 15, 16].

The children were monitored after vaccination on average 15 minutes after the first vaccine dose. The PHNs work was organised so that they were able to monitor children the recommended time [17, 18] which is not the case when the whole vaccination visit lasts 20 minutes or less [9, 13, 15, 16].

The type of vaccine played an important role in the time used for vaccination. In previously published studies it has been noted that it is quicker to give one shot instead of three shots [4], and slower to give a vaccine needing reconstitution when compared to ready-to-inject vaccine [5, 19]. Both results were observed also in our study. Furthermore, we showed that administering an oral vaccine is slower than giving an injection.

In this study we were able to observe the PHNs and physicians in four CHCs. It could be claimed that more CHCs would have given better generalizability to the results. As the CHC visits are regulated by statute [1], we think that the practices in different CHC are very similar as observed in our study.

We chose to collect the time used for vaccine logistics and other administrative tasks by interviews, which led to a wide site range of the time used for these non-observed tasks. The time of logistics would probably have varied widely also if observed directly, as the logistics arrangements were very different in different CHC as explained above.

We excluded visits of children whose parent(s) did not speak Finnish and visits of children with congenital or chronic diseases to get an overview of the routine work. If the excluded visits had been observed probably the overall time would have been longer and the time used for some tasks might have varied more. These excluded visits were rare in the CHCs observed and thus we do not think that they have an impact on the generalizability of the results.

To be able to understand the differences in the observed times of vaccination we should have observed also the environment of the visit rooms and the facilities. For example, the location of the fridge where the vaccines were (there was not fridge in every appointment room) might have lengthen the time used for vaccination. Unfortunately, we did not record this kind of details accurately enough.

Conclusions

Administering of one vaccine dose took about eight minutes and cost three Euros in the Finnish CHCs. Administering of the vaccines of the Finnish vaccination programme is relatively simple and inexpensive because Finnish children have regular scheduled visits to CHCs.

Supporting information

Acknowledgments

We kindly thank study nurses Anni Huttunen and Seija Nieminen for measuring the times. Warm thanks to the public health nurses and families who let our study nurses to follow-up the child- health-clinic-visits.

References

  1. 1. Government Decree 338/2011 on maternity and child welfare clinics, school and student health care and preventive oral health care.; 2019(May 20,) Available: http://www.finlex.fi/fi/laki/kaannokset/2011/en20110338.pdf, Accessed: May 20, 2019.
  2. 2. Hakulinen-Viitanen T, Hietanen-Peltola M, Bloigu A, Pelkonen M. Raportti. Maternity and child health clinic services and school health care–National follow-up 2012. Report [Abstract in English].; 12/2014 Available: http://www.julkari.fi/bitstream/handle/10024/116122/URN_ISBN_978-952-302-159-4.pdf?sequence=1&isAllowed=y.
  3. 3. Lopetegui M, Yen P, Lai A, Jeffries J, Embi P, Payne P. Time motion studies in healthcare: What are we talking about? J Biomed Inform 2014;49:292–9. https://doi.org/10.1016/j.jbi.2014.02.017 pmid:24607863
  4. 4. Pellissier JM, Coplan PM, Jackson LA, May JE. The effect of additional shots on the vaccine administration process: results of a time-motion study in 2 settings. Am J Manag Care 2000;6(9):1038–44. https://doi.org/10.1016/j.jbi.2014.02.017. pmid:11184065
  5. 5. De Coster I, Fournie X, Faure C, Ziani E, Nicolas L, Soubeyrand B et al. Assessment of preparation time with fully-liquid versus non-fully liquid paediatric hexavalent vaccines. A time and motion study. Vaccine 2015;33(32):3976–82. https://doi.org/10.1016/j.vaccine.2015.06.030 pmid:26092310
  6. 6. Pereira JA, Quach S, Hamid JS, Quan SD, Diniz AJ, Van Exan R et al. The integration of barcode scanning technology into Canadian public health immunization settings. Vaccine 2014;32(23):2748–55. https://doi.org/10.1016/j.vaccine.2013.11.015 pmid:24252700
  7. 7. Glazner JE, Beaty B, Berman S. Cost of vaccine administration among pediatric practices. Pediatrics 2009;124 Suppl 5:492. https://doi.org/10.1542/peds.2009-1542H pmid:19948580
  8. 8. Turner N, Rouse P, Airey S, Petousis-Harris H. The cost of immunising at the general practice level. J Prim Health Care 2009;1(4):286–96. https://doi.org/10.1071/HC09286. pmid:20690337
  9. 9. Mokiou S, Standaert B, Li X, De Cock E. Measuring the cost of a pediatric vaccine administration in the UK. Vaccine 2018;36(2):237–42. https://doi.org/10.1016/j.vaccine.2017.11.042 pmid:29208324
  10. 10. Crocker-Buque T, Mohan K, Ramsay M, Edelstein M, Mounier-Jack S. What is the cost of delivering routine vaccinations at GP practices in England? A comparative time-driven activity-based costing analysis. Human Vaccines & Immunotherapeutics 2019;15(12):3016–23. https://doi.org/10.1080/21645515.2019.1619403.
  11. 11. Kapiainen S, Väisänen A, Haula T. Terveyden- ja sosiaalihuollon yksikkökustannukset Suomessa vuonna 2011. Available: http://urn.fi/URN:ISBN:978-952-302-079-5.
  12. 12. www.medkit.fi.; 2019(May 13). Accessed: May 13, 2019.
  13. 13. Crocker-Buque T, Edelstein M, Mounier-Jack S. A process evaluation of how the routine vaccination programme is implemented at GP practices in England. Implement Sci 2018;13(1):132–8. https://doi.org/10.1186/s13012-018-0824-8 pmid:30348182
  14. 14. Salo H, Kilpi T, Sintonen H, Linna M, Peltola V, Heikkinen T. Cost-effectiveness of influenza vaccination of healthy children. Vaccine 2006;24(23):4934–41. https://doi.org/10.1016/j.vaccine.2006.03.057 pmid:16678945
  15. 15. LeBaron CW, Rodewald L, Humiston S. How much time is spent on well-child care and vaccinations? Arch Pediatr Adolesc Med 1999;153(11):1154–9. https://doi.org/10.1001/archpedi.153.11.1154 pmid:10555717
  16. 16. Szilagyi PG, Iwane MK, Humiston SE, Schaffer S, McInerny T, Shone L et al. Time spent by primary care practices on pediatric influenza vaccination visits: implications for universal influenza vaccination. Arch Pediatr Adolesc Med 2003;157(2):191–5. https://doi.org/10.1001/archpedi.157.2.191 pmid:12580691
  17. 17. National Institute for Health and Welfare. Rokotusten järjestäminen.; 2021(April 26,) Available: https://thl.fi/fi/web/infektiotaudit-ja-rokotukset/tietoa-rokotuksista/rokotustoiminnan-suunnittelu-ja-jarjestaminen, Accessed: April 26, 2021.
  18. 18. Centers for Disease Control and Prevention. Vaccine Administration.; 2019(May 20,) Available: https://www.cdc.gov/vaccines/pubs/pinkbook/vac-admin.html, Accessed: May 20, 2019.
  19. 19. Wiedenmayer KA, Weiss S, Chattopadhyay C, Mukherjee A, Kundu R, Aye R et al. Simplifying paediatric immunization with a fully liquid DTP-HepB-Hib combination vaccine: evidence from a comparative time-motion study in India. Vaccine 2009;27(5):655–9. https://doi.org/10.1016/j.vaccine.2008.11.045 pmid:19056443