Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Knowledge, attitude and practice of vaccinators and vaccine handlers on vaccine cold chain management in public health facilities, Ethiopia: Cross-sectional study

Abstract

Background

Effective management of the vaccine cold chain system at all levels is one of the crucial factors for maintaining vaccine potency. Vaccines require more complex handling and storage requirements due to increased temperature sensitivity and complicated immunization schedules. This urges adequate knowledge, attitude, and practice. This study assessed the knowledge, attitude, and practice of vaccinators and vaccine handlers’ in public health facilities.

Methodology

An institutional-based cross-sectional study design was used to assess the knowledge, attitude, and practice of 127 vaccinators and vaccine handlers in public health facilities of Oromia Special Zone, from September 1 to 30, 2019. Data were collected using self-administered questionnaires and a structured observation checklist. Descriptive and inferential statistics were made using the statistical package for social sciences version 20. Variables with a p-value <0.05 were taken as statistically significant.

Result

The response rate was (96.94%). Sixty-eight (53.5%; 95% CI: 46.5%, 61.4%), 58 (45.7%; 95% CI: 37.8%, 53.5%) and 62 (48.8%: 95% CI; 41.7%, 56.7%) vaccinators and vaccine handlers had satisfactory knowledge, positive attitude and good practice respectively. Receiving training on cold chain management had a statistically significant association with the level of knowledge on cold chain management (AOR = 3.04, 95% CI: 1.04–8.88).

Conclusions

More than half of vaccinators and vaccine handlers had satisfactory knowledge, while below half of vaccinators and vaccine handlers had a positive attitude and good practice. The determinants of knowledge in cold chain management were receiving training on cold chain management. Providing regular technical support and on the job training on vaccine cold chain management will improve the knowledge, attitude, and practice of vaccinators and vaccine handlers.

Introduction

Vaccination is one of the most powerful and cost-effective of all health interventions [1]. Vaccines are expensive products that save millions of children’s lives each year [2]. The introduction of a new vaccine can have a significant impact on a country’s health system [3] and require new strategies and additional cold storage capacity [4].

Vaccines are sensitive biological products that can easily be destroyed if handled incorrectly [2]. Exposure to inappropriate conditions can affect the potency of refrigerated vaccine [5]. The loss of vaccine potency may also cause the vaccine to become more reactogenic. Vaccines require more complex handling and storage requirements due to increased temperature sensitivity and complicated immunization schedules. This urges adequate training and supervision [6].

In the United States of America, health professionals’ median knowledge on vaccine program score was 47.6% [7]. The knowledge of vaccination against Human Papillomavirus infection was low (27.9%) among physicians in Hong Kong [8]. In India, the overall knowledge regarding cold chain practices was satisfactory [9, 10]. A review of evidence in Europe showed gaps in knowledge and poor communication among healthcare workers [11]. Knowledge of health professionals on the cold chain was not as per required levels to support effective cold chain management in Mozambique [12]. A study conducted in Nigeria showed an inadequate implementation of vaccine management guidelines [13] and about 43.0% health workers in Nigeria had good knowledge of vaccine management, while 66.1% of health workers in Nigeria had good vaccine management practices [14]. Another study in the health care facilities of Southern Nigeria showed that knowledge on appropriate management of the cold chain in two districts was poor [15]. Also in other previous studies, 272 (64.0%) personnel in Nigeria were found to have poor knowledge [16] and 7 (28.3%) personnels in Cameroon did not know the correct vaccine storage temperature [17]. About 124 (67.8%) vaccine providers in South Ethiopia responded correctly to the recommended range of temperature for storage vaccine [18] and 84% of health workers in Nigeria had good knowledge of vaccine vial monitor (VVM) [19].

Cold chain management, training, supervision, a higher level of education, and year of service were significant determinants of the practice of vaccine cold chain management [14, 15, 20]. Besides, vaccine supply chain performance and logistics in the health facilities were sub-optimal [21]. The inefficient vaccine management systems, including poor stock management, poor quality of vaccine handling and storage, contribute to high wastage of vaccines [4].

Vaccine wastage could be expected in all programs and some level of wastage is unavoidable [22]. Due to the increasing vaccine costs, countries are looking more closely than before at vaccine wastage [3]. Effective management of the vaccine cold chain system at all levels is one of the crucial factors for maintaining vaccine potency [2], which narrows the gap between vaccinated and immunized [9]. It saves program costs, prevents high wastage rates and stock-outs, and improves the safety of immunizations [23]. Significant improvements can also be made in cold chain management, resulting in considerable savings in vaccine and children’s life [24]. Thus, this study assessed the knowledge, attitude, and practice of vaccinators and vaccine handlers in public health facilities in the Oromia Special Zone.

Methodology

Study area and period

This study was conducted in public health facilities in the Oromia Special Zone, Ethiopia, from September 1 to September 30, 2019. The Oromia Special Zone is one of the ten zones found in the Amhara regional state. The administrative zone had 2 town administrations and 5 Woredas. The special zone had 2 hospitals, 28 health centers, and 115 health posts serving a total population of 459,847.

Study design

An institutional-based cross-sectional study design was used to assess the knowledge, attitude, and practice of vaccinators and vaccine handlers who engaged in vaccine cold chain management.

Source population

All vaccinators and vaccine handlers who engaged in vaccine cold chain management.

Sample population

All vaccinators and vaccine handlers who engaged in vaccine cold chain management and who gave their consent to participate.

Sample size determination and sampling procedures

All vaccinators and vaccine handlers (127) who engaged in vaccine cold chain management activities of the 27 public health facilities were included. Four participants refused to participate. Moreover, one health center and both hospitals were excluded due to interruptions in rendering vaccination services at the time of the study.

Variables

The outcome variables of the study were the knowledge, attitude, and practice of vaccinators and vaccine handlers. Socio-demographic characteristics, receiving training, and supportive supervisions were predictor variables.

Data collection tools and procedures

Self-administered questionnaire was used to assess the knowledge and attitude of vaccinators and vaccine handlers adopted from the World Health Organization (WHO) [23, 25, 26]. Knowledge was assessed using a total of 21 questions and attitude toward vaccine cold chain management was scored using a total of 6 questions on a 5 point Likert scale. A structured observation checklist was adopted from the WHO to assess their practice [27]. The vaccine cold chain practice was assessed using a total of 25 questions under 9 domains. A value of 1 and 0 was assigned for correct and false responses respectively. The total knowledge, attitude, and practice score for each respondent and vaccine cold chain practice and infrastructure of health facilities were converted to percentages, and also mean score was calculated.

A pretest test was carried out in two health centers to test validity of the study tools and instruments in those facilities that were not part of the study area. The data were collected by three experienced pharmacists and the principal investigators coordinated the overall data collection. The reliability of the self-administered questionnaire was also checked by Cronbach’s alpha test. The structured observation checklist and self-administered questionnaire had an alpha value of 0.72 and 0.75 respectively. To assure the quality of the data, questionnaires were critically examined for completeness, accuracy, clarity, and consistency.

Data management and analysis

The data were entered using EpiData version 4.6 and exported to Statistical Package for Social Sciences version 20 for further analysis. The multiple logistic regression was fitted, crude and adjusted odds ratios were calculated with 95% confidence intervals, and variables with p-value <0.05 were taken as statistically significant. The analysis of this study did not account for clustering by health facility and multiple comparisons.

Operational definitions.

Satisfactory knowledge. Vaccinators and vaccine handlers who scored greater than the mean score.

Positive attitude. Vaccinators and vaccine handlers who scored greater than the mean score.

Good practice. Vaccinators and vaccine handlers who scored greater than the mean score.

Ethical considerations

Ethical approval of research was done from the Ethics Review Committee of the College of Medicine and Health Science, Wollo University (CHMS/405/13/11) and Oromia Special Zone Health Department. Oral informed consent was also requested from the study participants and confidentiality was maintained.

Results

One hundred twenty-seven (96.94%) vaccinators and vaccine handlers responded. There were 85(66.9%) male respondents. The respondents consisted of 20 to 42 years of age with a mean age and standard deviation (SD) of 25.95±3.81. Among the vaccinator and vaccine handlers included in the study, 68 (53.5%) were midwives. Concerning the level of education, 48 (37.8%) were diplomas, while 79 (62.2%) had a degree of work experience ranging from 4 months to 14 years with mean work experience and SD of 3.29±2.44 (Table 1).

thumbnail
Table 1. Socio-demographic characteristics of respondents in public health facilities, Ethiopia, 2019 (n = 127).

https://doi.org/10.1371/journal.pone.0247459.t001

The correct placement of the thermometer was answered by 19 (15%). Only 23 (18.1%) vaccinators and vaccine handlers knew about to estimate vaccines need. Forty-nine (38.6%) vaccinators and vaccine handlers knew the three vaccines that required a shake test and the reason for the application of the shake test was correctly mentioned by 72 (56.7%). Proper compartment for placement of Oral Polio Vaccine (OPV), Bacillus-Calmette-Guerin (BCG), and Measles and Injectable Polio Vaccine (IPV), Tetanus Toxoid (TT), Penta-valent Vaccine (PV), Pneumococcal Conjugate Vaccine (PCV) and Rota vaccines in the top opening ice-lined refrigerators were correctly described by 44 (34.6%) and 33 (26%) of vaccinators and vaccine handlers, respectively (Table 2). Sixty-eight (53.5%; 95% CI; 46.5%, 61.4%) had satisfactory knowledge.

thumbnail
Table 2. Knowledge of respondents on key cold chain management areas in public health facilities, Ethiopia, 2019 (n = 127).

https://doi.org/10.1371/journal.pone.0247459.t002

Forty-one (32.3%), 33 (26%), 40 (31.5%), and 24 (18.9%) vaccinators and vaccine handlers perceived that placing food and drinks with vaccines, opening refrigerators greater than 3 times a day, usage of reconstituted vaccines after 6 hours and usage of vaccine after expiration was acceptable (Table 3). Fifty-eight (45.7% 95% CI: 37.8%, 53.5%) and 62 (48.8%; 95% CI: 41.7%, 56.7%) had positive attitudes and good practice, respectively.

thumbnail
Table 3. Attitude of respondents on cold chain management in public health facilities, Ethiopia, 2019 (n = 127).

https://doi.org/10.1371/journal.pone.0247459.t003

Only receiving training in cold chain management had a statistically significant association with the level of knowledge on cold chain management. The adjusted model indicated that health professionals who received training in cold chain management were about 3.04 times more likely to have satisfactory knowledge on cold chain management compared to those who did not receive training (Adjusted OR = 3.04, 95% CI: 1.04–8.88) (Table 4).

thumbnail
Table 4. Logistic regression of knowledge of respondents on cold chain management in public health facilities, Ethiopia, 2019 (n = 127).

https://doi.org/10.1371/journal.pone.0247459.t004

None of the variables were found to have a statistically significant association with the level of attitude on cold chain management. The age and salary of vaccinators and vaccine handlers had a statistically significant association with the level of cold chain management practice in the crude model. Vaccinators and vaccine handlers who earned a salary of 1651–3200 and 3201–5250 birr were about 2.54 (Adjusted OR = 2.54, 95% CI: 0.77–8.38) and1.42 times (Adjusted OR = 1.42, 95% CI: 0.40–4.96) more likely to have poor cold chain management practice compared to those who earn greater than 5251 Ethiopian birrs (Table 5).

thumbnail
Table 5. Logistic regression of practice of respondents on cold chain management in public health facilities, Ethiopia, 2019 (n = 127).

https://doi.org/10.1371/journal.pone.0247459.t005

Discussion

Only 24.4% of vaccinators and vaccine handlers received cold chain management-related training while just 27.6% got supervised on cold chain management. This was comparable with previous studies done in the past where the proportion of respondents not trained were 66.8% in central Ethiopia [28] and 78.1% in the Bale zone [18]. This was much lower than studies in Nigeria (65.0%) [14] and Brazil (91.3%) [29]. This might be attributed to a lack of management ownership, loss of attention on the cold chain, health professional attrition, and financial constraints.

The recommended range of temperature for vaccines was correctly responded by 96.9% in this study. This was comparable with a study done in central Ethiopia, where 78.4% responded correctly [20] but 1.42 (67.8%) and 1.35 (71.1%) times higher than those in Bale [18] and Guragie zone [28] respectively. Another study in Nigeria [30] and Mozambique [12] also reported that nearly half of the respondents (52.1%) knew the optimal vaccine storage temperature.

Regarding the frequency of temperature recording, 83.5% was correctly described in the present study. This was in line with findings in the Guragie zone, where 83.6% of health workers knew the frequency of temperature recordings [28], but 1.44 fold higher (57.9%) than respondents in the Bale zone [18] and central Ethiopia [20]. On the other hand, the correct placement of the thermometer was mentioned by15% in the current study and the result was much lower than Brazil (69%) [29].

In the present study, 38.6% of vaccinators and vaccine handlers knew vaccines that required a shake test and the finding was 1.9 fold lower than the study in Addis Abeba (73.8%) [31]. The reason for the application was correctly mentioned by 56.7%. This finding was much higher than a study conducted in the Bale zone (36.2%) [18], central Ethiopia (36.2%) [20], and Nigeria (51.6%) [30].

The types of vaccines that were most sensitive to freeze, heat, and light were correctly identified by 52.9%, 52.9%, and 55% of respondents, respectively. It was much better than study in Ethiopia [20, 31]. The knowledge of freeze sensitive vaccines was lower than Nigeria (77.9%) [16], Bale zone (60.1%) [18], and Addis Abeba (65.4%) [31], while the knowledge on heat and light sensitivity was lower (89.9%) and higher (42.6%) than Bale zone respondents, respectively [18]. Half (49.6%) of vaccinators and vaccine handlers knew the importance of vaccine vial monitor and this finding was higher than the study done in Addis Abeba (16.8%) [31] and Nigeria (45.3%) [30], but lower than the study conducted in the Bale zone (56.8%) [18].

Vaccine management in the case refrigerator out of function was known by 60.6% and the finding was comparable with central Ethiopia (63.8%) [20] but higher than the Bale zone (44.3%) [18]. When there is an equipment failure, larger quantities of vaccine can be destroyed [2]. During a malfunction, immediate steps should be taken to bring it back to working order [32]. To avoid the breakdown of preventive and curative maintenance systems to storage buildings and vaccine cold chains, equipment should be done [33] and there must also be a recording and reporting system of breakdowns [2].

One-third (34.6%) vaccinators and vaccine handlers described proper compartment for placement of OPV, BCG, and measles in this study and much less than a study conducted in Bale zone (67.2%) [18] and central Ethiopia (71.6%) [20]. This finding was in line with a study done in Cameroon, in which 37.7% of health personnel did not know the right place to store the measles vaccine in the refrigerator [17]. In Nigeria, 41.9% and 64.2% had a bad practice of storing freeze and heat-sensitive vaccines, respectively [15]. This might be due to insufficient numbers and inadequately trained staff to handle vaccines [34] or staff turnover. Temperatures may fluctuate in different compartments within the refrigerator, and vaccines should only be stored in certain areas [35].

In this study, 64.6% of vaccinators and vaccine handlers correctly listed vaccines under a multi-dose vial policy and the result was comparable with central Ethiopia (62.9%) [20]. Nearly one-third of respondents incorrectly interpreted the multi-dose vial policy [31]. This discrepancy in knowledge across studies might be attributed to participant’s qualification status, place of study, socio-cultural and demographic differences, and ways of assessing knowledge among studies.

The present study revealed that 53.5% of vaccinators and vaccine handlers had satisfactory knowledge. It was consistent with a study done in central Ethiopia and Bale zone, where 54.3% [20], Guragie zone (51.3%) [28], and 54.6% [18] had satisfactory knowledge. This finding was also better than studies in Nigeria [1416, 36] and India [9, 10, 37], where knowledge of health personnel on cold chain management was poor, but in line with studies conducted in India [38, 39] and Malaysia [40], where knowledge on cold chain management was good. The discrepancy might be due to a difference in staff motivation, study participants’ qualifications, characteristics of the country, and the nature of the study.

In this study, 45.7% of vaccinators and vaccine handlers had a positive attitude towards cold chain management. Although the result was better than a study done in Nigeria, where 79.8% had a poor attitude towards cold chains [40], it is much less than the study conducted in Nigeria (93.2%) [16]. This wide discrepancy among vaccinators and vaccine handlers might be due to geographical and sociocultural differences among studies.

Sixty-two (48.8%) vaccinators and vaccine handlers had a good practice of cold chain management in this study. The finding was lower (73%) than the practice of cold chain management in Nigeria [14, 15]. Dairo and Osizimete portrayed that health professionals who had good knowledge and received formal training on vaccine cold chain management were more likely to have good practices [14, 39]. Further increasing the level of education will also improve the practice of cold chain management by 5.2 [15]. Thus, regular training and effective monitoring are recommended to ensure standard immunization [41, 42].

The determinants of knowledge on cold chain management were receiving training. In this study, professionals who received training in cold chain management were about 3.04 times more likely to have satisfactory knowledge of cold chain management compared to those who didn’t receive it. In Egypt, the total knowledge score was higher among healthcare providers who received training courses [42]. Another study in Nigeria showed that training was the determinant of cold chain management knowledge [29]. Moreover, healthcare workers who had sufficient training had better knowledge than healthcare workers who had no training [16, 43].

Despite socio-demographic characteristics of vaccinators and vaccine handlers were not found significant, professional qualification and year of service of health professionals working in the immunization program in Ethiopia [20] nurses having a bachelor degree in Egypt [42] showed a statistically significant association with knowledge of cold chain management. Inappropriate knowledge was also observed in those with longer formed (17.4 years) and a longer duration of vaccine units (7 years) [29].

In this study, attitude on vaccine cold chain management was not significantly associated with any of the variables. However, the level of education (P = 0.005) and knowledge of cold chain management (P < 0.001) were reported as determinants of attitude [16]. The age and salary of vaccinators and vaccine handlers had a statistically significant association with the level of cold chain management practice in the crude model. According to a study conducted in Southern Nigeria, significant determinants of the practice of cold chain management were cold chain management training (p = 0.004), a national program on immunization supervision (p < 0.001), and a higher level of education (p < 0.001) [15]. A similar study in Oyo State, Nigeria showed that health professionals who had good knowledge of vaccine handling and storage (p < 0.001) and had received formal training on vaccine management (p< 0.001) were 10 and 5.3 times more likely to have good vaccine handling and storage practices [14]. The regular practice was observed among those who had more time (8.3 years) working in vaccines cold chain management [29].

This study revealed that there were gaps in knowledge, practices, and attitudes of vaccinators and vaccine handlers regarding the vaccine cold chain system. The vaccine requires complex handling and storage requirements [2, 37] and each year storage and handling errors result in the revaccination of many patients and significant financial loss due to wasted vaccines [5]. Thus, assessing the knowledge, attitude, and practices of vaccinators and vaccine handlers will empower efforts made to develop the human resources required to manage vaccines and improve the immunization supply chain. However, the cross-sectional nature of this study might make it harder to establish a temporal relationship.

Conclusion

More than half of vaccinators and vaccine handlers had satisfactory knowledge, while below half of vaccinators and vaccine handlers had a positive attitude and good practice. Receiving training on cold chain management was the determinant of knowledge on cold chain management and increased the odds of having better knowledge. Providing regular technical support and on the job training on vaccine cold chain management will improve the knowledge, attitude, and practice of vaccinators and vaccine handlers.

Acknowledgments

The authors would like to acknowledge Wollo University.

References

  1. 1. Zhou F, Bisgard KM, Yusuf HR, Deuson RR, Bath SK, Murphy TV. Impact of universal Haemophilus influenzae type b vaccination starting at 2 months of age in the United States: an economic analysis. Pediatrics. 2002;110(4):653–61. pmid:12359777
  2. 2. WHO. WHO-UNICEF effective vaccine store management initiative: modules 1–4. Geneva: World Health Organization, 2005.
  3. 3. WHO. Monitoring vaccine wastage at country level: Guideline for program managers. Geneva: Switzerland: World Health Organization. 2005. www.rho.org/files/rb4/Monitoring_Vaccine_Wastage_WHO_2005.pdf.
  4. 4. WHO. Global immunization vision and strategy: 2006–2015. Geneva: World Health Organization, 2005.
  5. 5. CDC. Vaccine Storage and Handling Toolkit. Atlanta: US Department of Health and human Services, Center for Disease Control and Prevention. 2019. https://www.cdc.gov/vaccines/hcp/admin/storage/toolkit/index.html.
  6. 6. WHO. Principles and considerations for adding a vaccine to a national immunization programme: from decision to implementation and monitoring. 2014.
  7. 7. Carrico RM, Wiemken T, Westhusing K, Christensen D, McKinney WP. Health care personnel immunization programs: an assessment of knowledge and practice among infection preventionists in US health care facilities. American journal of infection control. 2013;41(7):581–4. pmid:23313153
  8. 8. Wong MC, Lee A, Ngai KL, Chor JC, Chan PK. Knowledge, attitude, practice and barriers on vaccination against human papillomavirus infection: a cross-sectional study among primary care physicians in Hong Kong. PloS one. 2013;8(8):e71827. pmid:23990994
  9. 9. Krishnappa L, Anniappan AB, Voderhobli NH, Krishna SK, Yathiraj S, Sreekantaiah P. Evaluation of cold chain practices in urban health centers of a metro city in India. National J Community Medicine. 2014;5(3):288–92.
  10. 10. Rao S, Naftar S, Unnikrishnana B. Evaluation, awareness, practice and management of cold chain at the primary health care centers in coastal South India. Journal of Nepal Paediatric Society. 2012;32(1):19–22.
  11. 11. Simone B, Carrillo-Santisteve P, Lopalco PL. Healthcare workers’ role in keeping MMR vaccination uptake high in Europe: a review of evidence. Eurosurveillance. 2012;17(26):20206. pmid:22790533
  12. 12. de Timóteo M, Bjune G. Cold chain management: knowledge and practices in primary health care facilities in Niassa, Mozambique. Ethiopian Journal of Health Development. 2007;21(2):130–5.
  13. 13. Wallace AS, Willis F, Nwaze E, Dieng B, Sipilanyambe N, Daniels D, et al. Vaccine wastage in Nigeria: an assessment of wastage rates and related vaccinator knowledge, attitudes and practices. Vaccine. 2017;35(48):6751–8. pmid:29066189
  14. 14. Dairo D, Osizimete O. Factors affecting vaccine handling and storage practices among immunization service providers in Ibadan, Oyo State, Nigeria. African health sciences. 2016;16(2):576–83. pmid:27605974
  15. 15. Ogboghodo EO, Omuemu VO, Odijie O, Odaman OJ. Cold chain management practices of health care workers in primary health care facilities in Southern Nigeria. Pan African Medical Journal. 2017;27(1). pmid:28761610
  16. 16. Ogboghodo E, Omuemu V, Odijie O, Odaman O. Cold chain management: An assessment of knowledge and attitude of health workers in primary health-care facilities in Edo State Nigeria. Sahel Med J. 2018;21:75–82.
  17. 17. Yakum M, Ateudjieu J, Walter E, Watcho P. Vaccine storage and cold chain monitoring in the North West region of Cameroon: a cross sectional study. BMC research notes. 2015;8(1):145. pmid:25884186
  18. 18. Woldemichael B, Bekele D, Esmael A. Cold Chain Status and Knowledge of Vaccine Providers at Primary Health Care of Units Bale Zone, Southeast Ethiopia: Cross-sectional Study. Immunome Res. 2018;14(152):2.
  19. 19. Bankole AM, Olusegun K-K, Marian NB, Godswill I, Adebowale OA, Lukeman AS, et al. The impact of health facility monitoring on cold chain management practices in Lagos, Nigeria. Journal of Public Health and Epidemiology. 2010;2(4):78–81.
  20. 20. Rogie B, Berhane Y, Bisrat F. Assessment of cold chain status for immunization in central Ethiopia. Ethiop Med J. 2013;51(Suppl 1):21–9. pmid:24380204
  21. 21. Agueh V, Jerome C, Nyametso D, Paraiso M, Azandjemè C, Metonou C, et al. Evaluation of the Performance of Expanded Immunization Programme Supply Chain and Logistics Management in Southern Benin Rural Health District. Universal Journal of Public Health. 2016;4(4):160–70.
  22. 22. Bagdey P, Narlawar U, KishorSurwase D, Dhage D, Adikane H, Zurmure S. A cross sectional study of assessment of vaccine wastage in tertiary care centre of central India. Int J Health Sci Res. 2017;7(4):12–7.
  23. 23. WHO. Training for mid-level managers (MLM). Geneva: Switzerland: World Health Organization. 2008. https://www.who.int/immunization/documents/mlm/en/
  24. 24. Turner N, Laws A, Roberts L. Assessing the effectiveness of cold chain management for childhood vaccines. Journal of primary health care. 2011;3(4):278–82. pmid:22132380
  25. 25. WHO. Vaccine management assessment. Geneva: World Health Organization. 2005. https://apps.who.int/iris/handle/10665/70184?show=full.
  26. 26. WHO. Vaccines and biological: Ensuring the quality of vaccines at country level, guideline for health staff. Geneva: Switzerland: World Health Organization. 2002.
  27. 27. WHO. Safe vaccine handling, cold chain and immunizations: A manual for the newly independent states [Fact sheet]. Geneva: Switzerland: World Health Organization. 1998.
  28. 28. Yassin ZJ, Yimer Nega H, Derseh BT, Sisay Yehuala Y, Dad AF. Knowledge of Health Professionals on Cold Chain Management and Associated Factors in Ezha District, Gurage Zone, Ethiopia. Scientifica. 2019;2019. pmid:31281711
  29. 29. Almeida M, Araújo TME, Nunes BMVT, Moura MEB, de Carvalho MdC. Knowledge and professional practice on conservation of vaccines. Revista de Pesquisa: Cuidado é Fundamental Online. 2014;6(5):10–21.
  30. 30. Ameen H, Salaudeen A, Bolarinwa O, Uthman M, Musa O, Aderibigbe S. Vaccine Storage and Handling Practices among routine immunization service providers in a metropolitan city of North-Central Nigeria. Journal of Community Medicine and Primary Health Care. 2014;26(2):18–28.
  31. 31. Berhanu T, Kebede Y, Berhane Y. Assessment of vaccines’ potency maintenance and injection safety practice In health facilities of Addis Ababa. https://nadre.ethernet.edu.et › record. 2019.
  32. 32. CDC. Cold Chain Protocol: Vaccines and Biologics. Atlanta: US Department of Health and human Services, Center for Disease Control and Prevention. 2013. https://www.gov.mb.ca/health/publichealth/cdc/protocol/ccp.pdf.
  33. 33. WHO. Immunization supply chain and logistics: A neglected but essential system for national immunization program, A call to action. Geneva: Switzerland: World Health Organization. 2014. www.who.int/immunization/call-to-action_ipac-iscl.pdf.
  34. 34. Lloyd J, Cheyne J. The origins of the vaccine cold chain and a glimpse of the future. Vaccine. 2017;35(17):2115–20. pmid:28364918
  35. 35. CDC. Vaccine Storage and Handling Toolkit. Atlanta: US Department of Health and human Services, Center for Disease Control and Prevention. 2014. https://www.cdc.gov/vaccines/hcp/admin/storage/toolkit/storage-handling-toolkit.pdf
  36. 36. Akoh W, Ateudjieu J, Nouetchognou J, Yakum M, Nembot F, Sonkeng S, et al. The expanded program on immunization service delivery in the Dschang health district, west region of Cameroon: a cross sectional survey. BMC public health. 2016;16(1):801. pmid:27530488
  37. 37. Mallik S, Mandal P, Chatterjee C, Ghosh P, Manna N, Chakrabarty D, et al. Assessing cold chain status in a metro city of India: an intervention study. African health sciences. 2011;11(1).
  38. 38. Harsh S, Bonny S, Ketan P, Surendra J. Closing gaps in routine immunization-impact and cost assessment on components of new vaccine policy in routine immunization in Gujarat, India. Journal Of Research In Medical And Dental Science. 2016;4(1):70–4.
  39. 39. Shah J, Agarwal M, Patel J, Trivedi A. Quality assessment of immunization services: A cross sectional study at UHCs of Ahmedabad Municipal Corporation. Int J Health Sci Res. 2015;5(7):21–5.
  40. 40. Azira B, Norhayati M, Norwati D. Knowledge, attitude and adherence to cold chain among general practitioners in Kelantan, Malaysia. International Journal of Collaborative Research on Internal Medicine & Public Health. 2013;5(3):157.
  41. 41. Brown VB, Oluwatosin OA, Ogundeji MO. Impact of training intervention on immunization providers’ knowledge and practice of routine immunization in Ibadan, south-western Nigeria: a primary health care experience. Pan African Medical Journal. 2017;26(216).
  42. 42. El Shazly HM, Khalil NA, Ibrahem RA, Wahed SAA. Knowledge and practice of healthcare providers as regards routine children vaccination in primary healthcare facilities of Quewisna District, Menoufia Governorate. Menoufia Medical Journal. 2016;29(4):1018.
  43. 43. Widsanugorn O, Suwattana O, Harun-Or-Rashid M, Sakamoto J. Healthcare workers’ knowledge and practices regarding expanded program on immunization in kalasin, Thailand. Nagoya journal of medical science. 2011;73(3–4):177. pmid:21928699