Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Evaluation of Health Management Information System data quality and information use for HIV/AIDS programs in public health facilities of Jimma town, Southwest Ethiopia

  • Samson Tashome Abashu,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Current address of corresponding author: Department of Health Policy and Management, Faculty of Public Health, Institute of Health, Jimma University P.O. Box 378, Jimma, Ethiopia.

    Affiliation Department of Health Policy and Management, Public Health Faculty, Institute of Health, Jimma University, Jimma, Ethiopia

    ⨯
  • Tilahun Fufa Debela,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Department of Health Policy and Management, Public Health Faculty, Institute of Health, Jimma University, Jimma, Ethiopia

    ⨯
  • Muluembet Abera Wordofa,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Population and Family Health, Public Health Faculty, Institute of Health, Jimma University, Jimma, Ethiopia

    ⨯
  • Berhane Megerssa Ereso

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Supervision, Validation, Visualization, Writing – review & editing

    berhane.megerssa@ju.edu.et

    Affiliation Department of Health Policy and Management, Public Health Faculty, Institute of Health, Jimma University, Jimma, Ethiopia

    ⨯

Abstract

Background

Poor data quality is a critical challenge to meet the global and national health goals since performance of the health system cannot be adequately monitored. Despite significant investments, HIV/AIDS program data quality remains challenging in developing countries including Ethiopia to make informed decision. The aim of this study was to evaluate health management information system data quality and information use for HIV/AIDS program in Jimma town public health facilities, South West Ethiopia, 2022.

Method

Facility-based cross-sectional evaluation with mixed methods was employed from June 22 to July 06/2022 at five public health facilities providing Anti-Retroviral Therapy in Jimma town. A total of 234 randomly selected HIV-positive patients’ medical records were reviewed, and a mobile-based data collection method was employed. Finally, resource availability, data quality and information use were analyzed separately and judged depending on judgment parameter.

Results

The overall resource availability, data quality and information use were 75.1%, 77.2% and 70.4% respectively. None of the providers working on Voluntary Counselling and Testing service were trained on data quality. There was a lack of SmartCare, internet and printers in some health facilities. Report timeliness, data completeness and data consistency were 46.7%, 91.1% and 84.2% respectively. Performance monitoring team meetings were not held on a monthly basis and some facilities didn’t use the standard performance monitoring team logbook.

Conclusion

The overall level of resource availability, data quality and information use were judged as good for each. However, report timeliness, data consistency and information uses were below the recommended national standards. Data quality related training should be provided for health care provides. SmartCare, internet, printers and guidelines should be supplied for the health facilities.

1. Introduction

Health Management Information System (HMIS) is the routine collection, aggregation, analysis, presentation and utilization of health and health related data for evidence based decisions for health workers, managers, policy makers and others [1,2]. Restructuring of health information systems has been a significant trend globally since the declaration of primary health care as an essential health care strategy at the Alma-Ata conference in 1978. As part of health system reform, developing countries also launched reforms to improve and expand health information systems [3]. However, studies in Sub-Saharan Africa (SSA) have revealed challenges with HMIS data quality, in terms of timeliness, completeness, consistency and poor utilization of HMIS tools [2,4,5].

Data quality is the degree to which a given dataset meets a user’s requirements and data are fit for their intended uses in operations, decision-making and planning. It is a prerequisite for ensuring HMIS information use [6]. On contrast, poor data quality is critical challenges to reaching the global and national health goals because the health system performance cannot be adequately monitored where data are of poor quality. Consequence of poor data quality includes everything from treatment quality to policy-level decision making. It leads to patient frustration and mistreatment, employee distrust of critical technology, decrease in efficiency and increase in bottlenecks, and poor and ineffective policy decisions [2,14].

Information use is the process through which decisions makers and stakeholders explicitly consider information in one or more steps of policy making, program planning and management, or service provision. Similarly, HIV/AIDS data is required at individual level, community level, facility level, and population level to provide individual level care and program level management [6,7].

Irrespective of huge supports by Non-Governmental Organizations and significant investments in technology, process development and human capital, HIV/AIDS program data quality remains challenging in developing countries to make informed decision [8]. In addition, the occurrence of COVID-19 pandemic has led to different challenges, and routine data accuracy check and RHIS performance review practices were also significantly reduced during the pandemic [9].

Study conducted in South Africa has revealed serious data-accuracy concerns in the routine data used to monitor PMTCT programs. This study indicated that an average accuracy between register and Routine Monthly Report was 51% and between the Routine Monthly Report and DHMIS database was 84% [10]. In addition, study conducted in Mozambique indicated that PMTCT data quality was 79% which is below expected national target. According to this study data consistency level between registration book and monthly reports was 89% and completeness of the data was 50% [11].

In Ethiopia, the electronics community HIV information system is not fully functional and is largely paper based system which does not have an effective grassroots structure. Assessment conducted at 47 health facilities in Addis Ababa indicated that less than 10% of the clients have valid residence information such as Kebele and mobile number recorded. Finding from routine RDQA by Addis Ababa City Administration Health Bureau in 16 health facilities showed over reporting in clients currently on treatment and testing positive. This assessment also showed underreporting on number of tests done and number of patients who are newly put on treatment [12]. In addition, study conducted in University of Gondar referral hospital indicates data completeness of ART clinic in both EMR and paper record is below national standard which is 76% and 78% respectively [13].

To solve HMIS data quality and information use problem, Ethiopian FMoH introduced information revolution and the government has been providing capacity building for health workforces [7]. Furthermore, revision has been made to HMIS and DHIS-2 was introduced. Similarly, SmartCare (EMR-ART) was also initiated to record and store HIV/AIDS data. Despite all this efforts, HIV AIDS data quality was not at the required level to make informed decision, provide quality care and support, and control the epidemic in Ethiopia [15,16]. To the best of our research, there is no published study conducted on HMIS or HIV AIDS program data quality and information use in Jimma town. The aim of this study was to identify the level of HIV/AIDS program data quality and information use in Jimma town public health facilities. Moreover, it was aimed to explore facilitators and barriers to HIV/AIDS data quality and information use.

2. Methods and materials

2.1 Study design, setting and period

Facility-based cross-sectional evaluation using mixed quantitative and qualitative methods was employed from June 22 to July 06/2022. The study was conducted in Jimma town which is located at 354 Km Southwest of Addis Ababa. There are 6 public health facilities (2 hospitals and 4 health centers) in the town of which five of them (two hospital and three health centers) are providing ART service. Jimma town health bureau reports of 2021 showed that there are 394 newly diagnosed HIV positive patients and a total of 5099 PLWHA in the town.

2.2 Population

Source populations were all HIV AIDS related documents and all HIV/AIDS program staffs in Jimma town public health facilities. Study populations were selected HIV AIDS program documents and purposively selected ART providers, data clerks, ART coordinators, Jimma town HIV/AIDS program coordinator and M and E officer.

2.3 Sample size determination and sampling procedures

A total of 234 randomly selected HIV-positive patients’ medical records were reviewed at five public health facilities providing ART service in the town. The sample size was determined by using single population proportion formula taking P 0.825 for overall average data quality of HMIS which was 82.5% from study conducted in Southern Ethiopia [17].

Since total population of patients on ART in the town is less than 10000 (i.e., 5099) correction formulas was used.

n= =, n = 213 and adding 10% for document which could be excluded (ineligible for document review) final sample size was 234.

The total sample size was proportionally allocated to each public health facility based on number of patients on ART at each facility. Then patient charts were selected by systematic sampling technique using unique ART number. Similarly data on ART register was reviewed for selected patient charts. For qualitative study, a total of 17 purposively selected key informants were included in the study and sample size was guided by saturation of idea.

2.4 Eligibility criteria

Inclusion criteria were selected HIV/AIDS program documents which are readable and HIV/AIDS program staffs those worked at least for six months at the facility. Patient cards with omitted information, not readable and torn were excluded from the data collection.

2.5 Data collection tools and procedures

Data collection tools were adapted from standard guidelines and structured checklists were used for document review and recourse inventory [6,31]. In addition, semi-structured interview guide was developed depending on evaluation questions and used for the key informant interview. The tool was translated to local language (Afan Oromo and Amharic), and used for data collection after pretested at Agaro general hospital on 5% (equivalent to sample size = 12). A total of five data collectors were participated in data collection after taking two days training on evaluation objectives, data collection tools, mobile based data collection (ODK) and ethical issues. Trained data collectors were participated in pretest to adapt themselves to the tool for the final data collection and ODK application was employed. Key Informants were interviewed by principal evaluator after resource inventory and document review was conducted at the office of respective key informant. The whole procedure of data collection had been supervised and monitored to assure the data quality.

2.6 Data management and analysis

Quantitative data were downloaded from Kobotoolbox in excel form and exported into SPSS version 26 software for analysis. Then, descriptive statistics were calculated for variables and the results were presented by texts, tables and graphs. Field note and audio records were transcribed in to the same language and translated to English for further analysis. Translated data were coded, categorized and classified into themes. Then it was analyzed manually by thematic analysis technique and the results were narrated by triangulating with quantitative findings.

2.7 Ethical consideration

Ethical approval was obtained from the institutional review board of institute of health, Jimma University. Informed, voluntary, written and signed consent was obtained from each key informant. Name and other personal information that could compromise the respondents’ confidentiality were not recorded. In addition, face mask and sanitizer were availed for data collectors and key informants for covid-19 infection prevention.

2.8 Operational definitions

Availability.

In this evaluation, availability of resources required for HIV/AIDS program data quality and information use were assessed by ten indicators adapted from standard manuals.

Data quality.

Was evaluated by three major data quality dimensions namely; timeliness, completeness and consistency.

Timeliness.

Report timeliness was measured for six months routine HIV/AIDS report and said to be timely reported if submitted before 26th day of the reporting period. Accordingly, it was labeled as timeline if >90% of facilities report is submitted before the deadline.

Completeness.

It was measured by three indicators. Completeness of data on patient chart is the degree to which selected data is filled on sampled patient charts. Similarly, completeness of data on ART register is the degree to which selected variables are filled on ART register for sampled patient charts. In addition, completeness of data on report format is degree to which reportable data elements were filled against total number of reportable data elements supposed to be filled on HIV/AIDS program monthly reports. Overall completeness level was measured by relative weight given for the three indicators and judged against judgement parameter. Finally, facilities are expected to achieve data completeness level of >90% to be labeled as complete.

Consistency.

Data consistency was measured by four indicators. Consistency of data between patient chart and ART register was measured by assessing the level of data concordance for selected variables between the two recording tools. On the other hand, consistency over time was measured for twelve months HIV/AIDS monthly report and the report was labeled as inconsistent over time if it was increased or decreased by ≥ 33%. In addition, consistency between original record and reported data was measured by reviewing data on ART registration and HIV/AIDS monthly report. Overall, the health facilities’ data consistency level is said to be within the recommended national standard if it is  > 90%.

Information use.

It was measured by thirteen indicators and judged against agreed judgment parameter. The data were collected by reviewing PMT logbook and MDT minutes. In this evaluation PMT was said to be stablished as per standard if the facility head was chairperson of the PMT, HMIS focal person was secretary of the PMT and all case team coordinators were members of the PMT.

Judgment criteria.

Is a preset criteria developed by agreement with stakeholders and weight were given for each indicator by considering their relative importance in the evaluation. Accordingly, the cut of point was decided to be Very Good if ≥85%, Good if 70% – 84%, Fair if 55% – 69% and Critical if <55% [18].

3. Result

3.1 Description of the study participants

A total of 234 patient charts selected by systematic random sampling using unique ART number (143 from Jimma University medical center, 51 from Jimma health center, 27 from Shanen Gibe general hospital, 11 from Higher-2 health center, and 2 from Mandera Kochi health center) were reviewed. Similarly, data of sampled patient charts was reviewed on ART registers at respective health facilities. In addition, a total of 17 key informants (Jimma town HIV/AIDS program focal person, Jimma town M and E officer, ART focal person/coordinators, ART providers and data clerks) were included in the study.

3.2 Availability of resource

3.2.1. Recording and reporting formats.

This study showed 90% overall availability of recording and reporting tools. There were no standard Performance monitoring team logbook and report timeliness and completeness tracking logbook in Jimma University Medical Center and Mandera Kochi health center. Similarly, Post-exposure prophylaxis register, multi-disciplinary team meeting minute and health institution report timeliness and completeness tracking logbook were not available in Higher-2 health center. On contrast, recording tools like ART register, PreP-register, PRE- ART register and VCT registers were available in all public health facilities. One respondent elaborated:

“…there is no shortage of recording and reporting tool in our health facility. We have most report formats in soft copy and use it by printing it. In addition, recording tools like registers were provided by town health office for us”. [A 34 years old male key informant]

3.2.2 Guidelines.

According to this study, 55% of guidelines required for HIV/AIDS program data quality and information use were available. In Jimma health center, 75% of required guidelines were available and 50% of them were available in the other health facilities. All public health facilities have HMIS procedure and information use manual except Jimma health center. On contrary, Jimma health center is the only health facility which had HIV/AIDS data quality manual and HIV/AIDS information use manual. A respondent described this issue:

“Even though different guidelines and manuals were provided from town health office, we do not have guidelines related to HIV/AIDS data quality in our health facility. This is due to our negligence since we didn’t request the office so far and even we can use it by downloading in soft copy from internet until we get it from the office…” [A 30 years male key informant]

3.2.3 Infrastructures.

According to this study, 80% of evaluated basic infrastructures were available in Jimma town public health facilities. All basic infrastructures were available in Jimma Medical center and Shanen Gibe hospital. On contrast, Mendera Kochi health center had 50% of the basic infrastructure during the study period. (Table 1)

thumbnail
Table 1. Availability of basic infrastructures in Jimma town public health facilities, 2022.

https://doi.org/10.1371/journal.pone.0357022.t001

One of the respondents elaborated the infrastructure problem:

“....Internet service was interrupted for the last one month and we face problem to enter patient data on SmartCare. In addition, our facility enters monthly report on DHIS-2 at town health office due to internet interruption. Internet and telephone service interrupts frequently due to shortage of budget and providers were forced to use their mobile to trace lost to follow up. [A 27 year old female key informant]

3.2.4 Human resource.

According to this study, overall availability of trained human power on RHIS/HMIS data quality was 66.7%. All health facilities had assigned provider for VCT but none of them took data quality related training within the last six months. Unlike other health facilities, ART coordinators in Jimma University medical center and Shanen Gibe hospital took training on data quality since the last six months. A respondent described this issue:

“…HIV/AIDS data quality is not achieved by only certain individuals and it needs involvement of all service delivery point provider. However, most providers were not trained on data quality since most of HIV/AIDS program related training is given for providers working on the program but not for other service delivery point provider”. [A 28 years old male key informant]

3.3 Data quality

3.3.1 Report timeliness.

From six months HMIS report, 46.67% of them were submitted to the next level according to the national schedule. Jimma health center, Higher-2 health center and Mendera Kochi health center had report timeliness level of 66.67%. On contrast, Shanen Gibe general hospital had report timeliness level of 33.3% and Jimma University medical center reported none of the six months report before the deadline. However, Most of the key informants stated that they submit monthly report before the deadline and report timeliness remains low due to edition of report on DHIS-2 after the deadline. A respondent clarified this issue:

“Most of the time we submit monthly HIV/AIDS program reports before the deadline. However, timeliness level is recorded by DHIS-2 and it will automatically change the timelines level into zero when any data is entered or edited after the deadline…” [A 29 years old data clerk]

3.3.2 Completeness.

3.3.2.1 Completeness of data on patient chart: This study showed overall data completeness level of 96.2% (n = 234) on patient charts. Residence information like phone number, district and kebele were filled on 94%, 98.3% and 97.4% of sampled patient charts respectively. (Table 2)

thumbnail
Table 2. Data completeness level on patient charts in Jimma town public health facilities, 2022.

https://doi.org/10.1371/journal.pone.0357022.t002

Majority of key informants stated that there is a good attitude towards data completeness on patient charts like filling missed data and updating when patients come for follow up. A respondent elaborate this issue:

“I register patient’s residential information and other required data on patient chart carefully when they start ART since it helps me to monitor patients response to ART and trace back once lost from follow up. I also fill data like phone number and address during follow up for patients previously not filled…” [A 34 years old ART provider]

3.3.2.2 Completeness of data on ART register: This study revealed that overall data completeness level on ART register was 88.3% (n = 234). The highest level data completeness was observed on age at entry, ART start date and ART regimen on last follow up which was 99.6% for each variables. On contrast the least level of data completeness was observed on weight on last follow up (58.5%). Regarding data completeness on ART register by health facility, JUMC and Mendera MKHC had the highest level of data completeness which was 91.8% and 91.7% respectively.

Most of key informants stated that they give more attention in treating patients than filling data on ART register. The response of a 27 years old provider strengthens this concern as: “Most of the time, I just focus on the assessment of the patient and managing the cases since there is high patient flow in our health facility. So, I prefer filling ART register when I am about to leave from the work and I suspect that this affect the completeness since I get tired …”

3.3.2.3 Completeness of data on report format: According to this study, out of 510 data elements checked for report content completeness 445 (87.25%) of the data elements were completely filled in the report format. The highest level report completeness was observed at Jimma University Medical Center (92.16%) followed by Shanen Gibe Hospital (90.20%) and Mandera Kochi Health Center (88.24%). A respondent stated:

“…I fill report format with zero if the service is not available or the result is not registered throughout the month. However, sometimes the report might be missed by mistake”. [A 26 years old data clerk]

3.3.3 Consistency.

3.3.3.1 Consistency of data between patient chart and ART registration: This study showed overall data consistency level of 75.85% between patient chart and ART register. The highest level of data consistency was observed on ART regimen on last follow up date (94.44%) and least level of consistency was observed for weight on last follow up date (41.88%) between patient chart and ART register (Fig 1).

thumbnail
Fig 1. Level of data consistency between patient chart and ART register in Jimma town public health facilities, 2022.

https://doi.org/10.1371/journal.pone.0357022.g001

Key informants identified two main reasons for data inconsistency, which includes filling of data by different person on patient chart and ART register, and lower attention for filling patient data as compared to treating clients. A participant elaborated this issue:

“…. In our facility data on patient chart is filled by ART providers and data on ART register is filled by data clerk. In addition, Providers give more attention to service provision rather than data quality. They copy data on patient chart to registration when they are about to leave from work” [26 years old data clerk]

3.3.3.2 Consistency between reported data and data on ART register: The overall data consistency between three months HIV/AIDS report and data on ART register was 105.8%. Three out of five health facilities had report consistency level find within acceptable range. On contrast, HIV/AIDS report was underreported in Jimma Health Center (134.76%) and Higher 2 Health center (113.56%). One participant clarified this issue:

“Providers do not fill data on tally sheet properly which was recorded on register. In addition, report is not cross checked against data on tally sheet before report submission. This leads to false reporting which is over reporting or under reporting…” [A 33 year old female KI]

3.3.3.3 Consistency of HIV test report at VCT+PITC and HCT by population group: According to this study, overall consistency of HIV Counselling and Testing (HCT) report by population group and PITC+VCT was 66.67%. It was 83.33% at Higher-2 health center and Mandera Kochi health center followed by Jimma health center (66.67%).

“…HIV counseling and testing report is compiled from VCT and different service delivery point. providers give less attention in classifying tested clients into population group and this in turn leads to discrepancy between HCT by population group and VCT and PITC”. [A 27 year old KI]

3.3.3.4 Consistency over time: This study revealed that eleven out of twelve months (91.7%) currently on ART report were consistent over time and report of March 2022 month was not consistent since it decreases from mean of the previous twelve months by 96.7% (Table 3). One participant described:

thumbnail
Table 3. Consistency over time of Currently on ART monthly report in Jimma town public health facilities, 2022.

https://doi.org/10.1371/journal.pone.0357022.t003

“…report of PLWHA currently on ART is filled with attention and we were asked for justification from the office if increased or decreased sharply. As a result, we checked and traced lost to follow up monthly, recorded transfer in properly and conduct death audit once death occurred”. [A 34 years old male]

3.4 Information use

This study revealed overall information use level of 70.4% at facility level. All health facilities had established PMT as per standard and all HIV/AIDS case team prepared data visuals showing achievements toward targets. In addition, 73.3% of expected PMT was conducted over six months and 66.7% of conducted the PMT meeting was chaired by facility heads. On contrast, none of the conducted PMT was attended by head of town health office. Majority of key informants agreed that there is significant gap regarding information use at facility level and PMT meeting is conducted to fulfill the requirement. One participant stated:

“It is difficult to get PMT members especially head of facility to conduct the meeting on regular basis. Sometimes, we conduct the meeting in the absence of facility head or with few members of the PMT for the requirement. Even there is a situation in which we fill on PMT logbook for one or two months without conducting the meeting…” [A 28 year old male key informant]

Another participant added on this issue:

“...PMT meeting is conducted to please higher level managers rather than solving problems. I think this is due to lack of awareness on PMT and information use as a whole”. [A 28 year old female key informant]

3.5 Overall judgment

Based on the weight given for each dimension, the overall resource availability, data quality and information use were 75.1%, 77.2% and 70.4% respectively which scored good for each dimensions. (Table 4)

thumbnail
Table 4. Overall Judgment matrix for evaluation of HMIS data quality and information use in case of HIV/AIDS program in Jimma town public health facilities, 2022.

https://doi.org/10.1371/journal.pone.0357022.t004

4. Discussion

In this study, we identified the level of HIV/AIDS program data quality and information use in Jimma town public health facilities. In addition, we explored the facilitators and barriers to HIV/AIDS data quality and information use. Accordingly, the overall availability of recording and reporting tool was 90%. This finding is greater than the study conducted in Liberia and South West Shewa, Ethiopia with 55% and 25% respectively [19,20]. This difference might be due to difference in socioeconomic status of the country and the study setting respectively. The current study indicated that all health facilities had electric supply which is better than the study conducted in East Wollega (40%) and South West Shewa zone 77% [20,21]. The difference might be attributed by continuous electric supply in urban health facilities as compared to rural health facilities. In addition, four out of five (80%) of health facilities have ART-EMR (SmartCare) which is almost consistent with the study conducted in Mekelle town, Ethiopia with 83.3% EMR availability [22]. The consistency might be due to strategic focus of Ethiopian ministry of health in installing ART-EMR in high patient load facilities [23].

Our evaluation finding showed overall availability of trained human power on RHIS/HMIS data quality of 66.7%. This finding is better than the study conducted in East Wollega, Eastern Ethiopia and Southern nations and nationalities of Ethiopia which showed 36.6%, 52.7% and 52.2% of staffs took HIS training respectively [23–26]. The possible justification for this difference might be due to difference in sample size and study settings since urban health workers have greater opportunity for training.

This study revealed that 46.67% of six months reports were submitted to the next level according to the national schedule which was found to be far below the national expectation [16]. It was also lower than the study conducted in Harari region and Hadiya zone with report timeliness of 93.7% and 84% respectively [27,28]. This discrepancy might be attributed by data source of report timeliness since it was customized from DHIS-2 in current study.

On the other hand, the level of data completeness on patient chart was 96.2%.This finding is greater than the national minimum acceptable data completeness level and the study conducted in Addis Ababa which showed less than 10% of the clients on ART have filled valid residence information such as Kebele and mobile number [29]. The possible explanation for better achievement might be due to high staff commitment for data completeness on patient charts as indicated by qualitative findings. On contrast, data completeness on ART register was 88.3% and this finding is below nationally recommended level of data completeness [16].

Regarding report content completeness, 87.25% of the data elements were completely filled in the reporting format. This finding is comparable with recently conducted study in Hadiya Zone, Ethiopia (86%) and below the study conducted in Harari region, Ethiopia (93%) [27,28]. However, this result is greater than the study conducted in Southern Nations and Nationalities of Ethiopia with report content completeness of 83.3% [25]. The discrepancy might be attributed by improvements made to HIS throughout four years difference of study period like development of HIS guidelines, capacity building, and establishment and staffing of HIT structures at different levels [7].

This evaluation indicated data consistency between patient chart and ART register of 75.85% which is below nationally recommended level of data consistency. The possible justification for low achievement might be due to low level of staff attention towards data on ART register as indicated by qualitative findings. On the other hand, consistency of HIV/AIDS report over time was 91.7% which is greater than minimum expected level of data consistency. The possible justification for this level of achievement might be due to close follow up and attention to newly started ART and current on ART report by program coordinator.

The present evaluation finding revealed overall information use level of 70.4%. This finding was lower than the study conducted in North Gondar, Ethiopia which revealed 78.5% information utilization for decision making [30]. The possible explanation for lower level of information utilization might be due low staffs awareness towards information use, being busy of providers by other work and lower utilization of standard PMT logbook as elaborated by key informants.

5. Limitation of the evaluation

This evaluation might be susceptible to social desirability bias in which Key Informants might underreport undesirable attitudes or behaviors and over report more desirable attributes. Detail explanation was given for the key informants on purpose of the evaluation to minimize this bias. The other limitation might be the use of secondary data (document review) since there may be other important data that is not actually in the documents. To solve this problem, key informant interview was conducted to provide explanation for finding from the document review.

6. Conclusion

The overall level of resource availability, HIV/AIDS data quality and information use at facility level were judged as good for each dimension. However, there was a lack of infrastructure like functional printers, telephones and internet access. Majority of ART coordinators and VCT providers didn’t take data quality-related training or refreshment during the last six months. The level of data completeness was within recommended national standard. However, the level of report timeliness and data consistency were below recommended national standards. All health facilities had established PMT as per standard. However, PMT meeting, MDT meeting and LQAS were not held on regular basis. Thus, Jimma town health office should ensure the availability of basic resources to properly implement HMIS in the case of HIV AIDS program. Moreover, health facilities should strengthen PMT for improving data quality and information use.

Supporting information

S1 Text. Data collection tool, information sheet with consent form English and local languages versions.

https://doi.org/10.1371/journal.pone.0357022.s001

(PDF)

Acknowledgments

The authors would like to thank Jimma University, Institute of Health, Department of Health Policy and Management, and the Jimma University Capacity Building and Mentorship Program for giving us this opportunity to conduct this research. We are also thankful to the health facility managers and the study participants.

References

  1. 1. MoH. Ethiopia health management information system: data recording and reporting. 2018.
  2. 2. Rumisha SF, Lyimo EP, et al. Data quality of the routine health management information system at the primary healthcare facility and district levels in Tanzania. 2020.
  3. 3. World Health Organization. WHO’s framework for action. Everybody’s business strengthening health systems to improve health outcomes. 2007.
  4. 4. Zewdie AB. Assessment of revised health management information system implementation in South West Shoa Zone, Central Ethiopia. 2020.
  5. 5. Moukénet A, de Cola MA, Ward C, Beakgoubé H, Baker K, Donovan L, et al. Health management information system (HMIS) data quality and associated factors in Massaguet district, Chad. BMC Med Inform Decis Mak. 2021;21(1):326. pmid:34809622
  6. 6. FMOH. HIV/AIDS data quality and information use training participant manual. 2021.
  7. 7. Ethiopian Ministry of Health. Health Sector Transformation Plan II 2020/2021-2024/2025. 2021.
  8. 8. WHO. Data quality assessment of national and partner HIV treatment and patient monitoring systems. 2018.
  9. 9. Aborode AT, Alexiou A. HIV/AIDS epidemic and COVID-19 pandemic in Africa. Front Genet. 2021.
  10. 10. Nicol E, Dudley L, Bradshaw D. Assessing the quality of routine data for the prevention of mother-to-child transmission of HIV. 2016.
  11. 11. Banze AR, Boothe MA. Evaluation of prevention of mother-to-child transmission national health information system for hiv/aids, in southern region of Mozambique, April to November 2016. Pan Afr Med J. 2021.
  12. 12. FMOH. Facility level ART data quality improvement initiative. 2021.
  13. 13. Abiy R, Gashu K. A comparison of electronic records to paper records in antiretroviral therapy clinic in Ethiopia: what is affecting the quality of the data?. Online J Public Health Inform. 2018.
  14. 14. O’Hagan R, Marx MA, Finnegan KE, Naphini P, Ng’ambi K, Laija K, et al. National assessment of data quality and associated systems-level factors in Malawi. Glob Health Sci Pract. 2017;5(3):367–81. pmid:28963173
  15. 15. Ministry of health Ethiopipia. EMR-ART providers view training package. 2021.
  16. 16. Ministry of health of Ethiopia. Health management information system indicators. 2018.
  17. 17. Federal Democratic Republic of Ethiopia. Federal democratic republic of ethiopia national quality improvement. 2018.
  18. 18. U.S. Department of Health and Human Services Centers for Disease Control and Prevention, Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: a self-study guide. Atlanta, GA: Centers for Disease Control and Prevention; 2011.
  19. 19. Glance ATA. Findings of a mixed method assessment in Liberia. 2021.
  20. 20. Addisuu B. Assessment of health management information system (HMIS) implementation in South West Shewa Zone, Oromia, Central Ethiopia. 2020.
  21. 21. Yarinbab TE, Assefa MK. Utilization of HMIS data and its determinants at health facilities in East Wollega Zone, Oromia Regional State, Ethiopia. 2018.
  22. 22. Tadesse K. Process evaluation of health management information system implementation status in public health facilities of Mekelle Zone, Tigray, Ethiopia. 2017.
  23. 23. Ministry of Health E. EMR-ART providers view training package. 2021.
  24. 24. Teklegiorgis K, Dawa D. Level of data quality from HMIS in a resources limited setting and its associated factors, eastern Ethiopia. 2016.
  25. 25. Solomon M, Addise M. Data quality assessment and associated factors in the HMIS among health centers of Southern Ethiopia. 2021.
  26. 26. Kebede M, Adeba E. Evaluation of quality and use of health management information system in primary health care units of east Wollega zone, Ethiopia. 2020.
  27. 27. Shama AT, Roba HS. Assessment of quality of routine HIS data and associated factors among departments in public health facilities of Harari region, Ethiopia. 2021.
  28. 28. Getachew N, Erkalo B, Garedew MG. Data quality and associated factors in the health management information system at health centers in Shashogo district, Hadiya zone, southern Ethiopia. 2021.
  29. 29. UNAIDS. Global HIV and AIDS statistics Fact sheet. 2022. https://www.unaids.org/en/resources/fact-sheet
  30. 30. Dagnew E, Woreta SA, Shiferaw AM. Routine health information utilization and associated factors among health care professionals working at public health institution in North Gondar, Northwest Ethiopia. BMC Health Serv Res. 2018;18(1):685. pmid:30180897
  31. 31. USAIDS. Performance of routine information system management. 2019.