Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Health systems performance in health outcomes, health financing and COVID-19 pandemic: Lessons from 31 countries

  • Pirhossein Kolivand ,

    Roles Conceptualization, Investigation, Validation

    ‡ Contributed equally as the first authors.

    Affiliations Research Center for Emergency and Disaster Resilience, Red Crescent Society of the Islamic Republic of Iran, Tehran, Iran, Department of Health Economics, Faculty of Medicine, Shahed University, Tehran, Iran

  • Jalal Arabloo ,

    Roles Project administration, Writing – original draft, Writing – review & editing

    ‡ Contributed equally as the first authors.

    Affiliation Health Management and Economics Research Center, Iran University of Medical Sciences, Tehran, Iran

  • Peyman Saberian,

    Roles Data curation, Resources

    Affiliations Research Center for Emergency and Disaster Resilience, Red Crescent Society of the Islamic Republic of Iran, Tehran, Iran, Department of Anesthesiology, Imam Khomeini Hospital Complex, Tehran University of Medical Sciences, Tehran, Iran

  • Taher Dorooudi,

    Roles Methodology, Writing – review & editing

    Affiliation Research Center for Emergency and Disaster Resilience, Red Crescent Society of the Islamic Republic of Iran, Tehran, Iran

  • Soheila Rajaie,

    Roles Data curation, Writing – original draft

    Affiliation Research Center for Emergency and Disaster Resilience, Red Crescent Society of the Islamic Republic of Iran, Tehran, Iran

  • Fereshte Karimi,

    Roles Data curation, Validation, Writing – original draft

    Affiliation Research Center for Emergency and Disaster Resilience, Red Crescent Society of the Islamic Republic of Iran, Tehran, Iran

  • Behzad Raei,

    Roles Software, Writing – original draft

    Affiliation Department of Health, Safety, and Environment Management, School of Public Health, Zanjan University of Medical Sciences, Zanjan, Iran

  • Masoud Behzadifar,

    Roles Data curation, Writing – original draft

    Affiliation Social Determinants of Health Research Center, Lorestan University of Medical Sciences, Khorramabad, Iran

  • Arash Parvari,

    Roles Formal analysis, Methodology, Writing – original draft

    Affiliation Department of Epidemiology and Biostatistics, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran

  • Seyed Jafar Ehsanzadeh,

    Roles Writing – review & editing

    Affiliation English Language Department, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran

  • Saeid Homayoun,

    Roles Conceptualization, Writing – review & editing

    Affiliation Faculty of Education and Economics, University of Gävle, Gävle, Sweden

  • Shahrzad Salehbeigi,

    Roles Writing – review & editing

    Affiliation Department of Cardiology, ST. Antonius Hospital, Cologne, Germany

  • Peyman Namdar,

    Roles Writing – original draft

    Affiliation Department of Emergency Medicine, Metabolic Disease Research Center, Qazvin University of Medical Sciences, Qazvin, Iran

  • Samad Azari

    Roles Conceptualization, Investigation, Writing – original draft, Writing – review & editing

    samadazari1010@gmail.com

    Affiliation Health Management and Economics Research Center, Iran University of Medical Sciences, Tehran, Iran

Abstract

Background

ssssHealth system performance is a multifaceted concept that encompasses various dimensions of a nation’s healthcare infrastructure. This study aims to assess and rank the performance of health systems across different regions of the world.

Methodology

We employed the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) method in 2023 to evaluate and rank the health system performance of 31 countries across six geographical regions. Our evaluation included six general categories and twelve indicators related to health, finance, and the COVID-19 pandemic. The final weights for these indicators were determined using the Three-scale method and the Entropy-weighting method. Additionally, we categorized health system performance into three groups: high, moderate, and low. Hierarchical clustering of health system performance scores was conducted using SPSS software (version 26).

Results

Luxembourg emerged as the only high-performing health system, while Qatar and the Netherlands fell into the moderate-performance group. Other countries exhibited low-performing health systems. Notably, within the low-performance group, the United States of America, Australia, Singapore, Canada, England, and Germany achieved relatively better rankings. Conversely, Yemen, Egypt, Afghanistan, and Bolivia ranked lowest in terms of health system performance.

Conclusion

Contrary to the assumption that higher health spending guarantees improved performance, the experience of COVID-19 among high-income countries revealed mixed results. Strengthening resilience, investing in public health systems, and ensuring sustainable financial resources are crucial for enhancing health system performance.

1. Background

The healthcare system encompasses all organizations, institutions, resources, and personnel working toward the common goal of improving societal health. These activities involve addressing factors that influence health and directly enhancing the well-being of the population [1]. Health system frameworks serve as conceptual tools that delineate and describe the objectives of the health system, as well as the factors influencing its performance [2].

Health Systems Performance (HSP) involves a comprehensive assessment and quantification of a health system’s effectiveness, efficiency, equity, and quality in achieving its goals. This evaluation entails continuous monitoring, analysis, and dissemination of data across various dimensions of the health system, including governance, financial management, resource allocation, service delivery, and health outcomes. The primary purpose is to provide evidence-driven insights to policymakers, enabling informed decision-making, prioritization of interventions, and optimization of overall health system functionality to address the dynamic challenges of contemporary healthcare. The evaluation framework must recognize the interconnectedness of diverse health system domains and objectives, emphasizing inputs, processes, outputs, outcomes, and impacts to ensure transparency, accountability, and ongoing improvements in healthcare delivery and public health outcomes [3].

Numerous frameworks have been proposed to measure HSP. These frameworks consider various indicators, including health goals, health inequalities, coverage, sustainable and equitable financing, quality, patient satisfaction, allocation efficiency, technical efficiency, cost-effectiveness, political acceptability, and financing mechanisms [46]. The World Health Organization (WHO) report in 2000 distinguishes between final goals (such as responsiveness and fair financing) and intermediate goals within health systems. It emphasizes that intermediate goals play a pivotal role in achieving the ultimate objectives. Accurate measurement of goals and HSP, informed decision-making processes, and policy adoption are essential. For instance, one criterion for assessing performance is the level of coverage achieved [7].

At the national level, healthcare systems exhibit significant variations in outcomes, even among countries with similar income levels. Some of these disparities can be attributed to differences in HSP. Consequently, healthcare policymakers should assess HSP at all levels, identify factors influencing access to and utilization of health services, and formulate policies to enhance population health. However, it is essential to recognize that improvements in availability and access, especially in resource-constrained settings, do not always directly translate into better health outcomes [8].

Strengthening healthcare systems necessitates developing management capacity across all levels. Key competencies for healthcare system management include strategic thinking, human resource management, financial stewardship, performance evaluation, governance, leadership, and community engagement [9].

Numerous countries have established mechanisms to evaluate the performance of their health systems. In the United States, the National Scorecard by the Commonwealth Fund assesses health system performance (HSP) across domains such as health outcomes, quality, and equity [10]. Belgium conducts a periodic (HSPA) using 80 indicators. England closely monitors the National Health Service (NHS) through an extensive range of indicators [11]. Meanwhile, the Netherlands publishes a biennial Health Care Performance Report, focusing on quality, access, and cost considerations [12]. In Africa, South Africa’s Health Systems Trust releases a district health barometer [13], while Uganda and Ghana employ various tools, including league tables and comprehensive assessments, to evaluate HSP. Despite extensive research on Health System Performance Assessments (HSPA) in high-income countries, low-income countries have fewer documented experiences, underscoring the need for further investigation in this area [14].

In Iran, HSP has undergone evaluation. The results indicate that Iran’s health system has made progress in achieving universal health coverage (UHC). However, challenges persist in resource utilization, necessitating opportunities for enhancing technical efficiency. Studies emphasize that improving Iran’s health system performance requires better implementation, resource provision, facility management, and effective governance [15].

Recent years have witnessed the profound impact of the COVID-19 pandemic on health systems worldwide. This global crisis has rigorously tested the resilience and performance of health systems, prompting the World Health Organization (WHO) to underscore the importance of assessing its impact on HSP using key indicators. Research highlights the imperative for health systems to enhance preparedness and response capabilities to effectively manage future public health emergencies. Furthermore, the pandemic underscores the significance of universal health coverage, robust public health infrastructure, and intergovernmental coordination in optimizing HSP during crises. Understanding and measuring the effects of pandemics on health systems are critical for informed policy decisions and strengthening health systems to better respond to future public health challenges, drawing insights from successful practices in high-performing countries [1618].

Given this, the aim of this study is to assess health system performance in selected countries and compare it with Iran. The findings will provide comprehensive information based on healthcare indicators, informing policy-making in this sector.

2. Methods

2.1. Study design

The Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) method, developed by Hwang and Yoon in 1981, employs the concept of positive and negative ideal solutions as benchmarks for evaluating and ranking performance across units of analysis [19]. This method assesses the strengths and weaknesses of existing objects by ranking them based on their proximity to these idealized targets. The ranking process involves measuring the distance between each evaluation object and both the best and worst solutions [20,21]. The TOPSIS method can be summarized in the following steps [22]:

  1. Calculate the Decision Matrix after Normalization.
  2. Calculate the Decision Matrix after Normalization and Weighting.
  3. Determine the Positive-Ideal and Negative-Ideal Solutions.
  4. Calculate Separation Measures using n-Element Euclidean Distance.
  5. Calculate the Relative Closeness to the Ideal Solution, which ranges from zero to one.
  6. Rank the Preference Order.

The TOPSIS method is highly objective, eliminating the influence of subjective factors and maximizing the utilization of original data with minimal loss of information [23]. Consequently, it has found effective application in various research domains, including supply chain management, logistics, engineering, and business systems. Notably, it is well-suited for risk assessment and evaluating system performance [24].

2.2. Study area and data source

This study employs the TOPSIS method to evaluate and rank health system performance (HSP) across six global regions: Africa, North America, South America, Europe, the Middle East, and Asia Pacific [25]. The study aims to compare health system performance. Due to practical constraints, it was not feasible to include every country from the analyzed regions. Therefore, a purposive sampling approach was adopted, resulting in the selection of 31 countries. These countries were chosen based on criteria such as GDP level, population size, COVID-19 indices, and healthcare expenditure. Specifically, countries with low, middle, and high GDP levels, along with other relevant indicators, were included from each region (see Fig 1). The HSP in these selected countries was evaluated and ranked using desired performance indicators. Data were sourced from the World Health Organization (WHO) database and the Institute for Health Metrics and Evaluation (IHME), which provides data and resources from the Global Burden of Disease Study (GBD). All data is free and accessible.

thumbnail
Fig 1. Countries included in this study.

The current map includes the selected countries based on the indicators of GDP, population, cases of the COVID-19 and health expenditure of a range of low, moderate and high countries. The 6 regions included Africa, North America, South America, Europe, the Middle East, and Asia Pacific.

https://doi.org/10.1371/journal.pone.0334693.g001

2.3. Calculation methodology

In this study, we delineate the following components of our research methodology:

  1. 1. Framework Design:
    1. ◦. We initially crafted a comprehensive framework for evaluating health system performance (HSP) based on three critical dimensions: health indicators, financial indicators, and COVID-19 impact. Drawing upon existing frameworks, including the World Health Organization’s six building blocks [2,4,26], we aimed to create a robust assessment tool.
    2. ◦. Health Indicators: Our selected health indicators include Neonatal Mortality Rate (NMR), Maternal Mortality Ratio (MMR), Healthcare Access and Quality Index (HAQ), Health-Adjusted Life Expectancy (HALE), and Non-Communicable Disease (NCD) prevalence.
    3. ◦. Financial Indicators: We considered Out-of-Pocket Spending, Prepaid Private Spending, Government Spending, and GDP per Capita as essential financial metrics.
    4. ◦. COVID-19 Indicators: To account for the pandemic’s impact, we incorporated Total Cases, Total Deaths, and Total Vaccinations related to COVID-19.
  2. 2. Weight Assignment:
    1. ◦. Next, we assigned weights to each indicator using a combination of established weighting methods. These weights reflect the relative importance of each dimension in assessing HSP.
  3. 3. Composite Index Calculation:
    1. ◦. Leveraging available data, we computed a composite index that allows us to measure HSP across selected countries globally. Our primary objective is to rank these countries using the Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) method.
  4. 4. Hierarchical Cluster Analysis:
    1. ◦. We employed Hierarchical Cluster Analysis to group countries based on their performance in the three dimensions: COVID-19 impact, financing, and health system.
  5. 5. Country Clustering:
    1. ◦. Using the Complete Linkage method, we clustered countries into three classes: high, moderate, and low performers

The Fig 2 shows the selected indicators to evaluate the HSP. By reviewing the existing literature and performance frameworks, the researchers proposed a framework to compare the performance of countries. In this framework, various indicators were selected in the three areas of financing, health and indicators related to COVID-19.

thumbnail
Fig 2. Indicators included in this study (HSP Framework).

https://doi.org/10.1371/journal.pone.0334693.g002

2.3.1. The HSP framework.

Assessing health system performance (HSP) through a combination of quantitative and qualitative methods represents an effective approach to fortifying national health systems. This comprehensive evaluation provides a holistic understanding of system strengths and weaknesses, empowering policymakers to make informed decisions for enhancement [13,27]. By scrutinizing the World Health Organization’s (WHO) HSP framework [4] and integrating insights from relevant studies and the objectives of our study, we constructed an evaluation index framework for quantitative analysis of HSP (see Fig 2).

2.3.2. Index weighting.

In this study, we employed a hybrid approach, combining the Three-Scale method and the Entropy-Weighting method, to determine the final weights for the indicators. This approach ensures a robust and objective assessment of each indicator’s importance in the overall evaluation of the studied topic. The Entropy-Weighting method yields estimates comparable to propensity score methods, enhancing the reliability of our weight assignments [28]. Additionally, the Three-Scale method offers practical advantages, facilitating expert judgments, constructing a priority judgment matrix, and logically ranking priorities [29].

2.3.3. Classification of HSP.

To cluster countries based on their health system performance, we utilized version 26.0 of the SPSS software. Hierarchical clustering was applied to HSP scores for 31 countries across six global regions. To determine the optimal number of clusters, we employed the Silhouette method. Our analysis revealed that three clusters best represent the data (see Fig 3). Employing the Complete Linkage method, we categorized countries into three classes: high, moderate, and low performers. The Complete Linkage method, a hierarchical clustering technique, considers the maximum distance between any two points in different clusters, facilitating the identification of distinct groups based on the similarity of HSP scores among countries.

2.4. Ranking countries based on indicators

In addition to employing the TOPSIS method, we conducted a comparative analysis of 31 countries included in the study. These countries were ranked based on health, financial, and COVID-19 indicators for the years 2000, 2019, 2020, and 2023 (for COVID-19). The objective was to provide a comprehensive overview of each country’s performance relative to the selected indicators.

2.5. Ethical approval

This study is an excerpt from the research project with the Ethical Code IR.RCS.REC.1401.013 from the Iranian Red Crescent Society, conducted at the Research Center for Emergency and Disaster Resilience, Red Crescent Society of the Islamic Republic of Iran, Tehran, Iran.

3. Results

3.1. Clustering of countries

To analyze and discuss health system performance, we achieved optimal results by clustering the 31 countries into three distinct groups (K = 3). Fig 4 illustrates the cluster chart generated through hierarchical cluster analysis, visually representing the clustering outcomes. Additionally, Table 1 presents the division of countries into three categories: high, moderate, and low performance, facilitating a clear understanding of each country’s health system performance classification.

thumbnail
Table 1. Health system performance by the clustering countries.

https://doi.org/10.1371/journal.pone.0334693.t001

Furthermore, we created a global map (Fig 5) displaying health system performance values. This visual representation highlights variations across different regions and countries, aiding in the identification of areas that require targeted interventions and improvements.

thumbnail
Fig 5. Global distribution of HSP assessment and ranking (31 countries).

https://doi.org/10.1371/journal.pone.0334693.g005

Table 1 shows the ranking results of the countries in the order of high, Moderate and low performance.

In our analysis, the majority of countries were classified in the category of low performance. Using the method of clustering countries based on their performance, one country (Luxembourg) had high performance, while two countries (Switzerland and Qatar) had moderate performance. On the other hand, 28 countries, including Iran, had low performance.

3.2. Ranking countries with TOPSIS method

Table 2 presents the ranking of the HSP of the 31 countries. The three countries, Luxembourg, Switzerland, and Qatar, are ranked in the top three among 31 countries and have shown better performance in terms of health, financing, and COVID-19 indicators. In this ranking, Iran is ranked 21st. On the other hand, the three countries of Afghanistan, Egypt, and Yemen occupied the bottom three ranks and did not perform well (Table 2).

thumbnail
Table 2. Global health system performance rankings of the 31 countries.

https://doi.org/10.1371/journal.pone.0334693.t002

3.3. Ranking countries with the value of indicators

3.3.1. Health indicators.

Table 3 shows the ranking of the countries for the MMR and NMR indicators. These rankings are arranged for the years 2000 and 2019. Also, the change in the rank of each country in the form of red and green arrows has shown the deterioration or improvement of the situation of each country. For example, the Australia had the best status in the MMR index in 2000, while in 2019, it had a decrease in this index. While the rank of Egypt improved and moved from 21st to 13th. For the index NMR the Singapore has been the best in both years. While the Afghanistan is still at the bottom of the ranking table (Table 3).

Table 4 shows the ranking of the HALE and the Non-Communicable Diseases rate indicators. Iran has improved the most in the HALE index, its rank has changed from 17 to 12. In the Non-Communicable Diseases rate index, Afghanistan’s rank has improved from 20 to 9 and has changed the most (Table 4).

3.3.2. Financial indicators.

In Table 5, the ranking of financial indicators is shown. The status of the out-of-pocket spending indicator shows that the Libya and the Singapore have improved the most, while the Yemen and the Ukraine have had the biggest decline in the ranking. Also, the status of the index shows that Iran has improved the most and Syria has decreased the most. Switzerland and Cuba remain unchanged at the top and bottom of the table, respectively (Table 5).

thumbnail
Table 5. Ranking of 31 countries (Out of Pocket Spending & Prepaid Private Spending Indices).

https://doi.org/10.1371/journal.pone.0334693.t005

The status of the Government spending and the GDP per capita indicators is shown in the Table 6. The Yemen dropped 11 ranks in the Government spending indicator. China also improved the most with a change of 13 ranks. GDP per capita indicator had the most improvement and 10 rank changes in the years 2000–2019. The Syria also had the biggest decrease with 15 degrees (Table 6).

thumbnail
Table 6. Ranking of 31 countries (Government Spending & GDP per capita Indices).

https://doi.org/10.1371/journal.pone.0334693.t006

3.3.3. COVID-19 indicators.

Given the recent emergence of COVID-19, this section covers a distinct time frame. We present rankings for two key indicators: the number of deaths and vaccinations (see Table 7).

thumbnail
Table 7. Ranking of 31 countries (Deaths of COVID-19 & Vaccinations of COVID-19).

https://doi.org/10.1371/journal.pone.0334693.t007

  1. 1. Number of Deaths:
    1. ◦. We investigated deaths from 2020 to 2023.
    2. ◦. Notably, the United States consistently ranked at the bottom during this period.
    3. ◦. Luxembourg demonstrated significant improvement, moving from 10th to 5th place.
  2. 2. Vaccination Indicator:
    1. ◦. In terms of vaccinations, China, the United States, Brazil, and Germany maintained their top positions from 2021 to 2023.
    2. ◦. Conversely, Yemen, Haiti, and Dominica remained at the bottom of the list.

For a visual representation of global health system performance, refer to the HSP map in Fig 5. This map highlights variations across regions and countries, aiding in identifying areas that require targeted interventions and improvements.

4. Discussion

4.1. The framework of health system performance (HSP)

The primary objective of our study is to evaluate Iran’s health system performance in comparison to that of other selected countries. To achieve this, we employed a set of indicators related to health (Neonatal Mortality Rate, Maternal Mortality Ratio, Healthcare Access and Quality Index, Health-Adjusted Life Expectancy, and Non-Communicable Disease prevalence), COVID-19 (Total Cases, Total Deaths, and Total Vaccination), and financing (Out-of-Pocket Spending, Prepaid Private Spending, Government Spending, and GDP per Capita).

Several frameworks have been designed to assess HSP. Notably, the integrated healthcare performance framework proposes a range of indicators, including accountability, fair financial participation, efficiency, access, quality, value maintenance, and employee motivation [30]. Additionally, the World Health Organization (WHO) health framework evaluates HSP across four key areas: management, resource generation, service provision, and financing [5].

In our study, we critically examined various frameworks for evaluating HSP, aligning them with our research objectives. Given the significant impact of the COVID-19 pandemic on health systems, we separately evaluated its effects.

4.2. High-performing countries

Among the 31 countries assessed, Luxembourg emerges as the top performer. Its healthcare system ranks among the twelve most effective in Europe. Other high-performing systems include those in the Netherlands, Austria, Belgium, Denmark, Finland, France, Germany, Norway, Sweden, Switzerland, and the United Kingdom. These systems excel across various criteria, including access, health status, flexibility, innovation, quality, and resilience. Resilience, in particular, refers to a health system’s ability to meet future population needs and adapt to innovations [31].

In Luxembourg, key institutions driving health system effectiveness include the Ministry of Health and the Social Security. These entities collaborate closely, make joint decisions, and assume responsibility for organizing, legislating, and financing the healthcare system [32]. Notably, Luxembourg boasts the second-highest health expenditure per capita among European countries affiliated with the World Health Organization. Additionally, it holds the highest GDP per capita in Europe [31].

4.3. Countries with moderate performance

  1. 1. Switzerland:
    1. ◦. Switzerland ranks as the second-best country among the 31 countries in terms of health system performance (HSP).
    2. ◦. The Swiss healthcare system is widely recognized as one of the world’s best. It operates under a mandatory health insurance (MHI) system, compulsory for all residents since 1996 [33].
    3. ◦. Despite its strengths, the Swiss system faces challenges due to its fragmented and federal structure, necessitating greater integration of care.
    4. ◦. While the system boasts high life expectancy and generally satisfies the population in terms of accessibility and quality of care, concerns persist regarding the representation of healthcare system users and the influence of patient lobbies.
    5. ◦. Efforts to promote integrated care are viewed as a means to enhance HSP in Switzerland [3437].
  2. 2. Qatar:
    1. ◦. Qatar holds the second rank among countries with moderate performance and also ranks third overall among the 31 countries.
    2. ◦. To address COVID-19 challenges, Qatar established a centralized digital platform through a community call center. Initially, it provided digital counseling via a hotline and later expanded to include a mass immunization COVID-19 vaccination hotline [38].
    3. ◦. Qatar has made significant strides in improving its healthcare system, investing heavily in infrastructure, research, and technology.
    4. ◦. Challenges remain, including the need for more medical workers in primary healthcare and addressing inequitable geographic distribution of healthcare resources [39,40].

4.4. Countries with low performance

In this study, we examine the performance of various countries, focusing on those that exhibit suboptimal outcomes. Among the nations analyzed, the United States, Australia, and Singapore secured the top three positions, ranking first, second, and third, respectively. Notably, they placed 4th, 5th, and 6th within the cohort of 31 countries.

The United States health system presents a complex landscape characterized by both strengths and vulnerabilities. On the positive side, it boasts a substantial and well-trained health workforce, a diverse array of high-quality medical specialists, and robust secondary and tertiary institutions. However, it grapples with several challenges. These include incomplete coverage for its citizenry, disproportionately high health expenditure per capita compared to other nations, subpar performance on objective and subjective quality measures, and an uneven distribution of resources and outcomes across different regions and population groups [4143].

Turning our attention to Australia, its healthcare system centers around Medicare, which provides access to medical and hospital services for all Australian residents. Under this system, health professionals—including general practitioners, specialists, and optometrists—offer free or subsidized treatment. Additionally, public patients receive free care in public hospitals [44]. Despite the widespread availability of public services, public funding, and private health insurance [45], out-of-pocket expenditure (OOPE) still accounts for 20% of total healthcare spending across the OECD. This raises equity concerns, particularly for individuals with chronic conditions and greater healthcare needs, especially when those needs coincide with lower income [46].

At the other end of the spectrum, Afghanistan, Egypt, and Yemen occupy the lowest positions. Afghanistan, having endured two decades of war and the collapse of health institutions, embarked on healthcare system reforms, including primary healthcare, in 2002. However, the reality is starkly different from the perception that it relies solely on donor support. A significant portion of the country’s total health expenditure is directly borne by households [47]. Notably, Afghanistan topped the list of out-of-pocket payments among the 31 countries in 2020, with approximately 77.58%. This ranking underscores the profound impact of war on the nation’s healthcare system (WHO indicators, 2020).

Yemen, situated as one of the poorest countries in the Middle East, faces a prolonged conflict resulting from decades of political, economic, and social challenges. The ongoing war has severely affected public services, particularly the health sector, which now operates at less than half its capacity. Approximately 30.5 million Yemenis, of whom around 20.7 million require comprehensive humanitarian assistance, bear the brunt of this crisis. With over 80% of Yemen’s population living below the poverty line, it stands as one of the most severe humanitarian crises globally [48]. Yemen’s collapsing health system poses a grave threat to the well-being of its population [49].

Regarding out-of-pocket payments in 2020, Yemen ranks 30th out of 31 countries, with 63.96% (WHO indicators, 2020). The government’s share in health payments remains small at 28.24 percent. High out-of-pocket expenses place a heavy burden on households, leading to catastrophic health expenditure [50]. Overall, Yemen occupies the last position in the ranking.

4.5. Health system performance in Iran

The study results indicate that Iran ranks 21st among the 31 countries under comparison. Furthermore, Iran falls into the category of countries with low performance, securing the 18th position within this group.

The program aimed at reforming Iran’s healthcare system was initially devised before the 1979 revolution and subsequently implemented by health officials [51]. However, when benchmarked against Middle Eastern and Asian counterparts, Iran’s performance in certain health indices remains unsatisfactory. For instance, the response rate in the Iranian health system stands at 67% for outpatient services and 73% for inpatient services—figures lower than those observed in Brazil and 14 European countries (where response rates exceed 81%) [52]. Additionally, approximately 70% of medical costs are borne by patients, annually pushing around 7% of the Iranian population below the poverty threshold [53].

The fourth five-year development plan highlights several challenges. These include an aging population, rising costs of care and health services, inadequate control of non-communicable diseases, increased prevalence of physical, mental, and social health conditions, and limited access to medical services in less developed regions. Furthermore, low satisfaction with paraclinical and non-essential services, coupled with escalating out-of-pocket payments, poses significant hurdles for national health officials [54].

The harsh economic sanctions against Iran constitute a major obstacle in implementing the Health System Reform Plan (HSRP). Although these sanctions ostensibly exclude food and medicines, limitations on financial transactions between Iran and the rest of the world, along with resource shortages due to the sanctions, have led to medicine scarcity within the Iranian health system. Consequently, the quality of domestically produced medicines used in medical services has declined [55].

Iran’s unique geographic context, mass immigration from neighboring Afghanistan and Iraq, regional conflicts, insecurity, and illicit drug trafficking across its eastern borders with Pakistan and Afghanistan have collectively impacted the nation’s health system [56].

Before the Islamic revolution, Iran witnessed over 5,000 maternal deaths annually, with a population of 35 million and an estimated 500,000 births per year. Presently, the absolute number of maternal deaths has decreased to less than 300 per year, despite ongoing challenges. Notably, Iran achieved Millennium Development Goal number 5 in 2008, seven years ahead of schedule [57]. In terms of maternal mortality rate in 2019, Iran ranked 16th among the 31 countries. Similarly, it held the 18th position for neonatal mortality rate within the same cohort (2019 data) [58].

Out-of-pocket (OOP) payments constitute over 50% of Iran’s total healthcare costs, surpassing levels reported in other countries. This high OOP burden is closely associated with catastrophic health expenditure (CHE) and healthcare financing inequality. A study revealed that more than 5% of Iranian households experience CHE, with greater prevalence among those with lower socioeconomic status [59].

Over the past three decades, Iran has witnessed a significant increase in life expectancy. While its healthcare system has effectively controlled infectious diseases, it now grapples with the mounting burden of non-communicable diseases and injuries. Notably, Iran’s health system has been more successful in reducing mortality rates than in managing complications and addressing mental health issues. This underscores the urgent need to expand rehabilitation services and integrate mental healthcare into primary care. Furthermore, Iran’s healthcare system must enhance its preparedness and resilience to emerging health threats, as exemplified by the experience during the COVID-19 pandemic [60].

The evaluation of Iran’s Health System Performance (HSP) and financing, in comparison with 30 selected countries, has revealed both strengths and weaknesses. While the country’s health financing system exhibits relative stability, it remains fragile. Key factors, including politics, economics, and technology, significantly shape its structure [61].

However, this study faces limitations. Global Burden of Disease (GBD) studies have encountered criticism for various reasons. Doubts persist regarding the reliability and comprehensiveness of data sources, challenges in accurately quantifying certain health conditions, biases in data collection and modeling, and the intricate task of assessing the impact of environmental and social factors on health indicators. These criticisms have sparked debates about the accuracy and comparability of GBD estimates [62,63]. Another limitation pertains to data accessibility. Although numerous variables influence Health System Performance (HSP), our inability to access certain data prevented their inclusion in the country ranking.

Nevertheless, a notable strength of this study lies in its proposed framework and the comparison of countries across different economic and geographical levels. The examination of high-income countries such as the US and UK alongside low-income countries like Yemen and Nigeria provides valuable insights. Additionally, our focus on macro indicators related to health systems sheds light on crucial dimensions affecting overall performance.

5. Conclusion

The present study aimed to evaluate and rank Health System Performance (HSP). We selected 12 distinct variables from three levels: health, financial, and Covid-19 indicators. To determine the weight of each variable across the 31 surveyed countries, we employed a combination of three-scale weighting methods and entropy weighting methods. Subsequently, we ranked health system performance using the TOPSIS method and classified countries into three groups using hierarchical clustering.

The study results revealed substantial disparities in HSP. Only Luxembourg demonstrated strong performance, while Qatar and Switzerland achieved moderate rankings. The remaining countries fell into the group with poor performance. Generally, countries with favorable HSP were predominantly from Europe and North America. In the Middle East, only Qatar achieved an average performance, while South American and African countries also struggled with poor performance.

The variation in health system performance arises from multiple factors, including financing systems, health indicators, and economic and social development. Low-performing countries often grapple with insecurity and political instability, lacking sufficient financial resources to enhance health structures. Additionally, the rise in non-communicable diseases poses significant challenges. The Covid-19 pandemic further exacerbated these issues, imposing additional health and financial burdens on systems already strained by limited and unstable resources.

To enhance health system performance, countries must reduce patients’ out-of-pocket payments and catastrophic health costs by bolstering sustainable financial resources. Developed nations, with greater financial capacity and strengthened health structures, serve as valuable models. Developing countries can learn from their experiences and focus on resource efficiency to achieve better economic and health outcomes.

Supporting information

References

  1. 1. Organization WH. Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. World Health Organization; 2010.
  2. 2. Papanicolas I, Rajan D, Karanikolos M, Soucat A, Figueras J. Health system performance assessment: a framework for policy analysis. World Health Organization; 2022.
  3. 3. Lessof S, Azzopardi Muscat N, Permanand G, Figueras J. Health system performance assessment: A renewed global framework for policy-making. UN City, Denmark: Regional Office for Europe; 2022.
  4. 4. Murray CJ, Frenk J, Organization WH. A WHO framework for health system performance assessment. 1999.
  5. 5. Murray CJ, Frenk J. A framework for assessing the performance of health systems. Bull World Health Organ. 2000;78(6):717–31. pmid:10916909
  6. 6. Reich M. World bank, world development report 1993: investing in health. Economic Development and Cultural Change. 1997;45:899–903.
  7. 7. Organization WH. The world health report 2000: health systems: improving performance: World Health Organization; 2000.
  8. 8. Colston J. The use of effective coverage in the evaluation of maternal and child health programs. Washington DC: Inter-American Development Bank; 2011.
  9. 9. Bradley EH, Taylor LA, Cuellar CJ. Management Matters: A Leverage Point for Health Systems Strengthening in Global Health. Int J Health Policy Manag. 2015;4(7):411–5. pmid:26188805
  10. 10. Schoen C, Davis K, How SK, Schoenbaum SC. US health system performance: a national scorecard: the United States would have to improve its performance on key indicators by 50 percent or more to reach benchmark rates. Health Aff. 2006;25(Suppl1):W457-75.
  11. 11. Lakhani A, Coles J, Eayres D, Spence C, Rachet B. Creative use of existing clinical and health outcomes data to assess NHS performance in England: part 1—performance indicators closely linked to clinical care. BMJ. 2005;330(7505):1426–31.
  12. 12. van den Berg MJ, Kringos DS, Marks LK, Klazinga NS. The Dutch Health Care Performance Report: seven years of health care performance assessment in the Netherlands. Health Res Policy Syst. 2014;12:1. pmid:24405849
  13. 13. Tashobya CK, da Silveira VC, Ssengooba F, Nabyonga-Orem J, Macq J, Criel B. Health systems performance assessment in low-income countries: learning from international experiences. Global Health. 2014;10:5. pmid:24524554
  14. 14. Edward A, Kumar B, Kakar F, Salehi AS, Burnham G, Peters DH. Configuring balanced scorecards for measuring health system performance: evidence from 5 years’ evaluation in Afghanistan. PLoS Med. 2011;8(7):e1001066. pmid:21814499
  15. 15. Sajadi HS, Goodarzi Z, Takian A, Mohamadi E, Olyaeemanesh A, Hosseinzadeh Lotfi F, et al. Assessing the efficiency of Iran health system in making progress towards universal health coverage: a comparative panel data analysis. Cost Eff Resour Alloc. 2020;18:20. pmid:32612458
  16. 16. Poroes C, Seematter-Bagnoud L, Wyss K, Peytremann-Bridevaux I. Health System Performance and Resilience in Times of Crisis: An Adapted Conceptual Framework. Int J Environ Res Public Health. 2023;20(17):6666. pmid:37681806
  17. 17. Moolla I, Hiilamo H. Health system characteristics and COVID-19 performance in high-income countries. BMC Health Serv Res. 2023;23(1):244. pmid:36915154
  18. 18. Markowicz I, Rudawska I. Struggling with COVID-19—A Framework for Assessing Health System Performance. Sustainability. 2021;13(20):11146.
  19. 19. Tzeng GH, Huang JJ. Multiple attribute decision making: methods and applications. CRC Press; 2011.
  20. 20. Chakraborty S. TOPSIS and Modified TOPSIS: A comparative analysis. Decision Analytics Journal. 2022;2:100021.
  21. 21. Ren L, Zhang Y, Wang Y, Sun Z. Comparative analysis of a novel M-TOPSIS method and TOPSIS. Applied Mathematics Research eXpress. 2007;2007:abm005.
  22. 22. Jahanshahloo GR, Lotfi FH, Izadikhah M. Extension of the TOPSIS method for decision-making problems with fuzzy data. Applied Mathematics and Computation. 2006;181(2):1544–51.
  23. 23. Zhao L, Li D, Guo X, Xue J, Wang C, Sun W. Cooperation risk of oil and gas resources between China and the countries along the Belt and Road. Energy. 2021;227:120445.
  24. 24. Zhao L, Jin Y, Zhou L, Yang P, Qian Y, Huang X, et al. Evaluation of health system resilience in 60 countries based on their responses to COVID-19. Front Public Health. 2023;10:1081068. pmid:36699903
  25. 25. Haldane V, De Foo C, Abdalla SM, Jung A-S, Tan M, Wu S, et al. Health systems resilience in managing the COVID-19 pandemic: lessons from 28 countries. Nat Med. 2021;27(6):964–80. pmid:34002090
  26. 26. European Observatory Health Policy Series. In: Papanicolas I, Rajan D, Karanikolos M, Soucat A, Figueras J, editors. Health system performance assessment: A framework for policy analysis. Copenhagen (Denmark): European Observatory on Health Systems and Policies © World Health Organization 2022 (acting as the host organization for, and secretariat of, the European Observatory on Health Systems and Policies). 2022.
  27. 27. Kumah E, Ankomah SE, Fusheini A, Agyei-Baffour P, Ayanore MA, Asravor RK, et al. Framework for assessing the performance of the Ghanaian health system: study protocol. Health Res Policy Syst. 2021;19(1):149. pmid:34930310
  28. 28. MacDonald JM, Donnelly EA. Evaluating the Role of Race in Sentencing: An Entropy Weighting Analysis. Justice Quarterly. 2017;36(4):656–81.
  29. 29. Zhao L, Zhao Y, Hu Q, Li H, Stoeter J. Evaluation of consolidation center cargo capacity and loctions for China railway express. Transportation Research Part E: Logistics and Transportation Review. 2018;117:58–81.
  30. 30. Papanicolas I, Smith P. EuroREACH Framework for Health System Performance. 2010.
  31. 31. Błoński M. Legal and economic aspects of healthcare systems in the Netherlands and Luxembourg. Ius Novum. 2019;13(2):17–32.
  32. 32. Moran V, Suhrcke M, Ruiz-Castell M, Barré J, Huiart L. Investigating unmet need for healthcare using the European Health Interview Survey: a cross-sectional survey study of Luxembourg. BMJ Open. 2021;11(8):e048860. pmid:34344682
  33. 33. et.al. CDP. Switzerland: health system review 2015. European Observatory on Health Systems and Policies; 2015. Contract No.: 4.
  34. 34. Filliettaz SS, Berchtold P, Koch U, Peytremann-Bridevaux I. Integrated Care in Switzerland: Strengths and Weaknesses of a Federal System. Int J Integr Care. 2021;21(4):10. pmid:34754285
  35. 35. Palley HA. Health Care in Switzerland: A Closer Look at a System Offered As a Model for the United States. Journal of Medicine and Surgical Sciences. 2021.
  36. 36. Schumacher L, Dhif Y, Bonnabry P, Widmer N. Managing the COVID-19 health crisis: a survey of Swiss hospital pharmacies. BMC Health Serv Res. 2023;23(1):1134. pmid:37864155
  37. 37. OECD. Health at a Glance 20232023.
  38. 38. Waheed MA, Al Mannai L, Khudadad H, Alenbawi J, Mansaray MA, Al Abdulla S. Assessment of Qatar’s Health Care Community Call Center Efficacy in Addressing COVID-19 Pandemic Health Care Challenges: Cross-Sectional Study. JMIR Form Res. 2024;8:e42753. pmid:38085918
  39. 39. Bener A, Al Mazroei A. Health services management in Qatar. Croat Med J. 2010;51(1):85–8. pmid:20162749
  40. 40. Qoronfleh MW. Health is a political choice: why conduct healthcare research? Value, importance and outcomes to policy makers. Life Sci Soc Policy. 2020;16(1):5. pmid:32715382
  41. 41. Rice T, Rosenau P, Unruh LY, Barnes AJ, Saltman RB, Van Ginneken E. United States of America: health system review. 2013.
  42. 42. Wang C. The Strengths, Weaknesses, Opportunities, and Threats Analysis of Big Data Analytics in Healthcare. International Journal of Big Data and Analytics in Healthcare. 2019;4(1):1–14.
  43. 43. Schneider E, Sarnak D, Squires D, Shah A, Doty M. Mirror 2017: international comparison reflects flaws and opportunities for better US health care. London: The Commonwealth Fund; 2023.
  44. 44. Robertson J, Newby DA, Walkom EJ. Health Care Spending: Changes in the Perceptions of the Australian Public. PLoS One. 2016;11(6):e0157312. pmid:27294518
  45. 45. Kapologwe NA, Kalolo A, Kibusi SM, Chaula Z, Nswilla A, Teuscher T, et al. Understanding the implementation of Direct Health Facility Financing and its effect on health system performance in Tanzania: a non-controlled before and after mixed method study protocol. Health Res Policy Syst. 2019;17(1):11. pmid:30700308
  46. 46. Ludlow T, Fooken J, Rose C, Tang KK. Out-of-pocket expenditure, need, utilisation, and private health insurance in the Australian healthcare system. Int J Health Econ Manag. 2023.
  47. 47. Farewar F, Saeed KMA, Foshanji AI, Alawi SMK, Zawoli MY, Irit S, et al. Efficiency analysis of primary healthcare facilities in Afghanistan. Cost Eff Resour Alloc. 2022;20(1):24. pmid:35659679
  48. 48. Elayah M, Gaber Q, Fenttiman M. From food to cash assistance: rethinking humanitarian aid in Yemen. J Int Humanit Action. 2022;7(1):11. pmid:37519842
  49. 49. Bakather AM, Binsaeedu AS, Abbad AAB, Bajaber AO, Bawazir AA, Alawadi MM. Healthcare of Yemen: Advancements and Challenges. Current Politics and Economics of the Middle East. 2019;10(1):27–80.
  50. 50. Getachew N, Shigut H, Jeldu Edessa G, Yesuf EA. Catastrophic health expenditure and associated factors among households of non community based health insurance districts, Ilubabor zone, Oromia regional state, southwest Ethiopia. Int J Equity Health. 2023;22(1):40. pmid:36894937
  51. 51. Esmailzadeh H, Rajabi F, Rostamigooran N, Majdzadeh R. Iran health system reform plan methodology. Iran J Public Health. 2013;42(Supple1):13–7. pmid:23865010
  52. 52. Piroozi B, Mohamadi Bolban Abad A, Moradi G. Assessing health system responsiveness after the implementation of health system reform: a case study of Sanandaj, 2014-2015. Iranian Journal of Epidemiology. 2016;11(4):1–9.
  53. 53. Kalroozi F, Mohammadi N, Farahani MA, Aski BH, Anari AM. A critical analysis of Iran health system reform plan. J Educ Health Promot. 2020;9:364. pmid:33575400
  54. 54. Rajabi F, Esmailzadeh H, Rostamigooran N, Majdzadeh R. What must be the Pillars of Iran’s Health System in 2025? Values and Principles of Health System Reform Plan. Iran J Public Health. 2013;42(2):197–205. pmid:23515322
  55. 55. Shahabi S, Fazlalizadeh H, Stedman J, Chuang L, Shariftabrizi A, Ram R. The impact of international economic sanctions on Iranian cancer healthcare. Health Policy. 2015;119(10):1309–18. pmid:26344426
  56. 56. Asadi-Lari M, Sayyari AA, Akbari ME, Gray D. Public health improvement in Iran--lessons from the last 20 years. Public Health. 2004;118(6):395–402. pmid:15313592
  57. 57. Lankarani KB, Alavian SM, Peymani P. Health in the Islamic Republic of Iran, challenges and progresses. Med J Islam Repub Iran. 2013;27(1):42–9. pmid:23479501
  58. 58. Rezaei S, Woldemichael A, Ebrahimi M, Ahmadi S. Trend and status of out-of-pocket payments for healthcare in Iran: equity and catastrophic effect. J Egypt Public Health Assoc. 2020;95(1):29. pmid:33140214
  59. 59. Rezaei S, Hajizadeh M. Measuring and decomposing socioeconomic inequality in catastrophic healthcare expenditures in Iran. J Prev Med Public Health. 2019;52(4):214–23. pmid:31390684
  60. 60. GBD 2019 Iran Collaborators. Health system performance in Iran: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2022;399(10335):1625–45. pmid:35397236
  61. 61. Ramezanian M, Haghdoost AA, Mehrolhassani MH, Abolhallaje M, Dehnavieh R, Poursheikhali A. Effective factors and drivers of Iran’s health care financing system. Med J Islam Repub Iran. 2020;34:104. pmid:33315996
  62. 62. Otorkpa OJ, Otorkpa CO, Emmanuel S, Olaiya AP, Auta HS, Daniel EO, et al. Review of global burden of disease studies: trends, challenges, and future directions. IJPHS. 2024;13(2):766.
  63. 63. Oliveira CB, Ferreira GE, Buchbinder R, Machado GC, Maher CG. Do national health priorities align with Global Burden of Disease estimates on disease burden? An analysis of national health plans and official governmental websites. Public Health. 2023;222:66–74. pmid:37523950