Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

An integrated model for evaluation of maternal health care in China

  • Qianlong Zhao ,

    Roles Data curation, Software, Writing – original draft, Writing – review & editing

    zhaoql16@163.com

    Affiliation Child and Adolescent Physical Examination and Health Management Center, Lanzhou University Second Hospital, Lanzhou, China

  • Junyi Chen,

    Roles Methodology

    Affiliation Department of Clinical Blood Transfusion, Lanzhou University Second Hospital, Lanzhou, China

  • Fulun Li,

    Roles Formal analysis

    Affiliation Department of Child Psychology and Behavior, Lanzhou University Second Hospital, Lanzhou, China

  • Aishu Li,

    Roles Software

    Affiliation Child and Adolescent Physical Examination and Health Management Center, Lanzhou University Second Hospital, Lanzhou, China

  • Qian Li

    Roles Formal analysis

    Affiliation Child and Adolescent Physical Examination and Health Management Center, Lanzhou University Second Hospital, Lanzhou, China

Abstract

In recent years, in the context of China’s continuous medical and health reforms, the health status of Chinese women and children has been significantly improved through the continuous efforts of staff at all levels of maternal and child health care institutions. Many indicators in maternal health care have improved significantly, but the speed and magnitude of changes have varied. The purpose of this study is to evaluate the dynamic changes in China’s maternal health status from 2004 to 2018, in order to determine whether China’s medical and health reform measures in recent years have improved maternal health. A total of 6 evaluation indicators from the data of China Health Statistics Yearbook 2019 were selected. Then, based on the multi-criteria decision-making (MCDA) methodology, the entropy weighted technique for order preference by similarity to an ideal solution (TOPSIS), entropy weighted rank-sum ratio (RSR) method and the fuzzy comprehensive evaluation were employed in this study. In addition, sensitivity analysis was engaged to validate the stability and accuracy of the achieved results. The study results shows the ranking values of various methods were not exactly the same, but the overall trend was consistent. Overall, the maternal health care in China improved from 2004 to 2018 year by year, of which the top four were ranked from 2015 to 2018, and relatively poor from 2004 to 2006. This means that the policies and measures implemented in China’s medical and health reform in the past few decades have effectively promoted China’s maternal health care, and this will also provide a theoretical basis for future decisions to promote maternal health care.

Introduction

Maternal health care is decisive for maternal and newborn health and the health of the entire country [1]. China has the largest group of women and children in the world, any improvement in maternal and child health services or polices will benefit over two-thirds of the total population and beyond [2]. Since the 1790s, almost all the UN assemblies and world summits related to development have placed great emphasis on maternal and child health, and without exception, regraded maternal and child health as the most important indicators to measure the development of a particular country [3]. In 2000, 189 heads of state, including China, signed the Millennium Declaration committing themselves to achieve eight goals for development. The target for Millennium Development Goal 5 was to reduce the maternal mortality ratio by three-quarters between 1990 and 2015 [4].

Previous studies about access and quality of health services between urban and rural residents were limited to examining health insurance and health care in certain areas in China [5]. A growing number of studies addressed gender variation in access to health care services and outcomes [6, 7]. Considering that there exists little empirical evidence on the disparity of different groups of populations by distinguishing their degree of equality and benefit of China’s national health care system, we conduct this unique study to fill this knowledge gap in China.

China’s health care reform was expected to be implemented in 3 sequential phases according to the macro guideline issued in 2009 [8]. The first phase was from 2009 to 2012, which was aimed to push all levels of governments in China tore focus on health development and to lay a foundation for the 2020 goals [8]. As a result, more than 125 billion USD flooded into the health sector from 2009 to 2012, with the following 5 targeted priorities: expanding public health insurance, strengthening primary care, establishing an essential medicine programme, providing public health care services, and conducting pilot reforms of public hospitals [9]. The second phase began in 2012 when the central government issued the 12th 5-year plan for health reform; this phase ended in 2015. Apart from continuing to invest financial resources in the 5 target areas outlined in the 2009–2012 phase, the 2012–2015 phase focused its most attention on public hospital reforms [10]. The reforms of county public hospitals were rolled out county by county. The central government intended to reform its wasteful and inefficient county public hospitals by removing the 15% profit margin for drug sales, changing the price schedule, restructuring the governance structure, changing the payment methods, and improving the management [10]. By the end of 2015, almost all county public hospitals were under the reform. The central government also expedited the reform of hospitals in urban areas [11]. In addition to the 17 pilot cities selected in the 2009–2012 phase, another 83 pilot cities across China were confirmed by the central government. These pilot cities were supposed to be used to determine innovative and feasible approaches for scaling up public hospital reform nationwide by policy experimentation [11]. China’s health reform entered its third phase when the Chinese government announced the 13th 5-year plan for medical reform [12]. In this plan, the central government clearly reconfirmed that it would achieve universal coverage of basic health services for all Chinese citizens by 2020.

Under the above background, the purpose of this study is to evaluate the dynamic changes in the state of maternal health care in China during 2004–2018. A total of 6 evaluation indicators from the data of China Health Statistics Yearbook 2019 were selected. Then, based on the multi-criteria decision-making (MCDA) methodology, the weighted technique for order preference by similarity to an ideal solution (TOPSIS), weighted rank-sum ratio (RSR) method and the fuzzy comprehensive evaluation of maternal health care in China were designed. The significance of this study is to evaluate whether China’s medical and health reform measures in recent years have promoted the maternal health status and to provide a theoretical basis for future maternal and child health decisions.

This paper is organized as follows: Section 1 presents the Introduction. Section 2 provides Literature review. Section 3 describes the method, including the Data sources, the Determination of the Weights, the detailed calculation steps of weighted TOPSIS, weighted RSR method and Fuzzy comprehensive evaluation, and the sensitivity analysis process of MCDM methodology. Section 4 shows the application of the different MCDA methods. Section 5 performs a sensitivity analysis to weights of MCDA. Section 6 presents the discussion of results. Finally, conclusions and the future work direction are given in the Section 7.

Literature review

MCDA is a set of methods used to solve complex problems with multiple standards and objectives. A large number of previous studies have shown MCDA was widely used in many fields, such as management and engineering [13, 14], economics [15], environment [16], political economy [17], and social system [18]. The application in the medical and health field has been booming since the 2000s [19]. Generally, MCDA research methods can be divided into three categories: value measurement models, ranking models and goal programming models. The common ranking methods of MCDA include simple additive weighting (SAW) method [20], TOPSIS method [21], preference ranking organization method for the enrichment of evaluations (PROMETHEE) method [22], analytic hierarchy process (AHP) method [23], artificial neural networks (ANN) method [24], and RSR method [25].

The TOPSIS method is one of the known classical multi-criteria decision-making methods, Which was first developed by Hwang and Yoon that can be used with both normal numbers and fuzzy numbers [26]. Previous studies have shown that TOPSIS and its modified versions have been widely used in many issues, for example, business [21], management and engineering [2729], health care [30, 31], safety [32], environment [33], etc. TOPSIS provides a simple and easy-to-understand platform for arranging and decomposing decision-making problems involving many attributes [30]. TOPSIS is not limited by research factors, its logic is reasonable and easy to calculate [31]. However, the use of classic TOPSIS technology for decision-making is not enough to resolve ambiguity, subjectivity and incomplete information [33]. Santos et al. [34] suggest that combining TOPSIS with other MCDM methods may be more effective and more flexible to solve problems. Gorgij et al. [35] used the entropy-TOPSIS method to rank the quality of groundwater resources. Jena et al. [36] integrated ANN-cross-validation and AHP-TOPSIS model to improve earthquake risk assessment. He et al. [37] developed a simulation-aided PROMETHEE-TOPSIS approach for the selection of the most desirable groundwater remediation strategies.

The RSR method is also one of the commonly used classical multi-criteria decision-making methods, Which was proposed by Chinese scholar and former professor Tian Fengdiao in Chinese Academy of Preventive Medicine in 1988 [38]. With the joint support and efforts of the majority of scholars, the RSR method has been widely used in the comprehensive evaluation of multiple indicators in the field of medical health and others [39]. Wu et al. [25] conducted a comprehensive evaluation of the medical service efficiency of TCM hospitals based on the RSR method. Chen et al. [40] analyzed the influence of China’s national standards based on the non-integer rank sum ratio method. Stevic et al. [41] also applied the RSR method in the comprehensive quality evaluation of fly ash.

In previous studies, there were various methods for selecting standard weights in the MCDA method [42]. According to Lu et al. [43], the evaluation of indicator weights through subjective weighting methods such as survey method, Delphi method, AHP, etc., may cause deviation of indicator weights due to subjective factors. Therefore, Chen et al. [44] suggested using entropy to calculate the weight of the standard, because it is an effective method that can make the decision-making process more reliable and accurate, and there are no major modeling difficulties. Objective fixed weight methods such as entropy can effectively eliminate human interference because they are based on inherent information [45].

Previous studies have shown that fuzzy set theory was used to resolve ambiguity and uncertainty in the decision-making process [46]. Therefore, the combination of fuzzy set and trend will be very suitable for solving ambiguous group decision problems [47]. In recent years, Fuzzy TOPSIS has been widely used by researchers [48]. Solangi et al. [49] used Fuzzy-TOPSIS method to study Pakistan’s sustainable energy planning strategy. Rashidi et al. [50] used fuzzy TOPSIS when selecting suppliers in the supply chain. Shen et al. [51] applied the extended intuitionistic fuzzy TOPSIS method based on the new distance metric to credit risk assessment. Through these research results and the development of TOPSIS method, it can be seen that the fuzzy TOPSIS method is more widely used and more reliable than the traditional TOPSIS method.

Methods

Data sources

The research data got from the China Health Statistics Yearbook 2019, which can be get at http://www.cnpub.com.cn/2019/1450795.html?from=singlemessage. According to the relevant data published in the Yearbook, six indicators were selected to comprehensively evaluate and analyze the national maternal health situation. The six indicators X1~X6 are maternal mortality rate (1/100,000), registration rate (%), system management rate (%), prenatal check-up rate (%), postpartum visit rate (%) and hospital delivery rate (%), of which the maternal mortality rate (1/100,000) is the low-quality indicator, and the registration rate (%), system management rate (%), prenatal check-up rate (%), postpartum visit rate (%) and hospital delivery rate (%) are the high-quality indicator. The original data table after co-trending was established (Table 1). Fig 1 shows the general model used in this paper.

thumbnail
Table 1. The original data table of maternal health care in China from 2004 to 2018.

https://doi.org/10.1371/journal.pone.0245300.t001

Determination of the weights

Entropy is recommended to calculate the weight of the criteria. The detailed processes are as follows:

  1. The indicators were processed in a consistent manner, that is, the directions of the indicators are consistent. Generally, the difference method was used to convert low-quality indicators to high-quality indicators.
  2. Formula (1) and (2) are used to normalize high-quality indicators and low-quality indicators, respectively: (1) (2)
  3. Formula (3) is used to calculate the proportion of the ith sample under the jth index in the index (pij): (3)
  4. Formula (4) is used to calculate the entropy value of the jth index (ej): (4) Where . In this study, n = 15, j = 1, 2…6.
  5. Formula (5) is used to calculate the redundancy of calculating information entropy (dj): (5)
  6. Formula (6) is used to calculate the weight of each indicator (Wj): (6)

The weighted TOPSIS method

The weighted TOPSIS method ranks according to the proximity of a limited number of evaluation objects to the idealized target, which is a relatively good evaluation of the existing objects [52]. Weighted TOPSIS method is a ranking method that is close to the ideal solution, and it is a commonly used effective method in MCDA [53]. The detailed processes are as follows:

  1. The weighted TOPSIS method requires that all indicators change in the same direction, that is, co-trend.
  2. The original data matrix after co-trending was normalized to eliminate the influence of the indicator measurement unit, and a normalized matrix A was established. The index conversion formula is (7). Then multiply each index aij of the normalized matrix A by its weight coefficient. (7) Where Xij represents the value of the jth indicator in the i year. In this study, n = 15, j = 1, 2…6.
  3. The optimal solution A+ and the worst solution A- was determined by matrix A.
    The optimal solution A+ consists of the maximum value in each column of the matrix A: Aj+ = max (a1j, a2j…a15j), j = 1, 2…6. The worst solution A- consists of the minimum value in each column of the matrix A: Aj- = min (a1j, a2j…a15j), j = 1, 2…6. In this study, A+ = (0.0417, 0.0534, 0.0610, 0.0515, 0.0521, 0.0218), A- = (0.0158, 0.0488, 0.0509, 0.0479, 0.0472, 0.0181).
  4. The distance Di+ and Di- of each evaluation indicators was calculated by Eqs (8) and (9). (8) (9) Where Di+ is the distance of the years to the optimal solution, and Di- is the distance of the years to the worst solution.
  5. The proximity level of the years to the optimal solution (Ci) was calculated by Eq (10). (10) Where the value of Ci is between 0 and 1. When the Ci value is closer to 1, it indicates that the maternal health care status in this year is closer to the optimal level.

The weighted RSR method

The fundamental theory of the weighted RSR method is that a dimensionless statistical indicator is calculated from an n×m matrix using rank conversion. After this calculation, the distribution of WRSR could be explored using parametric statistical methods. Generally, the WRSR indicator ranges from 0 (worst) to 1 (best) and follows a normal distribution. Additionally, the status (worst/best) of subjects could be evaluated using the WRSR order or a set of ordinal classification [38]. The detailed processes are as follows:

  1. Rank the indicators of maternal health care, with the high-quality indicators ranked in ascending order and the low-quality indicators ranked in descending order.
  2. The value of RSR was calculated by Eq (11). (11) Where Rij is the rank of maternal health care indicators in China from 2004 to 2018, i = 1, 2, 3…15, m is the index number of maternal health care (m = 6), n is the evaluation years of China maternal health care (n = 15).
  3. Formula (12) is used to calculate the WRSR: (12) Where Wj is the weight of jth indicator.
  4. Sort according to the WRSR value. A larger WRSR value indicates better maternal health.

Fuzzy comprehensive evaluation method

The detailed processes are as follows:

  1. The value of Ci and WRSR was calculated through weighted TOPSIS method and weighted RSR method, respectively.
  2. The value of Ci and WRSR was substituted into the formula (13) where W1: W2 is the weight ratio. According to the FUZZY SET theory [54], the weight ratio W1: W2 are taken as 0.1: 0.9, 0.5: 0.5, 0.9: 0.1, respectively.
  3. Sort the numerical values calculated according to formula (13), and select the sorting results with different weight ratios that appear more frequently, which is the comprehensive evaluation result. The larger the value, the better the maternal health care.

Sensitivity analysis

Assuming that Wk changes to Wk*, k = 1, 2, 3,…, n, then Wk* = γkWk, where γk is the initial rate of the change of Wk, which is a number greater than zero. Because the sum of the weight of each indicator is equal to 1, when Wk changes, the weights of other indicators will change. Formula (14) is used to express the weights after the change. (14) Where W1, W2, Wk, and Wn are the weights of the first, second, kth and nth indicators after the change of Wk. The variable βk is defined as the unitary variation rate of the change of Wk. Therefore, we can get γk by formula (15): (15)

In this study, taking the change of W1 as an example, a total of 14 unit change rate schemes were designed, namely β1 = 0.01, 0.02, 0.05, 0.1, 0.2, 0.5, 1, 1.5, 2, 2.5, 3, 3.5, 4, and 4.5. After designing different unitary variation rate of change schemes, the weights of the indicators under these schemes were recalculated, and the Ci values under these schemes were also obtained.

Results

The weights of evaluation indicator

Table 2 shows the weight value of each evaluation indicator. The X3 indicator has the highest weight value with 0.2180, and the X6 indicator has the lowest weight value with 0.0809.

Weighted TOPSIS method evaluation of maternal health care in China from 2004 to 2018

According to the Ci value of weighted TOPSIS method evaluation of the maternal health care in each year, the top 4 maternal health care in China from 2004–2018 were in 2018, 2017, 2016 and 2015, and the last four were in 2004, 2005, 2006 and 2007 (Table 3, Fig 2A).

thumbnail
Fig 2. The ranks of alternatives (years) according to different applied methods.

A: Weighted TOPSIS; B: Weighted RSR; C: Fuzzy comprehensive; D: Combination Chart of three methods.

https://doi.org/10.1371/journal.pone.0245300.g002

thumbnail
Table 3. Weighted TOPSIS method evaluation of maternal health care in China from 2004 to 2018.

https://doi.org/10.1371/journal.pone.0245300.t003

Weighted RSR method evaluation of maternal health care in China from 2004 to 2018

According to the WRSR value ranking evaluation of the maternal health care in each year, the top 4 maternal health care in China from 2004–2018 were in 2016, 2015, 2017, 2018, and the last four were in 2004, 2006, 2005 and 2007 (Table 4, Fig 2B).

thumbnail
Table 4. Weighted RSR method evaluation of maternal health care in China from 2004 to 2018.

https://doi.org/10.1371/journal.pone.0245300.t004

Fuzzy comprehensive evaluation of maternal health care in China from 2004 to 2018

According to the fuzzy comprehensive method evaluation of the maternal health care in each year, the top 4 maternal health care in China from 2004 to 2018 were in 2016, 2017, 2015 and 2018, and the last four were in 2004, 2006, 2005 and 2007 (Table 5, Fig 2C).

thumbnail
Table 5. The fuzzy comprehensive evaluation of maternal health care in China from 2004 to 2018.

https://doi.org/10.1371/journal.pone.0245300.t005

Fig 2D shows the results of the weighted TOPSIS, weighted RSR method and the fuzzy comprehensive evaluation were not exactly the same, but the overall trend was consistent. Generally, maternal health care in China improved year by year from 2004 to 2018.

Correlation analysis

Spearman rank correlation analysis was used to compare the results obtained by different methods (weighted TOPSIS, weighted RSR method, fuzzy comprehensive evaluation). Fig 3A–3C shows the value of Ci and WRSR, Ci and 0.5WRSR+0.5Ci, WRSR and 0.5WRSR+0.5Ci have a significant positive correlation (r = 0.964, P<0.001; r = 0.971, P<0.001; r = 0.996, P<0.001).

thumbnail
Fig 3. Spearman rank correlation analysis of the results obtained by different methods.

A: Correlation between Ci and WRSR; B: Correlation between Ci and 0.5WRSR +0.5Ci; C: Correlation between WRSR and 0.5WRSR +0.5Ci.

https://doi.org/10.1371/journal.pone.0245300.g003

Sensitivity analysis

Table 6 and Fig 4A shows the recalculation results of each weight under different unitary variation ratios for W1. Similarly, the variations of the results under different unitary variation ratios for W2, W3, W4, W5 and W6 can be recalculated, and the results are illustrated in Fig 4B–4F.

thumbnail
Fig 4. The Ci under different unitary variation ratios for Wk.

A: W1; B: W2; C: W3; D: W4; E: W5; F: W6.

https://doi.org/10.1371/journal.pone.0245300.g004

thumbnail
Table 6. Weights under different unitary variation ratios for W1.

https://doi.org/10.1371/journal.pone.0245300.t006

Fig 4A shows the sharp increase of Ci value in 2018 when β1 = 0.2 disturbed the original ranking of 2013–2018. In addition, the ranking of 2015, 2016, and 2017 have changed after β1 = 1. Fig 4B shows the variation of W2 have a great impact on the Ci value in 2018, but other years are not sensitive to variation in W2. Fig 4C shows the ranking of 2015–2018 have changed after β3 = 2. Fig 4D and 4E shows the Ci value in 2010 began to increase from β4,5 = 2.5, but the ranking did not exceed 2011 until β4,5 = 4. Fig 4F shows the variation of W6 has no effect on the ranking of Ci values in each year.

Discussion

The advantage of the weighted TOPSIS method evaluation is that the method is simple and flexible, and the original data is fully utilized; the disadvantage is that the sensitivity is low and it is sensitive to the interference of outliers [55]. The advantage of weighted RSR method evaluation is that rank is used for calculation, and it is less interference to the outliers; the disadvantage is that some original information may be lost [38]. The advantage of the fuzzy comprehensive evaluation is that it overcomes the shortcomings of the previous two methods, and the analysis of the data is more sufficient and accurate; The final result determined by the principles for choosing more occurrences can accurately reflect the overall change trend [56]. Based on the above analysis, this paper tends to recommend the fuzzy joint comprehensive evaluation method.

In this present study, According to the Ci value ranking of weighted TOPSIS method, the maternal health care in China improved from 2004 to 2018 year by year. According to the WRSR value ranking, in addition to a slight decline in 2005, the maternal health care in China from 2004–2016 improved year by year, and there was a downward trend in 2017–2018 after 2016. According to the fuzzy comprehensive evaluation ranking, the change trend of maternal health care in China from 2004 to 2018 is basically the same as that in weighted RSR. The weight of the standard in this study is calculated using entropy, the weight calculated in this way can effectively eliminate human interference, and the result obtained is more objective. The weight value of each evaluation indicator shows the system management rate indicator (X3) has the highest weight value with 0.2180, and the hospital delivery rate indicator (X6) has the lowest weight value with 0.0809.

Then the sensitivity analysis results of parameter weights shows 2013–2018 are sensitive to variation in W1 and W3, 2010–2018 are sensitive to variation in W2, 2010 and 2011 are sensitive to variation in W4 and W5, none is sensitive to variation in W6. In addition, spearman rank correlation analysis shows the results obtained by multiple different methods are significantly positively correlated. In summary, China’s maternal health care level from 2004 to 2018 has become better and better. This trend of change is inseparable from China’s medical and health reforms in the past few decades. The summary of measures related to the development of maternal health care in China’s medical and health reforms in recent years is as follows:

1990–2008, the maternal health care in China entered the fifth historical development stage. At this stage, with the booming economy, maternal and child health care has received increasingly domestic and international attention [57]. Through the improvement of legislation and investment, China has made great progress in improving maternal and child health. In 1994, the Law of the People’s Republic of China on Maternal and Infant Health Care was issued, which clearly stipulated the policies for maternal and child health care [58]. In 2001, the National Program for Women’s Development in China (2001–2010) was adopted with a main goal of reducing the maternal mortality rate to 39.75 per 100,000 by 2010 [59]. Up to 2008, maternal and child health care hospitals or centers have been established in all provinces, cities, and counties across the country, and even township hospitals have employed maternal and child health care staff [60]. Since the 1990s, the Chinese government has implemented a series of international programs for maternal and child health interventions in cooperation with United Nations International Children’s Fund (UNICEF), United Nations Fund for Population Activities (UNFPA), World Health Organization (WHO), and the World Bank. The Baby-friendly Hospital and Baby-friendly Initiative was the largest international cooperative project between Ministry of Health and UNICEF since China’s reform [61]. In addition, programs such as Strengthening maternal child health (MCH) and family planning (FP) at the Grass-roots Level, Strengthening Essential Health Services in Poor Rural Areas, human immunodeficiency virus (HIV)/ acquired immune deficiency syndrome (AIDS)/ sexually transmitted diseases (STI) Prevention and Control and MCH, Safe Motherhood Initiatives and other international programs have been implemented successfully and have produced a great promotion effect [62].

After 2009, the maternal health care in China entered the sixth historical development stage, the comprehensive health care reform has laid the institutional foundation for the development of maternal and child health care and the promotion of health equity [57]. In 2009, China carried out comprehensive medical reforms in five area, including: (1) providing equal access to basic medical insurance for both urban and rural residents, and increasing the coverage rate to 90% within three years; (2) strengthening the primary medical and health service system; (3) promoting equalization of basis public health services; (4) establishing national essential medicine system; (5) implementing pilot reforms in public hospitals [63]. The reform provides an institutional basis for the development of maternal and child health care, as the maternal and child health care services and interventions have been incorporated into the equalization of public health services. The maternal and child health related services in basic public health services include free medical examinations before pregnancy, systematic health management of pregnant women, subsidies for rural women in hospital delivery, and free treatment of pregnant women with HIV infection [64]. In addition, the ever-increasing capital investment and allocation of health human resources also ensure the continuous development of maternal health care [65]. After the health care reform in 2009, China increased investment in basic public health funds, including maternal and child health care [60]. Most rural areas were providing maternal and child health services, including hospital services, as part of the New Rural Cooperative Medical Scheme (NRCMS) reimbursement [66]. According to the Yearbook 2019, 2009–2018, the average annual growth rate of the number of health technicians, licensed (assistant) doctors and registered nurses in the maternal and child health institutions in China were 7.80%, 5.48% and 12.15%, respectively. The ratio of doctors to nurses in maternal and child health care institutions increased from 1: 0.80 in 2009 to 1: 1.24 in 2018.

Conclusion

In this present study, the situation of maternal health care in China from 2004–2018 was selected as cases, we have selected 6 indicators from the latest China Health Statistics Yearbook based on previous research reports, and conducted a comprehensive assessment of China’s maternal health care through the weighted TOPSIS method, the weighted RSR method, and the fuzzy combination of the two methods based on the fuzzy set theory, which was used to solve ambiguity and uncertainty in the decision-making process. We also determined the weight of each evaluation index through the entropy weight method, and conducted a sensitivity analysis on the weights of the parameters. Based on the research results, we can conclude that the fuzzy comprehensive evaluation overcome the shortcomings of a single evaluation method, the ranking values of various methods were not exactly the same, but the overall trend was consistent. Overall, the maternal health care in China improved from 2004 to 2018 year by year, of which the top four were ranked from 2015 to 2018, and relatively poor from 2004 to 2006. This means that the policies and measures implemented in China’s medical and health reform in the past few decades have effectively promoted China’s maternal health care, and this will also provide a theoretical basis for future decisions to promote maternal health care.

This study has certain limitations. First of all, the evaluation index system should be representative. However, due to limited access to certain data, some indicators will not be available. Secondly, the research data has a certain lag. For example, this research uses the latest statistical yearbook, but the latest data is released until 2018. Finally, the evaluation results may not be completely consistent due to the different weighting coefficients, but the differences are less. In the future, the integrated model can be applied to more cases to verify the effectiveness of its evaluation. In addition, we will continue to collect the latest yearbook data to track changes in the results after 2018.

References

  1. 1. Lassi ZS, Kedzior SG, Bhutta ZA. Community-based maternal and newborn educational care packages for improving neonatal health and survival in low- and middle-income countries. Cochrane Database Syst Rev. 2019;2019(11). pmid:31686427
  2. 2. Tang D, Li M, Ung COL, Tang C, Hu H. Exploratory study on development challenges of maternal and child healthcare institutions in China: a qualitative study combining interviews and focus groups. BMJ Open. 2019;9(6):e028789. pmid:31227539
  3. 3. Blencowe H, Krasevec J, de Onis M, Black RE, An X, Stevens GA, et al. National, regional, and worldwide estimates of low birthweight in 2015, with trends from 2000: a systematic analysis. Lancet Glob Health. 2019;7(7):e849–e860. pmid:31103470
  4. 4. Liang J, Li X, Kang C, Wang Y, Kulikoff XR, Coates MM, et al. Maternal mortality ratios in 2852 Chinese counties, 1996–2015, and achievement of Millennium Development Goal 5 in China: a subnational analysis of the Global Burden of Disease Study 2016. Lancet. 2019;393(10168):241–252. pmid:30554785
  5. 5. Chen L, Zhang X, Xu X. Health Insurance and Long-Term Care Services for the Disabled Elderly in China: Based on CHARLS Data. Risk Manag Healthc Policy. 2020;13:155. pmid:32161509
  6. 6. Li J, Shi L, Liang H, Ding G, Xu L. Urban-rural disparities in health care utilization among Chinese adults from 1993 to 2011. BMC Health Serv Res. 2018;18(1):102. pmid:29426313
  7. 7. Zhou Y, Yao X, Liu G, Jian W, Yip W. Level and variation on quality of care in China: a cross-sectional study for the acute myocardial infarction patients in tertiary hospitals in Beijing. BMC Health Serv Res. 2019;19(1):43. pmid:30658628
  8. 8. Leng Y, Liu W, Xiao N, Li Y, Deng J. The impact of policy on the intangible service efficiency of the primary health care institution-based on China’s health care reform policy in 2009. Int J Equity Health. 2019;18(1):14. pmid:30665422
  9. 9. Song S, Yuan B, Zhang L, Cheng G, Zhu W, Hou Z, et al. Increased inequalities in health resource and access to health care in rural China. Int J Environ Res Public Health. 2018;16(1):49. pmid:30585243
  10. 10. Meng Q, Mills A, Wang L, Han Q. What can we learn from China’s health system reform? BMJ. 2019;365:l2349. pmid:31217222
  11. 11. Yip W, Fu H, Chen AT, Zhai T, Jian W, Xu R, et al. 10 years of health-care reform in China: progress and gaps in universal health coverage. Lancet. 2019;394(10204):1192–1204. pmid:31571602
  12. 12. Ji JS. Time for health to enter China’s climate action framework. Lancet Public Health. 2019;4(9):e442–e443. pmid:31493837
  13. 13. Noureddine M, Ristic M. Route planning for hazardous materials transportation: Multicriteria decision making approach. Decision making: applications in management and engineering. 2019;2(1):66–85.
  14. 14. Hassanpour M. Evaluation of Iranian wood and cellulose industries. Decision making: applications in management and engineering. 2019;2(1):13–34.
  15. 15. Reddy BP, Walters SJ, Duenas A, Thokala P, Kelly MP. A role for MCDA to navigate the trade-offs in the National Institute for Health and Care Excellence’s public health recommendations. Operations Research for Health Care, 2019;23.
  16. 16. Deshpande PC, Skaar C, Brattebø H, Fet AM. Multi-criteria decision analysis (MCDA) method for assessing the sustainability of end-of-life alternatives for waste plastics: A case study of Norway. Sci Total Environ. 2020:137353. pmid:32143095
  17. 17. Ishtiaque A, Eakin H, Chhetri N, Myint SW, Dewan A, Kamruzzaman M. Examination of coastal vulnerability framings at multiple levels of governance using spatial MCDA approach. Ocean & Coastal Management. 2019;171:66–79.
  18. 18. Guay J-F, Waaub J-P. SOMERSET-P: a GIS-based/MCDA platform for strategic planning scenarios’ ranking and decision-making in conflictual socioecosystem. EURO Journal on Decision Processes. 2019;7(3):301–325.
  19. 19. Baran-Kooiker A, Czech M, Kooiker C. Multi-criteria decision analysis (MCDA) models in health technology assessment of orphan drugs—a systematic literature review. Next steps in methodology development? Front Public Health. 2018;6:287. pmid:30374435
  20. 20. Wang YJ. Combining quality function deployment with simple additive weighting for interval-valued fuzzy multi-criteria decision-making with dependent evaluation criteria. Soft Computing. 2019:1–11.
  21. 21. Tin KMMH, Lau H. A business process decision model for client evaluation using fuzzy AHP and TOPSIS. International Journal of Industrial and Systems Engineering. 2020;35(1):57–79.
  22. 22. Chen T, Wang YT, Wang JQ, Li L, Cheng PF. Multistage Decision Framework for the Selection of Renewable Energy Sources Based on Prospect Theory and PROMETHEE. International Journal of Fuzzy Systems. 2020;22(4).
  23. 23. Kumari B, Pandey AC. Geo-informatics based multi-criteria decision analysis (MCDA) through analytic hierarchy process (AHP) for forest fire risk mapping in Palamau Tiger Reserve, Jharkhand state, India. Journal of Earth System Science. 2020;129(1):1–16.
  24. 24. Yariyan P, Karami M, Ali Abbaspour R. EXPLOITATION OF MCDA TO LEARN THE RADIAL BASE NEURAL NETWORK (RBFNN) AIM PHYSICAL AND SOCIAL VULNERABILITY ANALYSIS VERSUS THE EARTHQUAKE (CASE STUDY: SANANDAJ CITY, IRAN). International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences. 2019.
  25. 25. Wu X, Shen S. Comprehensive Evaluation of Medical Service Efficiency in TCM Hospitals Based on Data Envelopment Method and Rank Sum Ratio Method; 2019. IEEE. pp. 2486–2492.
  26. 26. El Allaki F, Christensen J, Vallières A. A modified TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) applied to choosing appropriate selection methods in ongoing surveillance for Avian Influenza in Canada. Prev Vet Med. 2019;165:36–43. pmid:30851926
  27. 27. Krmac E, Djordjević B. Evaluation of the TCIS Influence on the capacity utilization using the TOPSIS method: Case studies of Serbian and Austrian railways. Operational Research in Engineering Sciences: Theory and Applications. 2019;2(1):27–36.
  28. 28. Chatterjee P, Stević Ž. A two-phase fuzzy AHP-fuzzy TOPSIS model for supplier evaluation in manufacturing environment. Operational Research in Engineering Sciences: Theory and Applications. 2019;2(1):72–90.
  29. 29. Ramakrishnan KR, Chakraborty S. A cloud topsis model for green supplier selection. Facta Universitatis, Series: Mechanical Engineering. 2020;18(3):375–397.
  30. 30. Yucesan M, Gul M. Hospital service quality evaluation: an integrated model based on Pythagorean fuzzy AHP and fuzzy TOPSIS. Soft Computing. 2020;24(5):3237–3255.
  31. 31. Abdel-Basset M, Manogaran G, Gamal A, Smarandache F. A group decision making framework based on neutrosophic TOPSIS approach for smart medical device selection. J Med Syst. 2019;43(2):38. pmid:30627801
  32. 32. Zheng G, Li C, Feng Y. Developing a new index for evaluating physiological safety in high temperature weather based on entropy-TOPSIS model-A case of sanitation worker. Environ Res. 2020;191:110091. pmid:32877706
  33. 33. Carnero MC. Fuzzy TOPSIS Model for Assessment of Environmental Sustainability: A Case Study with Patient Judgements. Mathematics. 2020;8(11):1985.
  34. 34. dos Santos BM, Godoy LP, Campos LM. Performance evaluation of green suppliers using entropy-TOPSIS-F. Journal of cleaner production. 2019;207:498–509.
  35. 35. Gorgij AD, Wu J, Moghadam AA. Groundwater quality ranking using the improved entropy TOPSIS method: a case study in Azarshahr plain aquifer, east Azerbaijan, Iran. Human and Ecological Risk Assessment: An International Journal. 2019;25(1–2):176–190.
  36. 36. Jena R, Pradhan B. Integrated ANN-cross-validation and AHP-TOPSIS model to improve earthquake risk assessment. International Journal of Disaster Risk Reduction. 2020;50:101723.
  37. 37. He L, Shao F, Ren L. Identifying optimal groundwater remediation strategies through a simulation-based PROMETHEE-TOPSIS approach: An application to a naphthalene-contaminated site. Human and Ecological Risk Assessment: An International Journal. 2020;26(6):1550–1568.
  38. 38. Gu W, Zhao Y, Li Q, Li Y. Plant-microorganism combined remediation of polychlorinated naphthalenes contaminated soils based on molecular directed transformation and Taguchi experimental design-assisted dynamics simulation. J Hazard Mater. 2020;396:122753. pmid:32339881
  39. 39. Zhou S, Xu J, Ma X, Yuan B, Liu X, Fang H, et al. How Can One Strengthen a Tiered Healthcare System through Health System Reform? Lessons Learnt from Beijing, China. Int J Environ Res Public Health. 2020;17(21):8040. pmid:33142790
  40. 40. Chen Y, Fan L, Qing F. Affected Situation of Chinese National Standards based on Non-integer Rank Sum Ratio Method; 2020. IEEE. pp. 1209–1213.
  41. 41. Stevic Z, Pamucar D, Puska A, Chatterjee P. Sustainable supplier selection in healthcare industries using a new MCDM method: Measurement of alternatives and ranking according to COmpromise solution (MARCOS). Computers & Industrial Engineering. 2020;140:106231.
  42. 42. Yildiz A, Ayyildiz E, Taskin Gumus A, Ozkan C. A Framework to Prioritize the Public Expectations from Water Treatment Plants based on Trapezoidal Type-2 Fuzzy Ahp Method. Environ Manage. 2020;29. pmid:32990792
  43. 43. Lu J, Wei C, Wu J, Wei G. TOPSIS method for probabilistic linguistic MAGDM with entropy weight and its application to supplier selection of new agricultural machinery products. Entropy. 2019;21(10):953.
  44. 44. Chen P. Effects of normalization on the entropy-based TOPSIS method. Expert Systems with Applications. 2019;136:33–41.
  45. 45. Ren Z. Evaluation Method of Port Enterprise Product Quality Based on Entropy Weight TOPSIS. Journal of Coastal Research. 2020;103(SI):766–769.
  46. 46. Yatsalo B, Korobov A, Martínez L. From MCDA to Fuzzy MCDA: violation of basic axiom and how to fix it. Neural Computing and Applications. 2020;1–22.
  47. 47. Akcan S, Güldeş M. Integrated Multicriteria Decision-Making Methods to Solve Supplier Selection Problem: A Case Study in a Hospital. J Healthc Eng. 2019;2019:5614892. pmid:31687120
  48. 48. Salih MM, Zaidan B, Zaidan A, Ahmed MA. Survey on fuzzy TOPSIS state-of-the-art between 2007 and 2017. Computers & Operations Research. 2019;104:207–227.
  49. 49. Solangi YA, Tan Q, Mirjat NH, Ali S. Evaluating the strategies for sustainable energy planning in Pakistan: An integrated SWOT-AHP and Fuzzy-TOPSIS approach. Journal of Cleaner Production. 2019;236:117655.
  50. 50. Rashidi K, Cullinane K. A Comparison of Fuzzy DEA and Fuzzy TOPSIS in Sustainable Supplier Selection: Implications for Sourcing Strategy. Expert Systems with Applications.2018;121:266–281.
  51. 51. Shen F, Ma X, Li Z, et al. An extended intuitionistic fuzzy TOPSIS method based on a new distance measure with an application to credit risk evaluation. Information Sciences.2017;428:105–119.
  52. 52. Rafie E, Karamali M, Bahadori M, Yazdanian M, Ravangard R. Needs assessment and research priorities in the oral and dental health with health promotion approach in Iran. J Educ Health Promot. 2019;8:93. pmid:31143810
  53. 53. Hosseini SM, Bahadori M, Raadabadi M, Ravangard R. Ranking Hospitals Based on the Disasters Preparedness Using the TOPSIS Technique in Western Iran. Hosp Top. 2019;97(1):23–31. pmid:30601106
  54. 54. Gündoğdu FK, Kahraman C. A novel fuzzy TOPSIS method using emerging interval-valued spherical fuzzy sets. Engineering Applications of Artificial Intelligence. 2019;85:307–323.
  55. 55. Movahhed MK, Mohebbi M, Koocheki A, Milani E, Ansarifar E. Application of TOPSIS to evaluate the effects of different conditions of sonication on eggless cake properties, structure, and mass transfer. J Food Sci. 2020;85(5):1479–1488. pmid:32395876
  56. 56. Nakao M. Special series on "effects of board games on health education and promotion" board games as a promising tool for health promotion: a review of recent literature. Biopsychosoc Med. 2019;13:5. pmid:30820242
  57. 57. Huang Y, Shallcross D, Pi L, Tian F, Pan J, Ronsmans C. Ethnicity and maternal and child health outcomes and service coverage in western China: a systematic review and meta-analysis. Lancet Glob Health. 2018;6(1):e39–e56. pmid:29153766
  58. 58. Wang S-s, Zhou X, Lin X-g, Liu Y-y, Wu J-l, Sharifu LM, et al. Experience of Clinical Management for Pregnant Women and Newborns with Novel Coronavirus Pneumonia in Tongji Hospital, China. Curr Med Sci. 2020:1–5.
  59. 59. Xiao Y, Husain L, Bloom G. Evaluation and learning in complex, rapidly changing health systems: China’s management of health sector reform. Global Health. 2018;14(1):112. pmid:30454037
  60. 60. Wang L, Wang Z, Ma Q, Fang G, Yang J. The development and reform of public health in China from 1949 to 2019. Global Health. 2019;15(1):45. pmid:31266514
  61. 61. Yang X, Tang S, Yamey G, Qian X. Strengthening maternal and child health in China: lessons from transforming policy proposals into action. Biosci Trends. 2018;12(2):211–214. pmid:29657245
  62. 62. Xiao Y, Husain L, Bloom G. Evaluation and learning in complex, rapidly changing health systems: China’s management of health sector reform. Global Health. 2018;14(1):112. pmid:30454037
  63. 63. Qiu Y, Lu W, Guo J, Sun C, Liu X. Examining the Urban and Rural Healthcare Progress in Big Cities of China: Analysis of Monitoring Data in Dalian from 2008 to 2017. Int J Environ Res Public Health. 2020;17(4). pmid:32059464
  64. 64. Wang F, Shen K, Cai Y. Expansion of public transfers in China: Who are the beneficiaries? The Journal of the Economics of Ageing. 2019;14:100194.
  65. 65. Ma X, Wang H, Yang L, Shi L, Liu X. Realigning the incentive system for China’s primary healthcare providers. BMJ. 2019;365:l2406. pmid:31227522
  66. 66. Erlangga D, Suhrcke M, Ali S, Bloor K. The impact of public health insurance on health care utilisation, financial protection and health status in low-and middle-income countries: A systematic review. PloS one. 2019;14(8):e0219731. pmid:31461458