Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Performance appraisal method for rural infrastructure construction based on public satisfaction

  • Chuan Chen,

    Roles Supervision

    Affiliation Business School, Sichuan University, Chengdu, Sichuan, China

  • Yibin Ao ,

    Roles Investigation, Methodology, Software, Writing – original draft

    aoyibin10@mail.cdut.edu.cn

    Affiliations Business School, Sichuan University, Chengdu, Sichuan, China, College of Environment and Civil Engineering, Chengdu University of Technology, Chengdu, Sichuan, China

  • Yan Wang,

    Roles Investigation, Resources

    Affiliation Department of Engineering Management, Sichuan College of Architectural Technology, Deyang, Sichuan, China

  • Jiayue Li

    Roles Writing – review & editing

    Affiliation College of Environment and Civil Engineering, Chengdu University of Technology, Chengdu, Sichuan, China

Abstract

Rural infrastructure has rather fixed users compared to urban infrastructure. This study evaluated the effect of rural infrastructure construction from the perspective of farmers. First, this study revised the American Customer Satisfaction Index (ACSI) model and selected a performance appraisal index for rural infrastructure based on this revised model. Then, the study adopted an interpretive structural model (ISM), analyzed the influence of each index factor, and developed a hierarchical directed graph. Finally, based on the mutual-influence relationships among the index factors in the hierarchical directed graph, a performance appraisal analytic network process (ANP) model was established. Based on discussions with rural college students and rural households in Sichuan, China, 246 questionnaires were obtained pertaining to rural infrastructure, and an empirical analysis was conducted. The results indicated that the performance of rural infrastructure construction is not very good. In particular, the full use of infrastructure and its role in improving the environment were found to be the worst. Meanwhile, the possibility of building information transparency and the longitudinal comparison of perceived performance appraisal results were the best. The performance of rural infrastructure construction was evaluated based on the perceptions of the direct users of rural infrastructure, and the relationship between the factors and the weight was measured reasonably. The proposed method was found to be workable and the analysis results reliable and effective.

Introduction

China’s investment in rural fixed assets has grown significantly over the past 10 years. The rate of growth in 2014 was 2.72 times that of 2005. Growth in rural infrastructure is evident as well: 3,368.3 billion yuan was invested in 2014, which was two times that of 2005 [1]. With increased investment in rural areas, rural construction has produced certain benefits; however, problems with rural infrastructure construction have been highlighted as well. Environmental pollution, for example, is a major problem drawing global attention. As with rapid urban development, will the pursuit of new rural construction come at the expense of the environment? Will rural infrastructure construction meet the needs of agricultural production as well as those of peasants after a certain amount of investment and development? Further investigations are needed to address these questions. As such, there is a need to evaluate the effects of rural infrastructure construction by testing past inputs, which can also provide a theoretical reference for further investment and development in rural areas.

Recent studies on the effects of rural infrastructure have mainly focused on three aspects. The first is the assessment of infrastructure sustainability. Boz et al. developed a framework for evaluating sustainable infrastructure projects, proposed corresponding evaluation criteria, and established an evaluation index system [2]. Domingo assessed the effect of complex medical and health programs on construction-waste generation through interviews with people in the health-care infrastructure as well as questionnaire surveys [3]. Analyzing 23 feasibility study reports, Shen et al. identified 30 key indexes for the sustainable development of infrastructure projects and selected 20 key assessment indexes using fuzzy set theory [4]. Torres-Machi et al. analyzed environmental economic evaluation models as well as the practice of sustainable network pavement management [5]. Reza et al. proposed an evaluation method for sustainable infrastructure development based on the energy value of the whole life cycle [6]. Parrish et al. proposed life-cycle analysis (LCA), which assesses a project’s social, economic, and environmental aspects and requires that all three aspects be balanced to improve sustainability on the basis of life-cycle cost (LCC) [7]. Investigating the infrastructure sustainability of wastewater treatment, Glick et al. evaluated a case using both LCC and LCA, and concluded that most sewage treatment and pollution costs arise from the sewage transport process. They recommended replacing central treatment facility (CTF) technology with community-scale technology (CST) [8]. Analyzing the environmental, economic, and social aspects of four commonly used underground public infrastructure construction methods, Ariaratnam et al. found that pilot tube micro tunneling (PTMT) had the highest sustainability [9]. Bocchini et al. used the comprehensive application of resilience and sustainability to evaluate infrastructure construction [10]. Using system dynamics, Zhou et al. studied the unique characteristics of infrastructure from a microengineering perspective and established a model to analyze sustainable construction and operation [11]. Anagnostopoulos et al. combined geographic information systems (GIS) and spatial fuzzy analytic hierarchy process (SFAHP) to analyze and sort the location of a site [12].

Second, a number of studies have employed social investigation to examine rural infrastructure construction, use of the situation, willingness to raise funds, sources of funds, and user satisfaction. Wang et al. divided rural infrastructure into two types: production and living. They conducted household surveys in 19 villages in Guangdong and analyzed farmers’ satisfaction with the current infrastructure supply and their willingness to finance based on their needs [13]. Through case studies of three infrastructure projects (rural schools, drinking water, and irrigation), Ma et al. analyzed the government’s role in rural infrastructure investment and the direction of self-financing investment among villagers [14]. Yi et al. surveyed 101 villages in 5 provinces to analyze famers’ needs and investment behaviors in relation to roads, irrigation facilities, and drinking water facilities [15]. To analyze the status of private capital involved in rural infrastructure and farmers’ willingness to invest, Gan et al. investigated 31 villages and towns in the resource-rich areas of Shanxi, Shaanxi, and Inner Mongolia [16]. Using data from 30 provinces, Hao et al. analyzed the effect of increased income on rural infrastructure [17]. Using 670 questionnaires, Fan et al. established a structural equation model of the factors that influence satisfaction with rural infrastructure construction [18]. Using Henan Province to study farmers’ willingness to invest in rural infrastructure, Zhang et al. made recommendations for bottom-up and top-down public decision-making mechanisms [19].

Third, some studies have focused on project performance appraisal. Project performance measurement has been widely applied as an important tool for improving the level of enterprise project management. Although appraising the performance of infrastructure construction can improve the efficiency of public management and decision-making, research in this area is limited. To identify the gap between theory and practice, Bassioni et al. reviewed performance appraisal frameworks and their application among construction companies in the United Kingdom [20]. Ramani et al. used performance management to establish a sustainable improvement framework model for traffic management [21]. Conducting questionnaire surveys on the importance of performance indexes for participants in a project in Hong Kong, Lai and Lam found significant differences in the attitudes of participants [22]. Existing studies have mainly used the key performance index method to establish a project performance index system. Bassioni et al. argued that the key performance index method pays too much attention to project performance rather than enterprise performance [20]. Discussing project performance measurement from the perspective of contractors, Zhang et al. noted that research on project performance measurement has mainly focused on the perspectives of third parties and owners [23].

Compared to general construction projects and urban infrastructure construction projects, rural infrastructure construction has clear and fixed end users. Thus, the main target of infrastructure construction should be meeting users’ needs. Accordingly, this study used a customer satisfaction index (CSI) model to evaluate the performance of rural infrastructure construction. Factors that affect the performance of rural infrastructure can be preliminarily determined on the basis of CSI. However, since the relationships between various factors are different from general merchandise, the relationships among various factors in the CSI model cannot be fully applied. In this study, the internal relations between factors were determined using the interpretive structural model (ISM) theory. Project performance index weight is usually determined using the analytic hierarchy process (AHP) method, which reduces problems to a top-down hierarchical structure and assumes that elements on the same level are independent (i.e., no mutual-influence relationship exists). Since factors are not completely independent but mutually influenced, this study employed an analytic network process (ANP) and used Super Decisions (v. 2.8.0) to determine the weight of the indexes in the performance appraisal of rural infrastructure. The purpose of using CSI is to obtain users’ attitudes toward infrastructure. Data were obtained by investigating college students from rural areas in Sichuan Province and then conducting a survey of selected villages. Following analysis and calculation, rural infrastructure construction was evaluated from farmers’ perspectives. On that basis, reasonable, scientific suggestions are proposed for the future planning and construction of rural infrastructure.

The remainder of this paper is organized as follows. Section 2 presents the methods used in the study. Section 3 introduces the empirical study. Next, the empirical study results, discussion, and recommendations are presented in section 4. Finally, section 5 concludes the paper by providing the key findings of the study.

Methods

Customer Satisfaction Index (CSI) model

Dardozo introduced customer satisfaction into the marketing field in 1965 [24]. Howard and Sheth (1969) suggested that the evaluation of customer satisfaction is restricted to a certain time or occasion after the purchase [25]. Day and Bodur (1977) defined customer satisfaction as a kind of process that is generated by experience and evaluation [26]. After that, Hunt proposed a value and satisfied-relationship model [27]. In 1989, under the guidance of Professor Fornell at the University of Michigan, the Swedish Customer Satisfaction Barometer (SCSB)—the first national CSI model—was developed [28]. On this basis, CSI models were established in Sweden, the United States, and other countries. The most widely used model is the American Customer Satisfaction Index (ACSI), which was developed in 1994 and covers 10 economic sectors and 43 industries (http://www.theacsi.org/about-acsi/history). In 1999, the China Quality Association, Peking University, Tsinghua University, the People’s University, the Academy of Social Sciences, and other institutions jointly designed a CSI evaluation system. As China’s first standardized evaluation method, it laid the theoretical foundation for future studies of public satisfaction. Since then, scholars have thoroughly studied the customer satisfaction evaluation index system and the customer satisfaction model [29,30]. Revising the ACSI model, Li applied it to rural public infrastructure satisfaction and developed an evaluation index system for farmers’ satisfaction with rural public infrastructure [31,32]. In 2013, Ma Jieqiong used the improved ACSI to evaluate the performance of public projects and encourage the public to participate in performance appraisals of local government projects [33].

Based on the literature review, the CSI model includes seven indexes: expected quality, perceived product quality, perceived service quality, perceived value, customer satisfaction, customer complaints, and customer loyalty.

Interpretive Structural Modeling (ISM)

Interpretive structural modeling (ISM) was developed by Warfield to analyze complex system structures [34]. The core idea of ISM is to extract the constituent elements of problems and use some auxiliary means—such as matrices, programming, and direct graphs—to deal with the relationships between factors. This allows us to obtain a clear hierarchical structure and hierarchical structure graph, as follows:

  • Determine the research object and determine the relationships between the various factors of the study object through an ISM analysis team composed of experts in the relevant industry. Compose element set S so that element set S = {S1,S2,…,Sn}.
  • After determining the factors affecting the relationship, determine the direct relationship between the two elements according to the following: The adjacency matrix is established according to the above relation: A = (aij)n × n.
  • The reachable matrix is calculated by the adjacency matrix, and the hierarchical structure of the index factor is drawn.

Analytic Network Process (ANP)

Analytic network process (ANP) is a decision-making method proposed by Saaty, which is suitable for a nonindependent hierarchical structure. Although based on the analytic hierarchy process, this method is more flexible [35,36].

Unweighted super matrix W

Assuming the control layer of ANP has P1,P2,…,PN, and the network layer has an element level S1,S2,…,SN, where there are elements si1,si2,…,siN in Si, in which the control layer element Pi(i = 1,2,…,m) is the criterion, Sjk(k = 1,2,…,nj) is the substandard, and the element in the element set Si carries the indirect advantage of comparison to draw the matrix according to its influence on Sjk. The characteristic root method obtains the sort vector [wi1(jk)wi2(jk)win(jk)]T according to the consistency check and obtains matrix wij: (1)

The column vector Wij is the ranking vector of the important degree of in Ui to in Sj. If Uj is not affected by Si, then Wij = 0. Using the above steps, the super matrix W of Ps can be calculated as follows: (2)

Weighted super matrix

Comparing the importance of any two elements of Pi, we get the weighted matrix (3) Then, we get the weighted super matrix: (4)

Performance appraisal system method

This study appraised rural infrastructure construction performance based on public satisfaction using an evaluation index system based on ACSI according to research reviews of the multicriteria assessment of sustainable infrastructures [3739]. Then, the relationship between the indexes was analyzed using structural modeling, and the hierarchical structure of the index factors was obtained. To establish the network hierarchy model and determine the weight of each evaluation index, household survey questionnaires were designed based on performance appraisal indexes, which were selected based on the literature review and expert investigation. Then, the performance of rural infrastructure construction was evaluated based on the household perception data. The performance appraisal process is shown in Fig 1.

Empirical study

Revising ACSI to determine the evaluation index

In applying ACSI to the study of rural infrastructure satisfaction, scholars have only used the relevant indexes mentioned in ACSI. There has been no research on the correlation between the indexes. This study suggests that there are internal relations among factors based on the revised ACSI model proposed by Wenyi Li. Although these relationships are not recognized by farmers, they affect farmers’ perceptions of rural infrastructure. Therefore, this study initially assumed that the ACSI indexes for rural infrastructure were interrelated and mutually influenced.

Preliminary evaluation index selection.

The index design for rural infrastructure construction performance was evaluated based on the revised ACSI model. Twenty-six performance appraisal indexes for rural infrastructure construction were identified by studying related documents. Six new factors affecting famers’ evaluations were obtained through discussions with college students from rural areas; thus, the number of performance appraisal indexes for rural infrastructure construction was 32. The initial selection of the index system is shown in Table 1. Explanations are given below for the six extra indexes proposed in this study (indexes extracted from the literature are not explained).

Impression of full use: Rural infrastructure is the foundation of the development of rural economies. Further, its construction has for a long time been a matter of top-down, government-led supply. Whether rural infrastructure construction meets the real needs of farmers is rarely considered. During the field trip, many farmers suggested that some rural infrastructures are “vanity projects” built for the purpose of local government performance. These are not based on need and are not put into use. Impression of full use is an important part of rural infrastructure performance appraisal and can reflect the construction and use of rural infrastructure.

Construction efficiency: Infrastructure construction has several characteristics (large-scale investment, long construction period, etc.). Further, the project-approval cycle is longer since it involves the use of funds. Some farmers mentioned these problems during the field trip. Construction efficiency directly affects the construction and use of infrastructure.

Frequency of hearing complaints: Li et al. used complaints as an evaluation index. However, this study found that many farmers did not have a deep sense of self-perception regarding this problem, but they clearly perceived the frequency with which other people complained. Thus, this study used the frequency of hearing complaints as a supplementary index.

Investment possibilities: Investment involves risks. Although villagers invest in the construction of some infrastructures for their own use, investment can fail for reasons such as government credit risk, risks in the use of funds, or construction risks. Villagers’ investment possibilities can reflect their confidence in the local government’s ability to deal with risks. The greater the willingness to invest, the greater the confidence in local government.

Possibility of building information transparency: Infrastructure construction involves decision-making, planning, bidding, and many other procedures that pertain to the vital interests of farmers. These include the question of whether to solicit the views of farmers or whether to choose a reasonable contractor. All of these aspects directly affect the results of rural infrastructure construction. Some farmers know little or nothing about rural infrastructure construction. This study used these indexes in the performance evaluation of rural infrastructure construction. The smaller the possibility of the result, the smaller the farmers’ trust in local government.

Possibility of no construction corruption: Construction corruption is a prominent topic in China. Where it exists, it directly affects the quality, efficiency, and quantity of rural infrastructure construction.

Evaluation index selection and determination.

First, a questionnaire survey was conducted to screen the primary indexes and avoid selecting indexes that pertained to one-sided, repeated, or related issues. Thirty-two preliminary evaluation indexes were selected from the relevant literature and discussions with rural students (see Table 1). Respondents were asked to select 30 indexes in order from the 32 indexes according to the size of the impact on infrastructure performance appraisal. To avoid misleading respondents with the original target sequence, the order of the 32 indexes was randomized for each questionnaire. The weighted cumulative principle was as follows: respondents selected 30 indexes from the 32 indexes, assigned 30 to the first one, 29 to the second, and so on. Finally, all weights were accumulated for each index selected by all 91 respondents according to the order they chose. For example, if all of the 91 respondents selected “impression of full use” as the first one, the weighted cumulative value was 91 * 30 = 2,730. This study excluded weighted cumulative values of less than 900 (a significant fault existed in data below 900) and selected the remaining effective evaluation indexes for the evaluation index system. The screening results for the evaluation index are shown in Table 1.

To ensure respondents were familiar with rural infrastructure construction, the questionnaire was conducted at a local feasibility report review meeting concerning 10 local infrastructure projects. The participants included leaders of the administrative departments for the construction, review experts, representatives of the owners, and representatives of the unit preparing the feasibility report. One hundred questionnaires were issued; 91 were valid (91% effective recovery rate), and the feedback was good. The final composition of the questionnaire is shown in Table 2.

ISM to determine the index relationship

As shown in Table 1, the final 24 selected indexes were the objects to be studied. Construction administrative departments, experts, owners’ representatives, and representatives of the feasibility report comprised the ISM analysis group. Assuming a relationship existed between the 24 indexes, thus constituting the set of elements S, the number of element set S = {S1, S2, …, S24} = {C11, C12, …, C75}.

A two-dimensional questionnaire was established according to the ISM principle using the selected 24 indexes. The 91 respondents were asked to judge the relationship between any two indexes. Using statistics, it was confirmed that the two factors had an impact if more than half of the questionnaire showed that the two factors had relationships. The final determination of the ISM adjacency matrix could be obtained from the statistics. The reachable matrix of the adjacency matrix was solved using MATLAB, [36] as shown in Table 3.

Establishing ANP model to determine the weight of indexes

In the network-level analysis model, the two-level subindex system was the control layer, and the three-level index system was the network layer. The index factors of the network layer were determined according to Table 3. The performance appraisal model for rural infrastructure construction (Fig 2) was obtained by entering the relationships between the indexes into Super Decisions (v. 2.8.0).

thumbnail
Fig 2. ANP model diagram for rural infrastructure construction performance appraisal.

https://doi.org/10.1371/journal.pone.0204563.g002

The index was established using Super Decisions. First, we needed to compare the indexes of two points. The score value was determined according to the ratio of weighted cumulative values in Table 2, reflecting the impact of 91 expert opinions regarding the construction of rural infrastructure. When the ratio was in the 1.0–1.5 range, the score value was 2; in the 1.5–2.0 range, it was 3; and in the 2.0–2.5 range, it was 4. Each index factor and its related factors needed to be compared according to the weighted cumulative values in Table 2. After each scoring comparison, a consistency test was conducted. After examination, all of the related factors were compared, and the results were satisfactory at CR < 0.1, which met the requirements of the consistency check. Using Super Decisions, we obtained the rural infrastructure performance appraisal for the specific weights of the 24 factors (Table 4).

thumbnail
Table 4. Performance appraisal index system factor weights.

https://doi.org/10.1371/journal.pone.0204563.t004

Performance appraisal of rural infrastructure

We used the performance appraisal index system for rural infrastructure to design a questionnaire for farmers. To obtain effective, real data and ensure that respondents understood all of the problems in the questionnaire, the research group organized rural students from engineering management as respondents and visitors to gather the data. A meeting was organized to help students fully understand the questionnaire and to collect data about student attitudes toward rural infrastructure. Then, these students conducted investigations in their hometowns to gather firsthand data. Out of 300 questionnaires issued, 246 were recovered, for a recovery rate of 82%, which is quite high. Among them, 144 respondents were male and 102 were female. The questionnaires covered 23 cities in Sichuan Province and had a wide coverage area.

The reliability of the questionnaire was tested using the Cronbach alpha coefficient (α = 0.8103) with the use of SPSS 21.0, indicating that the questionnaire has high reliability. The questionnaire distribution and recovery numbers are shown in Table 5.

Twenty-four questions were set for the 24 indexes for the performance appraisal of rural infrastructure construction, each with five options according to the satisfaction situation, degree of implementation, and possibility of improvement. After preliminary statistics, topics were selected as shown in Table 6.

According to the questionnaire recycling statistics, measurement was carried out using a Likert-type scale. In Table 7, not satisfied (very small) (much) = 1, less satisfied (smaller) (larger) = 3, general = 5, satisfactory (larger) (smaller) = 7, and very satisfactory (great) (very small) = 9. Each index corresponds to the final questionnaire to obtain its score (xij is the number of respondents who selected the score j for each index):

The questionnaire design question was made to correspond to the rural infrastructure performance appraisal index for the weight of ωi; then, the index considered the weight score of μi = ωi × yi. The final scores for the indexes are shown in Table 7.

For the Sichuan area, the performance of rural infrastructure construction, evaluated from the perspective of farmers, is:

Discussion and suggestions

This study adopted the American Customer Satisfaction Index (ACSI) as the basis for appraising the performance of rural infrastructure. This research method has excellent applicability. The direct users of rural infrastructure are relatively fixed, and they have an intuitive and objective understanding of rural infrastructure; thus, the results of their appraisals are scientific and reasonable. Construction and investment in rural infrastructure aim to promote rural economic development, production, and livelihoods. As such, the construction of rural infrastructure should meet the needs of farmers for both production and daily life. In recent decades, China’s investment in rural infrastructure has increased, and new rural construction has shown initial successes. However, does such construction really meet the most urgent needs in rural areas? Does it really make farmers satisfied or meet the requirements for rural production? Considering these questions, this study evaluated the effect of such construction from the perspective of farmers.

The performance appraisal index for rural construction was based on not only previous studies but also information added through new research. The preliminary determination of the index system is more comprehensive and practical for reflecting farmers’ requirement information for rural infrastructure. To avoid high correlations between indexes, repeated meanings, and poor accuracy measurement, this study administered the index-selection questionnaire to senior professionals. The respondents had high professional levels, including the leaders of construction administration, representatives of rural infrastructure projects, and experts on project evaluation. Thus, the survey results are reliable.

Cumulative weight value can comprehensively reflect how important each index is for performance appraisal. This study used cumulative weight value to select the evaluating index. A pairwise comparison of associated factors was performed using an analytic network process (ANP) based on the AHP method used by Jin et al. to select rural building sites [40]. In addition, this study used index scoring related to cumulative weight value to avoid one-sidedness and single-expert subjectivity. Thus, the index selection and scoring are reliable.

Previous studies have used a customer satisfaction index (CSI) for the performance appraisal of construction projects. However, they only considered seven CSI factors, or just revised the factors, and they did not study the logical relationships between them. This study assumed that farmers’ perception factors are related to each other; thus, it was necessary to study the relationships among them. The relationships among various indexes were studied using an interpretive structural model (ISM). The adjacency matrix of the evaluation index was obtained from the summary statistics by collecting questionnaires on related factors from the abovementioned professionals. MATLAB was used to calculate the reachable matrix; the relationships among the various factors were measured using Super Decisions. Based on participation by professionals, the model is objective, scientific, and reasonable.

Based on model operation and household surveys, the performance appraisal score for rural infrastructure construction in Sichuan Province was found to be 4.7606. From the perspective of farmers, the performance of rural infrastructure construction is not very good and is inconsistent with China’s increasing infrastructure investments. This result is consistent with Arjuna and Manoj, who found that a lack of infrastructure affects rural residents’ satisfaction because of physical activity in the rural areas of Sri Lanka [41]. However, the longitudinal comparison score for farmer satisfaction was 6.1909, which was the highest among all factors investigated. This case study result represents a typical contribution to the method for estimating the social sustainability of infrastructure [42]. This indicates that the overall rural infrastructure is better than ever, which is consistent with China’s infrastructure investment. In addition, farmers’ willing to invest in rural infrastructure construction was strong with a score of 6.0413, indicating their eagerness to improve rural infrastructure. This is because infrastructure development has a positive influence on agricultural land and regional sustainable development [43]. China’s rural construction over the past 10 years has caused farmers to gain confidence in the construction of rural infrastructure. However, many farmers do not believe existing rural infrastructures are put to full use. The score for impression of full use was 3.3817, which was the lowest among all factors. This suggests that some existing infrastructures are unnecessary, and some are negatively viewed as “vanity projects.” While investment in rural infrastructure has increased, it is not effectively used where it is most needed. In the future, we should pay more attention to the real needs of rural areas and farmers in the construction of rural infrastructure. Regarding environmental perceptions, farmers generally believed that construction did not improve the rural environment (score: 3.9421). It is clear that damage will occur if China does not pay sufficient attention to the environment during the process of rapid infrastructure construction.

The weight of the performance appraisal of rural infrastructure construction reflects the importance of various indexes. This study found that the index weights for overall impression of quality, sense of quality under given costs, complaints to others, complaints to relevant departments, possibility of building information transparency, and possibility of no corruption were the largest at 0.0682. Weight depended on the experience of professionals, and their degree of specialization was high. From their perspective, farmers’ complaints greatly influence the performance appraisal of rural infrastructure construction. Different types of complaints may come from different lifestyles, and they are important in the performance appraisal of rural infrastructure construction [44]. The possibility of building information transparency and of no corruption also greatly influence performance appraisal. We should, therefore, focus on information transparency and on preventing corruption in future rural infrastructure construction. This also highlights the need for better supervision. Experts emphasized the quality of rural infrastructure construction, so the overall impression of quality and the sense of quality under given costs had the highest weight.

This performance appraisal of rural infrastructure construction fully considered farmers’ perceptions and professional advice. At 0.3293, the possibility of building information transparency had one of the highest scores; it was very large for both farmers and experts. This is in line with the conclusion that information transparency has an important influence on the performance appraisal of infrastructure [45]. We can conclude that construction administrative departments should increase the transparency of information regarding rural infrastructure construction in the future. Governments should open all information channels to help villagers understand rural infrastructure construction, and for balance, governments should accept feedback from villagers. The longitudinal comparison score of 0.3285 reflects the fact that rural infrastructure is under constant development. Studying the index of the longitudinal comparison of rural infrastructure from the perspective of experts is very important for performance appraisal and emphasizes the importance of development. The experiences of experts are also very important for urban infrastructure construction [46].

The performance appraisal indexes were selected from the relevant literature as well as discussions with rural students and experts in Sichuan Province. In addition, the relationships between the indexes were judged by 91 experts in Sichuan Province. As such, the conclusions have strong geographical applicability, and different areas may yield different findings.

The performance appraisal of rural infrastructure should also consider aspects such as technology, planning, location, and project management. Since this study evaluated rural infrastructure based only on farmer satisfaction, it has strong subjectivity. In future work, other aspects should be added for a more comprehensive appraisal.

Conclusion

Based on previous studies, this research established a comprehensive ACSI-ISM-ANP framework for rural infrastructure performance evaluation [37,39,42,46]. A systematic integration of the experiences of infrastructure construction experts and the judgments of infrastructure users was used to evaluate rural infrastructure performance. Overcoming the problem of one-sided performance evaluation in the past, this approach not only satisfies the scientific aspect of performance evaluation but also considers the needs of infrastructure end users.

The performance appraisal score for rural infrastructure in Sichuan Province was determined to be 4.7606. Based on farmer satisfaction, this score is relatively low. According to the data analysis, farmers are most satisfied with the longitudinal comparative perception of rural infrastructure construction. The possibility of participation in rural infrastructure investment is also relatively high. However, farmers have a very bad impression of the function and application of rural infrastructure. They are also dissatisfied with the effect on the environment. From the index of evaluation weights, this study concludes that the performance of rural infrastructure construction affects farmers’ complaints, the possibility of transparency, and the possibility of no corruption a great deal. Moreover, transparency in building information has the highest value, followed by longitudinal comparison.

Appraising the performance of rural infrastructure construction should cover a wide range of aspects. This study conducted the performance appraisal of rural infrastructure construction based only on farmer satisfaction. Thus, the authors intend to gradually consider and study other aspects.

Acknowledgments

The authors express gratitude to all of the staff involved in the questionnaire, without whom this study would not have succeeded. The authors also wish to thank the construction management students for participating in the questionnaires and household surveys. In addition, sincere thanks go to the leaders of the local construction administrative department for their support in investigating the feasibility report review meeting, which enabled us to obtain professional suggestions.

References

  1. 1. National Bureau of Statistics of China. China Statistical Yearbook 2015, Available online: http://www.stats.gov.cn/tjsj/ndsj/2015/indexch.htm (accessed on 4 May 2016).
  2. 2. Boz MA, El-adaway IH (2015) Creating a Holistic Systems Framework for Sustainability Assessment of Civil Infrastructure Projects. Journal Of Construction Engineering And Management 141.
  3. 3. Domingo N (2015) Assessment of the Impact of Complex Healthcare Features on Construction Waste Generation. Buildings 5: 860–879.
  4. 4. Shen LY, Wu YZ, Zhang XL (2013) Key Assessment Indicators for the Sustainability of Infrastructure Projects (vol 137, pg 441, 2011). Journal Of Construction Engineering And Management 139: 591–591.
  5. 5. Torres-Machi C, Chamorro A, Yepes V, Pellicer E (2014) Current models and practices of economic and environmental evaluation for sustainable network-level pavement management. Revista De La Construccion 13: 49–56.
  6. 6. Reza B, Sadiq R, Hewage K (2014) Emergy-based life cycle assessment (Em-LCA) for sustainability appraisal of infrastructure systems: a case study on paved roads. Clean Technologies And Environmental Policy 16: 251–266.
  7. 7. Parrish K, Chester M (2013) Life-Cycle assessment for construction of sustainable infrastructure. Practice periodical on structural design and construction 19: 89–94.
  8. 8. Glick S, Guggemos AA (2013) Rethinking wastewater-treatment infrastructure: case study using life-cycle cost and life-cycle assessment to highlight sustainability considerations. Journal of Construction Engineering and Management 139: A5013002.
  9. 9. Ariaratnam ST, Piratla K, Cohen A, Olson M (2013) Quantification of Sustainability Index for Underground Utility Infrastructure Projects. Journal Of Construction Engineering And Management 139.
  10. 10. Bocchini P, Frangopol DM, Ummenhofer T, Zinke T (2014) Resilience and Sustainability of Civil Infrastructure: Toward a Unified Approach. Journal Of Infrastructure Systems 20.
  11. 11. Zhou J, Liu YJ (2015) The Method and Index of Sustainability Assessment of Infrastructure Projects Based on System Dynamics in China. Journal Of Industrial Engineering And Management-Jiem 8: 1002–1019.
  12. 12. Anagnostopoulos K, Vavatsikos A (2012) Site Suitability Analysis for Natural Systems for Wastewater Treatment with Spatial Fuzzy Analytic Hierarchy Process. Journal Of Water Resources Planning And Management-Asce 138: 125–134.
  13. 13. Chunchao W (2010) Study on the Will of Peasants participating in the Financing of the Construction for Rural Infrastructure——Household Survey of 19 Villages in Guangdong as An Example [J]. Shanghai Journal of Economics 3: 005.
  14. 14. Ma L.J. Analysis on Government’s Role and Farmers’ Will in Investment in Rural Infrastructure: Take Drinking Water, Schools, and Irrigation as Examples. Finance and Trade Research. 2009; vol. 3:38–42.
  15. 15. Yi H-m, Zhang L, Denise H, Liu C (2008) The Provision of Infrastructure and Farmers Demand——Evidence from 5 Province. China Soft Science 11: 106–115.
  16. 16. Gan J.; Zhu Y.C. Study on the Participation of Private Capital in Rural Infrastructure: Based on an Investigation of 31 Villages and Towns in the Resource-Rich Regions of Shanxi, Shaanxi, and Inner Mongolia. Inquiry into Economic Issues. 2011; vol.11:153–158.
  17. 17. Hao E.H.; Hu K.; Chen X.P. Income Increase Effect of Rural Infrastructures: Based on the Data Analysis of 30 Provinces in China. Rural Economy. 2015; vol. 4: 64–68.
  18. 18. Fan L.M.; Luo Y.M. Analysis on the Influence Factors of Farmers’ Satisfaction to Rural Infrastructure: Structural Equation Modeling Based on 670 Questionnaires. Issues in Agricultural Economy. 2009; 9: 51–59.
  19. 19. Zhang K.H.; Wan M. Study on the Will of Peasants Participating in the Financing of the Construction for Rural Infrastructure. Journal of Zhongnan University of Economics and Law. 2009; vol.176, no.5:36–41.
  20. 20. Bassioni HA, Price ADF, Hassan TM (2004) Performance measurement in construction. Journal Of Management In Engineering 20: 42–50.
  21. 21. Ramani TL, Zietsman J, Knowles WE, Quadrifoglio L (2011) Sustainability Enhancement Tool for State Departments of Transportation Using Performance Measurement. Journal Of Transportation Engineering-Asce 137: 404–415.
  22. 22. Lai IK, Lam FK (2010) Perception of various performance criteria by stakeholders in the construction sector in Hong Kong. Construction Management and Economics 28: 377–391.
  23. 23. Zhang S.B.; Hou X.W.; Yang Q.B. Performance Measurement of Engineering Contractor Project Based on BSC and ANP. Statistics and Decision. 2012; vol.1:175–178.
  24. 24. Cardozo RN (1965) An experimental study of customer effort, expectation, and satisfaction. Journal of marketing research: 244–249.
  25. 25. Howard JA, Sheth JN (1969) The theory of buyer behavior.
  26. 26. Day RL, Bodur M (1977) A comprehensive study of satisfaction with consumer services. Consumer satisfaction, dissatisfaction and complaining behavior: 64–70.
  27. 27. Hunt HK (1991) Consumer Satisfaction, Dissatisfaction, And Complaining Behavior. Journal Of Social Issues 47: 107–117.
  28. 28. Fornell C, Larcker DF (1981) Evaluating Structural Equation Models with Unobservable Variables And Measurement Error. Journal Of Marketing Research 18: 39–50.
  29. 29. Liu H-Y, Jian L, Ge Y-X (2006) Design of customer satisfaction measurement index system of EMS service. The Journal of China Universities of Posts and Telecommunications 13: 109–113.
  30. 30. Hsu SH (2008) Developing an index for online customer satisfaction: Adaptation of American customer satisfaction index. Expert Systems with Applications 34: 3033–3042.
  31. 31. Wen-yia L, Kun-pengb X (2011) Farmers' Satisfaction Model and Evaluation Indexes in Rural Public Infrastructure. Journal of Hubei University of Education 5: 022.
  32. 32. Wenyi L (2012) Study on evaluation of farmers satisfaction of the rural public infrastructure. Journal of Chongqing University (Social Science Edition) 4: 001.
  33. 33. Ma J.Q. A Research on Local Government Project Performance Evaluation Base on Public View. Wu Han, China. Wuhan Textile University. 2013:15–17.
  34. 34. Warfield JN (1973) Binary Matrices In System Modeling. Ieee Transactions on Systems Man And Cybernetics Smc3: 441–449.
  35. 35. Saaty RW (1987) The analytic hierarchy process—what it is and how it is used. Mathematical modelling 9: 161–176.
  36. 36. Saaty TL (2004) Fundamentals of the analytic network process—Dependence and feedback in decision-making with a single network. Journal of Systems science and Systems engineering 13: 129–157.
  37. 37. Sierra LA, Yepes V, Pellicer E (2018) A review of multi-criteria assessment of the social sustainability of infrastructures. Journal of Cleaner Production 187: 496–513.
  38. 38. Sierra LA, Yepes V, García-Segura T, Pellicer E (2018) Bayesian network method for decision-making about the social sustainability of infrastructure projects. Journal of Cleaner Production 176: 521–534.
  39. 39. Sierra LA, Yepes V, Pellicer E (2017) Assessing the social sustainability contribution of an infrastructure project under conditions of uncertainty. Environmental Impact Assessment Review 67: 61–72.
  40. 40. Jeong JS, García-Moruno L, Hernández-Blanco J (2013) A site planning approach for rural buildings into a landscape using a spatial multi-criteria decision analysis methodology. Land Use Policy 32: 108–118.
  41. 41. Barengo NC, Medagama A, Galgomuwa M (2018) Lack of infrastructure, social and cultural factors limit physical activity among patients with type 2 diabetes in rural Sri Lanka, a qualitative study. Plos One 13: e0192679. pmid:29462186
  42. 42. Sierra LA, Pellicer E, Yepes V (2017) Method for estimating the social sustainability of infrastructure projects. Environmental Impact Assessment Review 65: 41–53.
  43. 43. Bacior S, Prus B (2018) Infrastructure development and its influence on agricultural land and regional sustainable development. Ecological Informatics 44: 82–93.
  44. 44. Sierra LA, Pellicer E, Yepes V (2015) Social sustainability in the lifecycle of chilean public infrastructure. Journal of Construction engineering and management 142: 05015020.
  45. 45. Munda G, Russi D (2008) Social multicriteria evaluation of conflict over rural electrification and solar energy in Spain. Environment and Planning C: Government and Policy 26: 712–727.
  46. 46. Munda G (2006) Social multi-criteria evaluation for urban sustainability policies. Land Use Policy 23: 86–94.