Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Green material selection for sustainability: A hybrid MCDM approach

  • Honghao Zhang,

    Affiliation Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic and Transportation Engineering, Central South University, Changsha, China

  • Yong Peng ,

    yong_peng@csu.edu.cn (YP); tiangd2013@163.com (GT)

    Affiliation Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic and Transportation Engineering, Central South University, Changsha, China

  • Guangdong Tian ,

    yong_peng@csu.edu.cn (YP); tiangd2013@163.com (GT)

    Affiliation Transportation College, Jilin University, Changchun, China

  • Danqi Wang,

    Affiliation College of Automotive Engineering, Jilin University, Changchun, China

  • Pengpeng Xie

    Affiliation Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic and Transportation Engineering, Central South University, Changsha, China

Abstract

Green material selection is a crucial step for the material industry to comprehensively improve material properties and promote sustainable development. However, because of the subjectivity and conflicting evaluation criteria in its process, green material selection, as a multi-criteria decision making (MCDM) problem, has been a widespread concern to the relevant experts. Thus, this study proposes a hybrid MCDM approach that combines decision making and evaluation laboratory (DEMATEL), analytical network process (ANP), grey relational analysis (GRA) and technique for order performance by similarity to ideal solution (TOPSIS) to select the optimal green material for sustainability based on the product's needs. A nonlinear programming model with constraints was proposed to obtain the integrated closeness index. Subsequently, an empirical application of rubbish bins was used to illustrate the proposed method. In addition, a sensitivity analysis and a comparison with existing methods were employed to validate the accuracy and stability of the obtained final results. We found that this method provides a more accurate and effective decision support tool for alternative evaluation or strategy selection.

Introduction

While rapid urbanization and industrialization exacerbate the rate of resource shortages and environmental pollution worldwide, the promotion of sustainability has been increasing and gaining public momentum [13]. In the summit of the Group of Twenty (G20), sustainability in the global economy was one of the most crucial issues that have become highly appreciated. Subsequently, collective action plans regarding the sustainable development agenda in 2030 were formulated by the G20 leaders. Moreover, a large body of literature and research studies on sustainability, particularly involving material selection, have been generated by the relevant experts in recent years [47].

Green material selection, also called sustainable material selection, plays a significant role throughout the design-manufacturing process, which seeks to guarantee product performance and reduce the entire life-cycle impact to the environment and human health. Thus, it has been the subject of many studies [810]. Akadiri et al. [11] presented a novel model for building material selection via the fuzzy extended analytical hierarchy process (AHP) techniques. Maniya and Bhatt [12] applied the preference selection index method to seek a proper material that meets the design engineers' requirements. Chatterjee et al. [13] explored a new integrated multi-criteria decision making (MCDM) method that combines the complex proportional assessment method and the evaluation of mixed data method to select the optimal material alternative. However, when selecting the suitable green material for design products, various criteria or attributes, e.g., cost, physical property and environmental performance, should be considered simultaneously rather than only considering a single criterion for design engineers. Obviously, each material has distinctive performance for different properties, and no one can satisfy all the relevant properties. Therefore, green material selection should be viewed as a complex MCDM problem. To address this problem, a systematic and reasonable method is required.

Up to now, there are two types of methods to solve MCDM problem: synthetical assessment approaches[1424], e.g., multi-attribute utility theory, technique for order performance by similarity to ideal solution (TOPSIS) and approaches based on the theory of life cycle assessment [25]. In addition, some integrated methods have been successfully applied to overcome the shortcomings of single one [2629], e.g., AHP and TOPSIS, AHP and vlse kriterijumska optimizacija kompromisno resenje (VIKOR). However, this existing decision analysis approaches still have some problems to be solved in the decision model [30]. Therefore, to obtain the optimal material more reasonably and reduce subjectivity, it is essential to promote and optimize the assessment process.

This study proposes a hybrid MCDM approach combining DANP and G-TOPSIS that integrated GRA with TOPSIS to select optimal green material for sustainability based on product's needs. Among them, DEMATEL is used to analyze the interrelationship and influence of each criterion, and ANP is employed to calculate the final weights of criteria and evaluate each alternative to select the optimal green material via G-TOPSIS. An empirical application of rubbish bins is used to illustrate this hybrid MCDM method. In addition, a sensitivity analysis and comparison with existing methods are employed to validate the accuracy and stability of the obtained final results. In comparison with existing studies, this work has the following three distinctive contributions: 1) Establish a suitable hierarchy structure of each criterion, considering the economic, environment and physical properties. 2) Propose a hybrid MCDM approach that combines DANP and G-TOPSIS to obtain the weight of each criterion and select the optimal green material logically and effectively. 3) To reduce/avoid subjectivity and irrationality, a nonlinear programming is applied to make G-TOPSIS more reasonable.

The remainder of this paper is organized as follows. Section 2 describes the literature review. The hybrid MCDM method is proposed in Section 3. In Section 4, the proposed method is presented and applied to the case of rubbish bins. Analysis and discussion of the results are presented in Section 5. In last section, the conclusions are presented.

Literature review

Material selection has great importance in the design and development of products, and it is also critical for the success and competitiveness of the producers. Improper selection of materials may result in damage or failure of an assembly and significantly decreases the performance of products, thus negatively affecting productivity, profitability and reputation of an organization [3132]. In the literature, many investigations and studies have been conducted in various contexts to select material alternative based on different requirements/backgrounds which include eco-innovation, green manufacturing, market demand and so on, for real engineering processes [16, 3336]. Note that sustainability as a philosophy has been gradually entering design and manufacturing industries for products to combat climate change under umbrella terms [3739]. It is essential to carry out the study of material selection under the background of sustainable development [4041].

The selection of material alternatives is a multi-objective problem subject to compound constraints which can be viewed as a complex MCDM problem [23]. The objectives and criteria in the material selection process are often in conflicts and it involves trade-offs amongst decisive criteria. To ease out the material selection procedure and make the right decision, a systematic and efficient approach is required. Nowadays, a lot of mathematical techniques have been developed and applied in material selection field. For example, Anojkumar et al. [42] developed a hybrid MCDM method by combing four MCDM methods for solving pipes material selection difficulty in sugar industry to choose the best pipe material. Liu et al. [31] presented an interval 2-tuple linguistic VIKOR (ITL-VIKOR) method for solving the material selection problem under uncertain and incomplete information environment. Huang et al. [43] presented a new MCDM model and uncertainty analysis method for the environmentally conscious material selection problem. TOPSIS method is employed and uncertainty analyses were performed for model flexibility and efficiency by addressing the materials selection challenge. Liu et al. [44] proposed a hybrid decision making approach integrating induced aggregation operators into VIKOR in an MCDM problem regarding the selection of materials and the results are compared for different types of standardized distance aggregation operators. Table 1 presents the commonly used approaches in material alternatives evaluation and selection.

thumbnail
Table 1. Applications of MADM methods for material selection in different areas.

https://doi.org/10.1371/journal.pone.0177578.t001

The literature review demonstrates that the majority of researchers concentrated on material selection methods applying MCDM approaches. Although the existing methods provide many useful tools for material selection. However, most of them still ignore some aspects, e.g., physical properties is rarely considered which plays an significant role in the assessment process for green material alternatives; TOPSIS method as a commonly used tool is not suitable to assess all kinds of material alternatives due to its measurement scale is distance. Therefore, this study proposes a hybrid MCDM approach combining DANP and G-TOPSIS that integrated GRA with TOPSIS to select optimal green material for sustainability based on product's needs and formulate a new hierarchical structure including economic, environment, and physical properties.

Solution methodology

A hybrid MCDM approach that combines DANP and G-TOPSIS is proposed to select the optimal green material alternative for certain product. DANP is applied to analyze the influences and interrelationships among each criterion and obtain the final weights of each criterion. The optimal alternative will be evaluated via G-TOPSIS. The specific procedures and processes of both phases are summarized in the following sub-sections.

DANP

ANP, as an extension of AHP, was proposed by Saaty to address the interdependence and feedback among each criterion and alternative in the practical problem [61, 62]. However, the normalization method of supermatrix is not appropriate because each cluster, which originates from the allocation of each criterion in a column, has the same weight in the traditional process. There are varying degrees of impact among the clusters of criteria in the practical problem [29, 63]. Thus, DEMATEL is applied to improve the normalization process in ANP, namely DANP. It has been successfully employed in various fields, e.g., vendor selection and material selection [6, 6465]. The procedure can be summarized as shown in Appendix A.

G-TOPSIS

TOPSIS is an MCDM method proposed by Hwang and Yoon in 1981 [66]. The operating principium is that the optimal solution must satisfy certain conditions, i.e., the shortest distance from the positive-ideal solution and the longest distance from the negative-ideal solution [67, 68]. It has been commonly applied in various fields, e.g., weapon selection, material selection, and alternative evaluation [6972]. However, some problems cannot be resolved by TOPSIS in several special cases, e.g., when the distances of the alternatives to positive-ideal and negative-ideal solutions is equal. Thus, G-TOPSIS, which integrates GRA with TOPSIS, is proposed to obtain the final rank of each alternative and select the optimal green material for certain product. Additionally, to avoid the subjectivity and irrationality, a nonlinear programming model with constraints is proposed to obtain the integrated closeness index based on the similarity closeness index from GRA and the distance closeness index from TOPSIS. The procedure can be summarized as follows:

  1. Step 1: Construct a decision matrix for the selection of the optimal material. The decision matrix X = [xij]n×m can be presented as Eq (1). (1) where xij is a crisp value that indicates the performance rating of each alternative Ai (i = 1, 2, …, n) with respect to each criterion Bj (j = 1, 2, …, m).
  2. Step 2: Obtain the normalized decision matrix Z combined with the weight vector of criteria ω that is obtained via DANP.
    For the benefit criteria, the normalized value yij could be calculated as (2)
    For the cost criteria, the normalized value yij could be calculated as (3) (4)
  3. Step 3: Establish the positive-ideal and negative-ideal solutions. Based on the operating principium of TOPSIS, the positive-ideal and negative-ideal solutions play a significant role in the arithmetic process and can be obtained as Eqs (5) and (6). (5) (6) where J+ represents the index set for which the greater the better, and J- represents the index set for which the smaller the better.
  4. Step 4: Calculate the grey correlation coefficient between the ith alternative and positive-ideal alternative regarding the jth criterion. The procedure is presented as follows: (7) where ρ∈[0, 1] indicates the resolution factor. As a general rule, ρ = 0.5 [22].
    The grey correlation coefficient matrix regarding each alternative and positive-ideal solution is shown in Eq (8). (8)
    The grey correlation degree between the ith alternative and the positive-ideal solution can be obtained according to Eq (9). (9)
  5. Step 5: Obtain the grey correlation coefficient between the ith alternative and negative-ideal solution regarding the jth index in the same way of Step 4. (10)
    The grey correlation coefficient matrix regarding each alternative and negative-ideal solution is shown in Eq (11). (11)
    The grey association degree between the ith alternative and the negative-ideal can be obtained according to Eq (12). (12)
  6. Step 6: Obtain the separation measures. The separation of each alternative from the positive-ideal solution is calculated as (13)
    Similarly, the separation of each alternative from the negative-ideal solution is calculated as (14)
  7. Step 7: Apply the dimensionless method to , , and . (15) where Mi represents , , and .
  8. Step 8: Calculate the similarity closeness index and the distance closeness index. For GRA approach, represents the grey correlation degree between the ith alternative and the positive-ideal solution. The larger the value Ri, the more similar the alternative i to the positive-ideal alternative, the better the alternative. Similarly, for TOPSIS approach, the larger the value Di, the larger the separation of alternative i from the negative-ideal alternative, the better the alternative. (16) (17)
  9. Step 9: Construct the integrated closeness index. To avoid subjectivity and irrationality, nonlinear programming is applied to calculate the integrated closeness index CSi based on the similarity closeness index and the distance closeness index. Assuming that these two indices have the same weight, the nonlinear programming model with constraints can be structured as follows:
    Subsequently, a complex method and a penalty function method can be employed to address this nonlinear programming model [7374]. Note that the larger the value CSi, the better the alternative.

A hybrid MCDM method

To select the optimal alternative more objectively and rationally, this work proposes a novel hybrid MCDM approach that combines DANP and G-TOPSIS. This method applies the quantitative analysis and weight allocation features of DANP and the comprehensive optimization ability of G-TOPSIS to avoid some of the shortcomings and deficiencies of each method alone. A detailed flowchart is shown in Fig 1.

Phase 1: Obtain the weights of each criterion for optimal green material selection via DANP.

The integrated DEMATEL and ANP process presented in Section 2.1 is applied to get the weights of each criterion while accounting for dependence and feedback. A hierarchical structure regarding the evaluation criteria is built, as shown in Fig 2. According to the classification of each criterion, DEMATEL is applied to analyze the interrelationship and influence of each criterion, and ANP is employed to calculate the weights of criteria.

thumbnail
Fig 2. Causal influence diagrams for the dimensions and criteria.

https://doi.org/10.1371/journal.pone.0177578.g002

Phase 2: Determine the final rank and select the optimal green material for certain product by G-TOPSIS.

The final rank of each alternative and optimal green material can be calculated via G-TOPSIS combining GRA and TOPSIS. Additionally, to avoid subjectivity and irrationality in the integration process, a nonlinear programming model with constraints is proposed to obtain the integrated closeness index CSi based on the similarity closeness index Ri from GRA and the distance closeness index Di from TOPSIS. Note that CSi falls between 0 and 1. The larger the value of CSi, the better the performance of the material alternatives.

Verification of the empirical case

An empirical case of rubbish bins is provided to demonstrate this integrated method, i.e., DANP and G-TOPSIS. In the following sections, the background, the hierarchical structure of criteria and the optimization processes will be discussed respectively.

Background and data collection

As a common tool for daily life, the utilization and production of rubbish bins continue to increase; material selection is also an MCDM problem that must be treated with caution for sustainability. Currently, several commonly used material for rubbish bins are aluminum (Al), ABS plastic (ABS) and polyurethane (PU). In addition, production and recycling are closely related. While selecting a suitable material for production, it is necessary to choose corresponding product recovery and disposal strategies, i.e., recycling and remanufacturing (REM), recycling and incineration (INC), and recycling and landfill (LND). Thus, there are five material alternatives, i.e., Al-REM, ABS-INC, ABS-LND, PU-INC and PU-LND.

Raw data and related information can be gathered via experts from various fields, e.g., scholars of college and supervisors of enterprise, through questionnaire surveys. In this research, six experts, including two scholars who specialize in material selection, two supervisors from related companies with a good reputation, and two customers who have used these products for over three years, were interviewed to obtain the direct-relation matrix of each criterion and the decision matrix for the selection of optimal material. This investigation was conducted in August 2016. According to the statistical data from the six questionnaires, the inconsistent rate is 4.6% [75]. Thus, it can be summarized that the credibility is 95.40%, and additional questionnaires will not impact the optimization results.

Hierarchical criteria of material selection

This large number of materials, coupled with the complex relationships between the different selection parameters, often make the selection of a materials for a given component a difficult task. The establishment of hierarchical criteria is a crucial step in green material selection, and it has great influence upon the accuracy and reliability of material alternatives evaluation. In selecting materials, designers and engineers have to take into account a large number of criteria. These criteria for material include social (e.g. operational life, esthetics, health and safety), technical (e.g., maintainability, resistance to decay, life expectancy), environmental (e.g., energy saving, potential for recycling and reuse, raw material extraction) and economic (initial cost, maintenance cost, disposal cost) [6, 7678]. Physical properties have been applied in material selection, which plays an significant role in the assessment process for green material alternatives for real engineering processes [7980]. However, there are rarely hierarchical structures that combining the physical properties with other important attributes, i.e., economic and environment, in the previous studies. In addition, there are no relatively accurate index weights for physical properties in the evaluation process of material selection.

Therefore, to discover and inherit more suitable sustainable properties/criteria, we reviewed the existing literature and interviewed experienced experts from colleges/enterprises. Thus, the hierarchical structure of criteria for their green material selection was built, as tabulated in Table 2. The structure includes three levels, i.e., goal, cluster and criterion. The goal level (G) is green material selection (G1). The cluster level (E) involves economic (E1), environment (E2), and physical (E3) properties. Economic properties include initial cost (C1), maintenance cost (C2), disposal cost (C3), and tax contribution (C4). Environment properties include energy saving (C5), potential for recycling and reuse (C6), raw material extraction (C7), usage of water (C8), and CO2 emission (C9). Physical properties include density (C10), rigidity (C11), tensile strength (C12), elongation at break (C13), and tensile modulus (C14). The attributes of each criterion are shown in Table 2. Note that rigidity (C11) and tensile modulus (C14) are fixed index (the closer the attribute value is to a fixed value ti, the better the attribute). The fixed value ti is determined by the type of the product. To simplify the optimization process, we convert fixed index into cost index by calculating the evaluation value, i.e., the absolute value of the difference between the initial value with the fixed value. The smaller the evaluation value, the better the criterion.

thumbnail
Table 2. Hierarchical structure of criteria for material selection.

https://doi.org/10.1371/journal.pone.0177578.t002

Weighting of criteria via DANP method

The calculation procedure is structured by combining DEMATEL with ANP (in Section 2.1 and Appendix A). As shown in Appendix A, the direct-relation matrix could be formulated from the responses of six experts (Due to space limitations, the averaged direct-relation matrix for criteria and dimensions are only given here as shown in Tables 3 and 4).

thumbnail
Table 3. The averaged direct-relation matrix for criteria.

https://doi.org/10.1371/journal.pone.0177578.t003

thumbnail
Table 4. The averaged direct-relation matrix for the dimensions.

https://doi.org/10.1371/journal.pone.0177578.t004

Based on the calculation steps of DANP, the final weight of each criterion can be acquired as follows: a) the normalized initial direct-relation matrix can be calculated using Eqs (18) and (19); b) the total direct-relation matrix is obtained through Eq (20); c) each row sum vector r and column sum vector s of the total direct-relation matrix T are separately produced, as shown in Eqs (21) and (22), and the results are shown in Tables 5 and 6; d) the causal influence diagram is established based on the ri + ci and rici values respectively. The causal influence diagrams of criteria and the dimensions are shown in Fig 2; e) the unweighted supermatrix can be developed through Eqs (23)(28); f) the weighted supermatrix can be obtained according to Eqs (29)(31); and g) the result of limiting the weighted supermatrix is shown in Table 6.

thumbnail
Table 5. Sum of the influences given and received regarding criteria.

https://doi.org/10.1371/journal.pone.0177578.t005

thumbnail
Table 6. Sum of the influences given and received regarding the dimensions.

https://doi.org/10.1371/journal.pone.0177578.t006

Rank the material alternatives via G-TOPSIS method

The calculation procedure is structured by combining GRA with TOPSIS (in Section 2.2). By reviewing the related literature [5, 26] and investigations by experts, a decision matrix for five material alternatives, i.e., Al-REM, ABS-INC, ABS-LND, PU-INC and PU-LND, is constructed, as shown in Table 7. Note that the value of ti is 55 for the rigidity (C11) and the value of ti is 10 for the tensile modulus (C14).

thumbnail
Table 7. A decision matrix for five material alternatives.

https://doi.org/10.1371/journal.pone.0177578.t007

The ranking of five material alternatives can be calculated via G-TOPSIS method, as described in Section 2.2. The steps can be divided into the following five parts: a) from Steps 1 to 2, the normalized decision matrix Z combined with the weight vector of criteria ω is obtained; b) the positive-ideal and negative-ideal solutions can be calculated using Step 3; c) the grey correlation coefficient between the ith alternative and the positive-ideal alternative regarding the jth criterion is obtained via Step 4, and similarly, the grey correlation coefficient between the ith alternative and the negative-ideal solution regarding the jth index can be calculated using Step 5; d) the similarity closeness index and the distance closeness index are acquired according to Steps 6–8; and e) the integrated closeness index is gained using a nonlinear programming model with constraints as shown in Step 9, and the final rank can be obtained, with the ranking presented in Table 8.

Analysis and discussion

Comparison to existing methods

To prove the feasibility and validity of the proposed method, GRA, TOPSIS and VIKOR [9, 88] were applied to compare their outcomes. Note that the same weights of criteria were applied in the calculation process of the four methods. The analysis is conducted on the basis of the same illustrative example. Based on Table 8, the integrated closeness indices of the four methods, i.e., GRA, TOPSIS, VIKOR and G-TOPSIS, can be figured in Fig 3.

From Fig 3, it can be summarized that the final ranks of material alternatives via the four methods are basically consistent. Thus, this proposed method, i.e., DANP and G-TOPSIS, is a reasonable and effective method to evaluate the performance of material alternatives and select the optimal green material. Subsequently, based on the results of the four methods, the first material alternative, that is Al-REM, is the optimal green material to produce rubbish bins. In addition, the ranks of the five material alternatives are different using the four methods. The causes of this phenomenon are summarized as follows: 1) the degree of information utilization is different in different information aggregation methods, and a large amount of information can be easily lost in the aggregation process; 2) the operating principium of TOPSIS is based on the distance from the positive-ideal solution and the negative-ideal solution; however, it does not consider the degree of similarity to the ideal solution; and 3) similarly. GRA only takes into account the degree of similarity to the ideal solution, thereby easily resulting in information loss. Therefore, we propose a hybrid MCDM approach combining DANP and G-TOPSIS to obtain the weight of each criterion and select the optimal green material logically and effectively. In addition, nonlinear programming is applied to make G-TOPSIS more reasonable.

Sensitivity analysis

To monitor the robustness of the evaluation and selection for green materials, a sensitivity analysis that contains 19 experiments is conducted according to the weight change of each criterion. Table 9 presents the details of the experiment. For each condition, the integrated closeness indices of each material alternative are calculated. From Table 9, in the first 14 experiments, weights of each criterion are set as higher respectively, whereas the other criteria are set to be same. In experiment 15, the weights of criteria (C1–C8) = 0.125, whereas the other criteria weights are equal to zero. In experiment 16, the weights of criteria (C9–C14) = 0.167, whereas the other criteria weights are equal to zero. In experiment 17, the weights of all criteria of economic (C1–C4) = 0.25, whereas the other criteria weights are equal to zero. In experiment 18, the weights of all criteria of environment (C5–C9) = 0.2, whereas the other criteria weights are equal to zero. In experiment 19, the weights of all criteria of physical property (C10–C14) = 0.2, whereas the other criteria weights are equal to zero.

As shown in Table 9, the changes in the final ranks of the five material alternatives when the weights of the criteria are changed can be figured in Fig 4. According to Table 9 and Fig 4, the following conclusions can be obtained as follows: 1) out of the 19 experiments, alternative 1, that is Al-REM, has the highest score in the 11 experiments, i.e., experiment numbers (2, 3, 7–12, 14, 16, 19); hence, the ranking of the solutions of the five material alternatives is relatively sensitive to the criteria weights; and 2) the final ranking of the alternatives changes greatly with the weight vary of each criterion. Therefore, obtaining the weight of each criterion reasonably and scientifically plays a significant role in the selection of the optimal green material.

Discussion

By comparing the results from the three methods and the sensitivity analysis (as shown in Figs 3 and 4), it can be confirmed that this hybrid MCDM method is effective for the selection of the optimal choice from the material/design alternatives. Additionally, to illustrate that this method is better than the traditional methods, the significance of the present study can be summarized as follows:

From Table 6 and Fig 2. it can be seen that each cluster has feedback and dependence. In other words, the status of each cluster is different. In this paper, the degree that cluster 1 is affected by the other clusters (4.9286) is higher than the degrees for the others (4.5000, 4.5714). Thus, cluster 1 should occupy a greater proportion in the operation process. However, in the traditional method, e.g., AHP and ANP, it is assumed that each cluster has the same weight. The final weights of each cluster are either higher or lower than the realistic values. Therefore, this paper combines DEMATEL to improve the normalization of ANP in the unweighted supermatrix, and the results confirmed that it can be used to obtain the final weights of each cluster more reasonably. In addition, as shown in Table 8 and Fig 3, the final ranks from different methods are unstable, e.g., PU-INC is better than ABS-LND via DANP-GRA, in contrast, ABS-LND is better than PU-INC via DANP-TOPSIS. The reason for this difference is that each single method has its limitations, which will impact the final rank (the detailed limitation is summarized in the sub-section G-TOPSIS). Therefore, G-TOPSIS is proposed to rank the material alternatives effectively. To avoid subjectivity and irrationality, a nonlinear programming model with constraints is proposed to obtain the integrated closeness index based on the similarity closeness index from GRA and the distance closeness index from TOPSIS. In addition, a comparison and a sensitivity analysis are employed to confirm the accuracy and effectiveness.

The practical implication could be summarized from our study as follows: 1) by DANP, it can be seen that potential for recycling and reuse (C6) (0.112), usage of water (C8) (0.092), and energy saving (C5) (0.086) are found to have a large impact on the green material selection since these criteria carry relatively larger weights. Thus, their reasonable control can greatly contribute to a better design for engineers/designers. In addition, the results of the sensitivity analysis illustrate the importance of establishing a qualified group of experts/designers in the design evaluation. 2) The selection of the optimal material alternative is essential for the sustainable development of products. The main contribution of this work is the definition and development of an effective evaluation framework to guide managers to assess green material alternatives. To the best of our knowledge, no studies exist on devising a hybrid MCDM method that integrates DANP and G-TOPSIS to solve a green material selection problem for sustainable development. The results confirm that this method overcomes the one-sidedness of DANP-TOPSIS and DANP-GRA and makes the evaluation results more objective and realistic. In addition, the results of comparing with VIKOR confirmed that the final rank of this proposed approach is credible. Clearly, this study provides a more accurate, effective and systematic decision support tool for green material selection. In addition, this study can be useful for researchers to better understand the green material selection problem theoretically, as well as to organizations in designing/developing a better green design evaluation system.

Conclusion

Sustainable development is a difficult and restrained task for all walks of life, e.g., the manufacturing industry and the environmental protection agency. It has also been a great concern to countries, especially developing countries. In addition, previous research studies have proposed many solutions and optimization methods, with determining how to select the optimal material being one of the key problems. In this paper, we proposed a hybrid MCDM approach that combines DANP and G-TOPSIS to evaluate the material alternatives and select the optimal material for sustainability. This method not only handles the complex interactions and interdependences among dimensions and criteria, but also provides a visible causal relationship diagram to obtain the weights of each criterion for material selection. In addition, it combines GRA and TOPSIS in view of the lack of a single MCDM method, and a nonlinear programming model with constraints is proposed to obtain the integrated closeness index to avoid subjectivity and irrationality during the integration process. An empirical application of rubbish bins was used to illustrate the proposed method. A sensitivity analysis and a comparison with existing methods were employed to validate the stability of the final results. The results of the research in this paper show the following:

  1. the proposed approach combining DANP and G-TOPSIS is a reasonable and effective tool for green material selection based on the results of an empirical case, a comparison of methods, and a sensitivity analysis;
  2. a suitable hierarchical structure of each criterion considering the economic, environment and physical properties was built for material selection, and
  3. the weights of each criterion are obtained via DANP and a causal influence diagram for dimensions and criteria is built.

As future work, our studies will focus on three direction: 1) on the basis of this study, we will integrate other significant impact criteria, e.g., social, technical and interior environment characteristics factors in the hierarchical structure, and formulate a more complete index system; 2) this hybrid method could be applied to other fields. For example, green performance assessment and design alternative selection, and a computer-assisted design support system will be designed and applied in the assessment process; 3) by noting that the raw data from the experts have uncertain and imprecise features, uncertainty theory must be integrated in MCDM methods for further development [8990].

Appendix A

  1. Step 1: Calculate the direct-relation matrix. The degree of direct impact that criterion i exerts on criterion j, which is denoted by dij, can be formulated by several experts/engineers in this field based on assumed scales, i.e., "no influence (0)", "very low influence (1)", "low influence (2)", "high influence (3)" and "very high influence (4)". Subsequently, A direct-relation matrix A = [aij]n×n is produced through the mean of each same criterion in the various matrices of the experts/engineers.
  2. Step 2: Establish the initial direct-relation matrix. The initial direct-relation matrix D = [dij]n×n can be derived through normalizing the matrix A as shown in Eqs (18) and (19). (18) (19)
  3. Step 3: Derive the total direct-relation matrix. Along the powers of D, e.g., D2, D3, …, Dα, the indirect impact of each criterion is decreasing continuously. As α approaches infinity, then Dα = [0]n×n, where 0 ≤ dij <1, 0 < Σidij ≤ 1 and 0 < Σjdij ≤ 1; at least one column sum Σidij or one row sum Σjdij is equal to 1. Therefore, the total direct-relation matrix T = [tij] n×n can be obtained through Eq (20). (20) where limα→Dα = [0]n×n.
  4. Step 4: Analyze the results. Each row sum vector r and column sum vector s of total direct-relation matrix T are separately produced, as shown in Eqs (21) and (22), where ri denotes the sum of total influences of criterion i on the other criteria. Similarly, cj denotes the sum of total influences that criterion j has received from the other criteria. Additionally, (ri + ci) and (rici) should be calculated to analyze the results. (ri + ci), as an index, can indicate the degree of the central role that criterion i plays in this problem when i = j. Regarding (rici), if it's it is positive, criterion i affects other criteria; in contrast, criterion i is impacted by other criteria [32, 36]. (21) (22)
  5. Step 5: Establish a causal-relation diagram. By mapping the data set of (ri + ci, ri—ci), a causal-relation diagram can be structured to provide an effective method to determine how the preferred values in each dimension/cluster and criterion can be improved.
  6. Step 6: Calculate the unweighted supermatrix. Two different total direct-relation matrices are then obtained from DEMATEL, i.e., which pertains to n criteria and which is devoted to m dimensions/clusters from TC as shown in Eq (23). (23)
    In addition, a new matrix will be established by normalizing the total direct-relation matrix TC, as shown in Eqs (24) and (25). (24)
    An explanation for the normalization is explained in detail which is shown as Eqs (25) and (26). Similarly, other values can be obtained in the same manner. (25) (26)
    Let the total direct-relation matrix match and fill into the interdependence clusters. An unweighted supermatrix W can be obtained based on transposing the normalized total direct-relation matrix , as shown in Eq (27). (27)
    An explanation for the W11 is explained in detail which is shown as Eq (28). Similarly, other Wij values can be obtained in the same manner. (28)
  7. Step 7: Calculate the weighted supermatrix. Each column will be summed for normalization as Eq (29). (29)
    A new matrix can be established by normalizing the total direct-relation matrix TD, as shown in Eq (30). (30)
    To obtain the weighted supermatrix, the normalized total direct-relation matrix must be multiplied as shown in Eq (31). (31)
  8. Step 8: Limit the weighted supermatrix. Limit the weighted supermatrix by raising it to a sufficiently large power k until the supermatrix converges and becomes a long-term stable supermatrix to obtain the global priority vector ω.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (No. 51405517, U1334208 and No. 51405075) and the Natural Science Foundation of Hunan (2015JJ3155).

Author Contributions

  1. Conceptualization: HZ.
  2. Data curation: PX.
  3. Formal analysis: YP.
  4. Funding acquisition: YP.
  5. Investigation: DW PX.
  6. Methodology: HZ.
  7. Project administration: YP GT.
  8. Resources: DW.
  9. Software: GT.
  10. Supervision: YP.
  11. Validation: GT.
  12. Visualization: YP DW.
  13. Writing – original draft: HZ.

References

  1. 1. Lang DJ, Wiek A, Bergmann M, Stauffacher M, Martens P, Moll P, et al. Transdisciplinary research in sustainability science: practice, principles, and challenges. Sustainability Science. 2012; 7: 25–43.
  2. 2. Blackstock KL, Kelly GJ, Horsey BL. Developing and applying a framework to evaluate participatory research for sustainability. Ecological Economics. 2007; 60: 726–742.
  3. 3. Brundiers K, Wiek A. Educating students in real-world sustainability research: vision and implementation. Innovative Higher Education. 2011; 36: 107–124.
  4. 4. Turkay M, Saracoglu O, Arslan MC. Sustainability in supply chain management aggregate planning from sustainability perspective. Plos One. 2016; 11(1).
  5. 5. Viegas CV, Bond AJ, Vaz CR, Borchardt M, Pereira GM, Selig PM, et al. Critical attributes of sustainability in higher education: a categorisation from literature review. Journal of Cleaner Production. 2016; 126: 260–276.
  6. 6. Govindan K, Shankar KM, Kannan D. Sustainable material selection for construction industry—A hybrid multi criteria decision making approach. Renewable & Sustainable Energy Reviews. 2015; 55: 1274–1288.
  7. 7. Singh S, Olugu EU, Musa SN, Mahat AB, Wong KY. Strategy selection for sustainable manufacturing with integrated AHP-VIKOR method under interval-valued fuzzy environment. International Journal of Advanced Manufacturing Technology. 2016; 84(1–4): 547–563.
  8. 8. Kou G, Lu Y, Peng Y, Shi Y. Evaluation of classification algorithms using MCDM and rank correlation. International Journal of Information Technology & Decision Making, 2012; 11(01): 197–225.
  9. 9. Prasenjit C, Vijay MA, Shankar C. Selection of materials using compromise ranking and outranking methods. Materials & Design. 2009; 30(10): 4043–4053.
  10. 10. Shanian A, Savadogo O. A material selection model based on the concept of multiple attribute decision making. Materials & Design. 2006; 27(4): 329–337.
  11. 11. Akadiri PO, Olomolaiye PO, Chinyio EA. Multi-criteria evaluation model for the selection of sustainable materials for building projects. Automation in Construction. 2013; 30: 113–125.
  12. 12. Maniya K, Bhatt MG. A selection of material using a novel type decision-making method: Preference selection index method. Materials & Design. 2010; 31(4): 1785–1789.
  13. 13. Chatterjee P, Athawale VM, Chakraborty S. Materials selection using complex proportional assessment and evaluation of mixed data methods. Materials & Design. 2011; 32(2): 851–860.
  14. 14. Roth R, Field F, Clark J. Materials selection and multi-attribute utility analysis. Journal of Computer-Aided Materials Design. 1993; 1(3): 325–342.
  15. 15. Wang Y, Xi CY, Zhang S, Zhang WY, Yu DJ. Combined approach for government E-tendering using GA and TOPSIS with intuitionistic fuzzy information, Plos One. 2015; 10(7).
  16. 16. Rao RV, Davim JP. A decision-making framework model for material selection using a combined multiple attribute decision-making method. International Journal of Advanced Manufacturing Technology. 2008; 35(7–8): 751–760.
  17. 17. Nguyen HT, Dawal SZM, Nukman Y, Aoyama H. An integrated approach of fuzzy linguistic preference based AHP and fuzzy COPRAS for machine tool evaluation, Plos One. 2015; 10(9).
  18. 18. Chatterjee P, Athawale VM, Chakraborty S. Selection of materials using compromise ranking and outranking methods. Materials & Design. 2009; 30: 4043–4053.
  19. 19. Rao RV. A decision making methodology for material selection using an improved compromise ranking method. Materials & Design. 2008; 29: 1949–1954.
  20. 20. Jahan A, Mustapha F, Ismail MY, Sapuan SM, Bahraminasab M. A comprehensive VIKOR method for material selection. Materials & Design. 2011; 32: 1215–1221.
  21. 21. Altuntas S, Selim H, Dereli T. A fuzzy DEMATEL-based solution approach for facility layout problem: a case study. International Journal of Advanced Manufacturing Technology. 2014; 73(5–8): 749–771.
  22. 22. Chan JWK. Application of grey relational analysis for ranking material options. International Journal of Computer Applications in Technology. 2006; 26(4): 210–217.
  23. 23. Chan JWK, Tong TKL. Multi-criteria material selections and end-of-life product strategy: grey relational analysis approach. Materials & Design. 2007; 28: 1539–1546.
  24. 24. Rezaei J. Best-worst multi-criteria decision-making method: some properities and a linear model. Omega-International Journal of Management Science. 2015; 53: 49–57.
  25. 25. Coelho CRV, Pernollet F, van der Werf HMG. Environmental life cycle assessment of diets with improved omega-3 fatty acid profiles, Plos One. 2016; 11(8).
  26. 26. Kou G, Lin C. A cosine maximization method for the priority vector derivation in AHP. European Journal of Operational Research, 2014; 235(1): 225–232.
  27. 27. Tavana M, Zareinejad M, Di Caprio D, Kaviani MA. An integrated intuitionistic fuzzy AHP and SWOT method for outsourcing reverse logistics. Applied Soft Computing. 2016; 40: 544–557.
  28. 28. Ng CY, Chuah KB. Evaluation of design alternatives’ environmental performance using AHP and ER approaches. IEEE Systems Journal. 2014; 8(4): 1182–1189.
  29. 29. Yang YPO, Shieh HM, Tzeng GH. A VIKOR technique based on DEMATEL and ANP for information security risk control assessment. Information Sciences. 2013; 232: 482–500.
  30. 30. Liu HC, You JX, Lu C, Chen YZ. Evaluating health-care waste treatment technologies using a hybrid multi-criteria decision making model. Renewable and Sustainable Energy Reviews, 2015, 41: 932–942.
  31. 31. Liu HC, Liu L, Wu J. Material selection using an interval 2-tuple linguistic VIKOR method considering subjective and objective weights. Materials & Design, 2013; 52: 158–167.
  32. 32. Çalışkan H, Kurşuncu B, Kurbanoğlu C, Güven ŞY. Material selection for the tool holder working under hard milling conditions using different multi criteria decision making methods. Materials & Design, 2013; 45: 473–479.
  33. 33. Hosseinijou SA, Mansour S, Shirazi MA. Social life cycle assessment for material selection: a case study of building materials. The International Journal of Life Cycle Assessment, 2014; 19(3): 620–645.
  34. 34. Kumar R, Singal SK. Penstock material selection in small hydropower plants using MADM methods. Renewable and Sustainable Energy Reviews, 2015; 52: 240–255.
  35. 35. Prendeville S, O'Connor F, Palmer L. Material selection for eco-innovation: SPICE model. Journal of Cleaner Production, 2014; 85: 31–40.
  36. 36. Castro-Lacouture D, Sefair JA, Flórez L, Medaglia AL. Optimization model for the selection of materials using a LEED-based green building rating system in Colombia. Building and Environment, 2009; 44(6): 1162–1170.
  37. 37. Kuo TC, Hsu CW, Li JY. Developing a green supplier selection model by using the DANP with VIKOR. Sustainability, 2015; 7(2): 1661–1689.
  38. 38. Bissoli-Dalvi M, Nico-Rodrigues EA, de Alvarez CE, Fuica GES, Montarroyos DCG. The sustainability of the materials under the approach of ISMAS. Construction and Building Materials, 2016; 106: 357–363.
  39. 39. Mayyas A, Qattawi A, Omar M, Shan D. Design for sustainability in automotive industry: A comprehensive review. Renewable and Sustainable Energy Reviews, 2012; 16(4): 1845–1862.
  40. 40. Florez L, Castro-Lacouture D. Optimization model for sustainable materials selection using objective and subjective factors. Materials & Design, 2013; 46: 310–321.
  41. 41. Zhao R, Su H, Chen X, Yu Y. Commercially available materials selection in sustainable design: An integrated multi-attribute decision making approach. Sustainability, 2016; 8(1): 79.
  42. 42. Anojkumar L, Ilangkumaran M, Sasirekha V. Comparative analysis of MCDM methods for pipe material selection in sugar industry. Expert Systems with Applications, 2014; 41(6): 2964–2980.
  43. 43. Huang H, Zhang L, Liu Z, Sutherland JW. Multi-criteria decision making and uncertainty analysis for materials selection in environmentally conscious design. The international journal of advanced manufacturing technology, 2011; 52(5–8): 421–432.
  44. 44. Liu HC, Mao LX, Zhang ZY, Li P. Induced aggregation operators in the VIKOR method and its application in material selection. Applied Mathematical Modelling, 2013; 37(9): 6325–6338.
  45. 45. Desai S, Bidanda B, Lovell MR. Material and process selection in product design using decision-making technique (AHP). European Journal of Industrial Engineering, 2012; 6(3): 322–346.
  46. 46. Rahman S, Odeyinka H, Perera S, Bi Y. Product-cost modelling approach for the development of a decision support system for optimal roofing material selection. Expert Systems with Applications, 2012; 39(8): 6857–6871.
  47. 47. Anojkumar L, Ilangkumaran M, Vignesh M. A decision making methodology for material selection in sugar industry using hybrid MCDM techniques. International Journal of Materials and Product Technology, 2015; 51(2): 102–126.
  48. 48. Onut S, Kara SS, Mert S. Selecting the suitable material handling equipment in the presence of vagueness. The International Journal of Advanced Manufacturing Technology, 2009; 44(7–8): 818–828.
  49. 49. İç YT. An experimental design approach using TOPSIS method for the selection of computer-integrated manufacturing technologies. Robotics and Computer-Integrated Manufacturing, 2012; 28(2): 245–256.
  50. 50. Huang HH, Liu ZF, Zhang L, Sutherland JW. Materials selection for environmentally conscious design via a proposed life cycle environmental performance index. The International Journal of Advanced Manufacturing Technology, 2009; 44(11–12): 1073–1082.
  51. 51. Hsu CH, Wang FK, Tzeng GH. The best vendor selection for conducting the recycled material based on a hybrid MCDM model combining DANP with VIKOR. Resources, Conservation and Recycling, 2012; 66: 95–111.
  52. 52. Liu HC, You JX, Zhen L, Fan XJ. A novel hybrid multiple criteria decision making model for material selection with target-based criteria. Materials & Design. 2014; 60: 380–390.
  53. 53. Shanian A, Milani AS, Vermaak N, Bertoldi K, Scarinci T, Gerendas M. A combined finite element-multiple criteria optimization approach for materials selection of gas turbine components. Journal of Applied Mechanics, 2012; 79(6): 061019.
  54. 54. Maity SR, Chakraborty S. Grinding wheel abrasive material selection using fuzzy TOPSIS method. Materials and Manufacturing Processes, 2013; 28(4): 408–417.
  55. 55. Mayyas A, Omar MA, Hayajneh MT. Eco-material selection using fuzzy TOPSIS method. International Journal of Sustainable Engineering, 2016; 9(5): 292–304.
  56. 56. Tuzkaya G, Gülsün B, Kahraman C, Ozgen D. An integrated fuzzy multi-criteria decision making methodology for material handling equipment selection problem and an application. Expert systems with applications, 2010; 37(4): 2853–2863.
  57. 57. Girubha RJ, Vinodh S. Application of fuzzy VIKOR and environmental impact analysis for material selection of an automotive component. Materials & Design, 2012; 37: 478–486.
  58. 58. Aly MF, Attia HA, Mohammed AM. Integrated fuzzy (GMM)-TOPSIS model for best design concept and material selection process. International Journal of Innovative Research in Science, Engineering and Technology, 2013; 2(11): 6464–6486.
  59. 59. Rathod MK, Kanzaria HV. A methodological concept for phase change material selection based on multiple criteria decision analysis with and without fuzzy environment. Materials & Design, 2011; 32(6): 3578–3585.
  60. 60. Anojkumar L, Ilangkumaran M, Vignesh M. A decision making methodology for material selection in sugar industry using hybrid MCDM techniques. International Journal of Materials and Product Technology, 2015; 51(2): 102–126.
  61. 61. Saaty TL. Decision making with dependence and feedback: Analytic network process, RWS Publ Pittsburgh, 1996.
  62. 62. Kou G, Ergu D, Lin CS, Chen Y. Pairwise comparison matrix in multiple criteria decision making. Technological and Economic Development of Economy, 2016; 22(5): 738–765.
  63. 63. Ou Yang YP, Shieh HM, Leu JD, Tzeng GH. A novel hybrid MCDM model combined with DEMATEL and ANP with applications, International Journal of Operational Research. 2008; 5(3): 160–168.
  64. 64. Chiu WY, Tzeng GH, Li HL. A new hybrid MCDM model combining DANP with VIKOR to improve e-store business. Knowledge-Based Systems. 2013; 37: 48–61.
  65. 65. Tzeng GH, Chiang CH, Li CW. Evaluating intertwined effects in e-learning programs: a novel hybrid MCDM model based on factor analysis and DEMATEL. Expert Systems with Applications. 2007; 32(4): 1028–1044.
  66. 66. Hwang CL, Yoon K. Multiple attributes decision making methods and applications. Berlin: Springer, 1981.
  67. 67. Oztaysi B. A decision model for information technology selection using AHP integrated TOPSIS-Grey: The case of content management systems. Knowledge-Based Systems. 2014; 70: 44–54.
  68. 68. Patil SK, Kant R. A fuzzy AHP-TOPSIS framework for ranking the solutions of knowledge management adoption in supply chain to overcome its barriers. Expert Systems with Applications. 2014; 41: 679–693.
  69. 69. Deviren D, Yavuz S, Kilınc N. Weapon selection using the AHP and TOPSIS methods under fuzzy environment. Expert Systems with Applications. 2009; 36(4): 8143–8151.
  70. 70. Ahmadi MH, Ahmadi MA. Multi objective optimization of performance of three-heat-source irreversible refrigerators based algorithm NSGAII. Renewable & Sustainable Energy Reviews. 2016; 60: 784–794.
  71. 71. Tavana M, Li ZJ, Mobin M, Komaki M, Teymourian E. Multi-objective control chart design optimization using NSGA-III and MOPSO enhanced with DEA and TOPSIS. Expert Systems with Applications. 2016; 50: 17–39.
  72. 72. Behzadian M, Otaghsara SK, Yazdani M, Ignatius J. A state-of the-art survey of TOPSIS applications. Expert Systems with Applications. 2012; 39(17): 13051–13069.
  73. 73. Sun Y, Huang GH, Li YP, Xu Y, Cao MF. An interval fuzzy robust nonlinear program for the planning of municipal solid waste management systems under uncertainty. Engineering Optimization, 2009; 41(11): 989–1016.
  74. 74. Corazza M, Fasano G, Gusso R. Particle Swarm Optimization with non-smooth penalty reformulation, for a complex portfolio selection problem. Applied Mathematics and Computation, 2013; 224: 611–624.
  75. 75. Wang YL, Tzeng GH. Brand marketing for creating brand value based on a MCDM model combining DEMATEL with ANP and VIKOR methods, Expert Systems with Applications. 2012; 39(5): 5600–5615.
  76. 76. Govindan K, Shankar KM, Kannan D. Sustainable material selection for construction industry—A hybrid multi criteria decision making approach. Renewable and Sustainable Energy Reviews, 2016; 55: 1274–1288.
  77. 77. Kou G, Peng Y, Wang G. Evaluation of clustering algorithms for financial risk analysis using MCDM methods. Information Sciences, 2014; 275: 1–12.
  78. 78. Kou G, Ergu D, Shang J. Enhancing data consistency in decision matrix: Adapting Hadamard model to mitigate judgment contradiction. European Journal of Operational Research, 2014; 236(1): 261–271.
  79. 79. Athawale VM, Kumar R, Chakraborty S. Decision making for material selection using the UTA method. The International Journal of Advanced Manufacturing Technology, 2011; 57(1): 11–22.
  80. 80. Do JY, Kim DK. AHP-based evaluation model for optimal selection process of patching materials for concrete repair: Focused on quantitative requirements. International Journal of Concrete Structures and Materials, 2012; 6(2): 87–100.
  81. 81. Häkkinen T. Assessment of indicators for sustainable urban construction. Civil Engineering and Environmental Systems. 2007; 24(4): 247–259.
  82. 82. Nguyen BK, Altan H. Tpsi-tall-building projects sustainability indicator. Procedia Engineering. 2011; 21: 387–394.
  83. 83. Florez L, Castro D, Irizarry J. Measuring sustainability perceptions of construction materials. Construction Innovation Information Process Management. 2013; 13(2): 217–234.
  84. 84. Ortiz O, Castells F, Sonnemann G. Sustainability in the construction industry: a review of recent developments based on LCA. Construction and Building Materials. 2009; 23(1): 28–39.
  85. 85. Tsai CY, Chang AS. Framework for developing construction sustainability items: The example of highway design. Journal of Cleaner Production. 2012; 20(1): 127–136.
  86. 86. Castellano J, Castellano D, Ribera A, Ciurana J. Development of a scale of building construction systems according to CO2 emissions in the use stage of their life cycle. Building and Environment. 2014; 82: 618–627.
  87. 87. Li GX, Kou G, Lin CS, Xu L, Liao Y. Multi-attribute decision making with generalized fuzzy numbers. Journal of the Operational Research Society, 2015; 66(11): 1793–1803.
  88. 88. Tian GD, Zhou MC, Zhang HH, Jia HF. An integrated AHP and VIKOR approach to evaluating green design alternatives[C]// Networking, Sensing, and Control (ICNSC), 2016 IEEE 13th International Conference on. IEEE, 2016: 1–6.
  89. 89. Liu HC, You JX, You XY, Shan MM. A novel approach for failure mode and effects analysis using combination weighting and fuzzy VIKOR method. Applied Soft Computing, 2015; 28: 579–588.
  90. 90. Liu HC, You JX, Li ZW, Tian GD. Fuzzy Petri nets for knowledge representation and reasoning: A literature review. Engineering Applications of Artificial Intelligence, 2017; 60: 45–56.