Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Vector similarity measures of hesitant fuzzy linguistic term sets and their applications

  • Yongming Song ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Visualization, Writing – original draft

    xinshiji7819@163.com

    Affiliation School of Management and Economics, University of Electronic Science and Technology of China, Chengdu, P. R. China

  • Jun Hu

    Roles Data curation, Supervision, Validation, Writing – review & editing

    Affiliation State-owned Assets Supervision and Administration Commission in Yunnan Province of China, Kunming, P. R. China

Abstract

In decision making, similarity measure and distance between two objects are crucial to be able to determine the relationship between those objects. Many researchers have received much attention for their research on this subject. In this study, we propose two novel similarity measures between hesitant fuzzy linguistic term sets (HFLTSs). In addition, two extensions of Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) are proposed in the hesitant fuzzy linguistic environments. Furthermore, an example of an application concerning traditional Chinese medical diagnosis and an MCDM problem have been given to illustrate the applicability and validation of these similarity measures of HFLTSs. Furthermore, the results of examples demonstrate that the Dice and Jaccard similarity measures are more reasonable than the cosine similarity measure with respect to HFLTSs.

Introduction

Similarity measures and distances are widely used to determine the relationship between two individuals in many domains [18], including medical engineering, decision making, pattern recognition, and network comparison. The “classical” similarity measures comprise Dice’s measure, Jaccard’s measure, the cosine formula, the overlap measures, and the correlation coefficient of Pearson [9]. The Dice, Jaccard, and cosine measures are types of vector similarity measures. With the development of fuzzy sets, “classical” similarity measures have been extended to various fuzzy environments [1024]. Xu et al. [19] introduced the cosine similarity measures for the hesitant fuzzy environment. Zhang et al. [24] defined an integrated similarity measure based on the Dice and cosine measures for intuitionistic fuzzy sets. Ye [22] defined the Dice similarity measure for intuitionistic fuzzy sets. Ye [23] extended the Dice, Jaccard and cosine similarity measures to hesitant fuzzy sets. Through an example, Ye [23] pointed out that the Dice and Jaccard measures are more reasonable than the cosine measure when applied to a hesitant fuzzy set. Chiclana et al. [1] put forward a statistical comparative study of the manner in which five distance functions (Manhattan, Euclidean, cosine, Dice, and Jaccard) affect the consensus process for group decision-making problems.

In some practical problems, because decision makers may exist in a state of hesitation for several linguistic terms with comparison of two methods, such a linguistic term is often insufficient. To deal with this situation, Rodríguez et al. [25] introduced the hesitant fuzzy linguistic term set (HFLTS), which is a strong structure that reflects decision makers’ hesitant attitude [26]. Moreover, different similarity measures for HFLTS have been put forth [1517], e.g., Liao et al. [16] introduced the cosine similarity measures for HFLTS. In this paper, based on vector similarity measures, we extend Dice and Jaccard measures to HFLTSs and denote them as and , respectively. Moreover, the - and -distance-based technique for order of preference by similarity to an ideal solution (HFL-TOPSIS) methods are further established. Through examples, it shows that the extended Dice and Jaccard measures with HFLTSs are more reasonable than the cosine measure.

Similarity measures with hesitant fuzzy linguistic term set

Vector similarity functions

In the following, we introduce two classical vector similarity measures: Dice similarity [27] and Jaccard similarity [28]. Assuming two vectors, X = (x1,x2,⋯,xn) and Y = (y1,y2,⋯,yn), we can obtain (1) (2)

Hesitant fuzzy linguistic term set

Definition 1. [16] Let xiX, i = 1,2,…,N, and S = {st|t = −τ,…,−1,0,1,…,τ} be a linguistic term set. Then, a hesitant fuzzy linguistic term set (HFLTS), Hs in X, is denoted as follows: (3) where hs(xi) can be indicated as where φl ∈ {−τ,…,−1,0,1,…,τ} is the subscript of a linguistic term and L(xi) is the total number of linguistic terms in hs(xi).

The linguistic terms of an HFLTS, , might be unordered. For simplicity, we arrange the linguistic terms, , in ascending or descending order. The ascending order rule is to arrange the linguistic term set from small to large subscripts, whereas the descending order is just the opposite.

Different HFLTSs always possess different numbers of linguistic terms. Zhu and Xu [29] recommend a method for increasing the shorter HFLTs until it has the same length as the longer one. The adding regulation mainly relies upon the risk preferences of decision makers by adding the maximum value, minimum value, and mean value, which correspond to optimism, pessimism, and neutral rules, respectively. Without loss of generality, we add the shorter terms according to neutral rules in this paper.

Similarity measures for HFLTSs

Let S = {st|t = −τ,…,−1,0,1,…,τ} be a linguistic term set. For two HFLTSs, and , Liao et al. [16] defined the information energy of and the correlation between two and as (4) (5) , respectively. Here, Li is the maximum number of linguistic terms in or (with the shorter of the two needing to be extended to same length), . The N is the cardinality of X. Based on the definitions of the information energy and correlation of the HFLTSs, two vector similarity measures for HFLTSs are proposed.

Definition 2. The similarity measure between and is defined as (6)

Some theorems of similarity measure are proposed as follows:

Theorem 1. The similarity measure, , between the HFLTSs, and , possesses the following properties:

  1. (1). ;
  2. (2). , if and only if ;
  3. (3). .

Proof:

(1) and (2) are obvious.

(3) It is obvious for . According to the inequality a2 + b2 ≥ 2ab, we have . Thus, we obtain , and the property (3) holds. □

Definition 3. Similarity measure between and is defined as (7)

Theorem 2. The similarity measure, , between the HFLTSs and possesses the following properties:

  1. (1). ;
  2. (2). , if and only if ;
  3. (3). .

Proof:

(1) and (2) are obvious.

(3) This is obvious for . According to the inequality a2 + b2 ≥ 2ab, we have . Thus, we obtain , and the property (3) holds. □

Example 1. Let S = {sα|α = −3,…,−1,0,1,…,3} be a linguistic term set and and be two HFLTSs on S. We can extend to by adding the linguistic term, s1.5. Thus, the similarity measure, , between and is obtained as follows:

Weighted similarity measures for HFLTSs

Let wi be the weights of elements xi(i = 1,2,…,N) and . Then, the similarity measure formulas given in Eqs (6) and (7) can be extended as follows: (8) (9)

It is obvious that, if , then Eqs (8) and (9) are simplified to Eqs (6) and (7), respectively. Likewise, the two weighted similarity measures also possess the following properties:

  1. (1). ;
  2. (2). ;
  3. (3). , if and only if .

Ordered weighted similarity measure for HFLTSs

Inspired by the OWA operators proposed by Yager [30], Liao et al. [17] defined the ordered weighted correlation of any two HFLTSs, and , by (10)

Where ζ(1),ζ(2),…,ζ(N) satisfy (11)

Here, wi are the weights of ordered positions for elements xi(i = 1,2,…,N) with .

Similarly, the ordered weighed information energy of the set, Hs, is defined as (12)

Afterwards, we extend Eqs (8) and (9) to Eqs (13) and (14), respectively: (13) (14)

The two ordered, weighted similarity measures also have the following properties:

  1. (1). , ;
  2. (2). ;
  3. (3). , if and only if .

The -distance-based HFL-TOPSIS method

In recent years, multi-criteria decision making (MCDM) methods [3136] have been developed and widely applied to diverse scientific fields, such as water resource utilization, energy management, machine tool evaluation, and supplier selection. TOPSIS is a simple and widely used MCDM method [3739] for order preference using a close-to-ideal solution [4042]. With the development of fuzzy sets, TOPSIS has been extended to fuzzy environments [4348]. Furthermore, distance and similarity measures have a mutual transformation relationship with each other. Liao et al. [15] defined this relationship for HFLTSs as follows: (15)

Then, the corresponding distance measures can be easily obtained using Eq (15). Inspired by the cosine-distance-based HFL-TOPSIS method [16], the -distance-based HFL-TOPSIS method can be defined as follows:

  1. Step 1. Let A = {A1,A2,⋯,An} and C = {C1,C2,⋯,Cm} be a set of alternatives and a set of criteria, respectively. Let wj be the weights of criteria Cj, where . The characteristics of Ai in relation to criteria cj are represented by an HFLE, , where S = {st|t = −τ,…,−1,0,1,…,τ} is a linguistic term set.
  2. Step 2. The positive ideal solution, , and negative ideal solution, , are developed as follows:
  3. Step 3. According to Eq (16), the construction of the positive ideal distance matrix, D+, and the negative ideal distance matrix, D, are given as where the distance between the two HFLEs, and , can be given as follows: (16)
  4. Step 4. Calculate the closeness coefficient (17) Where and .
  5. Step 5. Rank the alternatives by decreasing order of Ri.

In the same way, the distance with the -distance-based HFL-TOPSIS method can be denoted as follows: (18)

Application of the similarity measures of HFLTS

Example 2 [17]. In traditional Chinese medical diagnosis, a doctor always gets some imprecise information about a patient’s symptoms, such as temperature, headache, cough, and stomach pain, through seeing, smelling, asking, and touching. Assuming that a doctor wants to make a proper diagnosis for a patient with four symptoms, V = {temperature, headache, cough, stomach pain} with four possible diseases, D = {Viral infection, Typhoid, Pneumonia, Stomach problem}. Each symptom can be seen as a linguistic variable, whose corresponding linguistic term set is shown as follows:

We can generate the following knowledge-based data set in terms of HFLTSs (see Table 1) according to existing experience. Assume there are four patients, P = {Richard, Catherine, Nicole, Kevin}, whose symptoms, as linguistic expressions, can be transformed into HFLTSs (Table 2).

thumbnail
Table 1. Symptoms characteristic for the considered diagnosis in terms of HFLTSs.

https://doi.org/10.1371/journal.pone.0189579.t001

thumbnail
Table 2. Symptoms characteristic for the considered patients in terms of HFLTSs.

https://doi.org/10.1371/journal.pone.0189579.t002

In order to diagnosis the diseases of these four patients, we can calculate the similarity measures between the data set of each patient’s symptoms and that of the diagnoses. We use two new similarity measures, and , to derive the relationship between each patient and disease, and the similarity values taken from the Dice and Jaccard measures are displayed in Tables 3 and 4, respectively.

thumbnail
Table 3. Similarity values of between each patient’s symptoms and possible diagnosis.

https://doi.org/10.1371/journal.pone.0189579.t003

thumbnail
Table 4. Similarity values of between each patient’s symptoms and possible diagnosis.

https://doi.org/10.1371/journal.pone.0189579.t004

The principle behind the diagnosis is the larger the value of the similarity measure, the higher possibility of the diagnosis for the patient. From Table 3 and Table 4, we can see that Richard, Catherine, Nicole, and Kevin are suffering from typhoid, stomach problem, viral fever, and pneumonia, respectively, which is in concordance with the correlation coefficient values of ρ1 calculated in [17], but not with those of ρ2 calculated in [17]. This is because the and similarity measures are obtained according to the normalized inner product within a vector space, while ρ2 [17] was defined using the classical overlap measure. These two different measures come from different points of view.

Example 3. In the following, we discuss an MCDM problem [16] in terms of both the - and -distance-based HFL-TOPSIS methods, respectively.

Assume a company intends to select an ERP system from three candidates, A = {A1,A2,A3}, with three criteria: C1 (potential cost), C2 (function), and C3 (operational complexity) of weights 0.3, 0.5, and 0.2, respectively. As ERP systems are very complicated, it is not easy to use just one linguistic term to express an opinion for the decision maker. Thus, the decision maker may be hesitant when determining the values of each ERP system over the criteria. We transform the linguistic expressions of CIO (Chief Information Officer) into a HFLTS judgment matrix H, using the transformation function [25]:

Now, we try to use the - and -distance-based HFL-TOPSIS methods to solve this MCDM problem.

  1. (1). Using the -distance-based HFL-TOPSIS method
  1. Step 1. It is given above, so we go to Step 2 directly;
  2. Step 2. Since all criteria are benefit criteria according to the score function and the variance function [49], we obtain , , , , , and . Thus, the positive ideal solution and the negative ideal solution for this problem are A+ = ({s2,s3},{s2,s3},{s3})T and A = ({s1,s2,s3},{s1,s2,s3},{s−2,s−1,s0})T, respectively.
  3. Step 3. According to Eq (16), we can construct D+ and D as follows:
  4. Step 4. Using Eq (17), we can calculate the closeness coefficient. Since , , , , , , we obtain RC(A1) = 0.7904, RC(A2) = 0, RC(A3) = 0.8401.
  5. Step 5. By means of the closeness coefficient of each alternative, the ranking of these ERP systems is A3A1A2, which implies that the third ERP system, A3, is the best choice for the company.
  1. (2). Using the -distance-based HFL-TOPSIS method
  1. Steps 1 and 2 are the same as those in the -distance-based HFL-TOPSIS method;
  2. Step 3. According to Eq (18), we can construct D+ and D as follows:
  3. Step 4. Using Eq (17), calculate the closeness coefficient. Since , , , , , , we obtain RC(A1) = 0.73712, RC(A2) = 0, RC(A3) = 0.79832.
  4. Step 5. By means of the closeness coefficient of each alternative, the ranking of these ERP systems is A3A1A2, which implies that the third ERP system, A3, is the best choice for the company.

From the above results, it can be concluded that the ranking of our two TOPSIS methods is the same, while that [16] of the three ERP systems is inconsistent as a result of the application of different distance measures to TOPSIS methods. However, the closeness coefficients of the third and first ERP systems are very similar to that of the ideal solution. In fact, the third ERP system, A3 = ({s2,s3},{s1,s2,s3},{s3})T, is closer to the positive ideal solution, A+ = ({s2,s3},{s2,s3},{s3})T, than the first ERP system A1 = ({s1,s2,s3},{s2,s3},{s1,s2,s3})T. Therefore, the third ERP system is a better choice for the company than the first ERP system, which validates that our methods are effective. The ranking result should be regarded as a support to the decision-making process. Afterwards, decision makers can choose an ERP system according to their preferences based on the ranking results of the TOPSIS method.

Example 4. Suppose that assessed values of two alternatives are A1 = ({s2,s1,s−1},{s2,s1},{s2,s1,s−1}), A2 = ({s3,s2,s1},{s2,s1},{s−1,s−2}) based on three criteria weight vector ω = (0.35,0.25,0.4), and ideal alternative is A* = ({s4,s4,s4},{s4,s4},{s4,s4}).

In the following, we calculate the Dice, Jaccard, and cosine [16] similarity measures between A1 and A*, and Dice, Jaccard, and cosine similarity measures between A2 and A*, respectively.

Although above three similarities obtain same conclusion that A2 is better than A1, CHFLTSs(A1,A*) is approximately equal CHFLTSs(A2,A*). Therefore, it means that Dice and Jaccard similarities have a stronger ability to discriminate between HFLTSs than Cosine similarity, which could further verify our conclusions, namely, the Dice and Jaccard similarity measures are more reasonable than the cosine similarity measure with respect to HFLTSs.

Conclusions

In this paper, we introduced two novel similarity measures for HFLTSs and enumerated some properties of these similarity measures. Furthermore, the two weighted similarity measures and the ordered weighted similarity measures for HFLTSs have been established and analyzed. Inspired by the cosine-distance-based HFL-TOPSIS method, the - and -distance-based HFL-TOPSIS methods can be introduced. An application example concerning the traditional Chinese medical diagnosis and a MCDM problem have been discussed to illustrate the applicability and validation of both our HFLTS similarity measures. Through examples, it has been shown that the Dice and Jaccard measures are more reasonable than the cosine measure for the HFLTS.

Acknowledgments

The authors also would like to express appreciation to the anonymous reviewers and Editors for their very helpful comments that improved the paper.

References

  1. 1. Chiclana F, Tapia García JM, del Moral MJ, Herrera-Viedma E. A statistical comparative study of different similarity measures of consensus in group decision making, Information Sciences. 2013; 221: 110–123.
  2. 2. Droogenbroeck BV, Breyne P, Goetghebeur P, Peeters ER, Kyndt T, Gheysen G. AFLP analysis of genetic relationships among papaya and its wild relatives (Caricaceae) from Ecuador, Theoretical and Applied Genetics. 2002;105(2): 289–297.
  3. 3. Janson S, Vegelius J. Measures of ecological association. Oecologia. 1981; 49(3): 371–376. pmid:28309999
  4. 4. Kou G, Lin CS. A cosine maximization method for the priority vector derivation in AHP. European Journal of Operational Research. 2014; 235(1): 225–232.
  5. 5. Park DG, Kwun YC, Park JH, Park IY. Correlation coefficient of interval-valued intuitionistic fuzzy sets and its application to multiple attribute group decision making problems. Mathematical and Computer Modelling. 2009; 50(9–10): 1279–1293.
  6. 6. Wei GW, Wang HJ, Lin R. Application of correlation coefficient to interval-valued intuitionistic fuzzy multiple attribute decision-making with incomplete weight information. Knowledge and Information Systems. 2011; 26(2): 337–349.
  7. 7. Ye J. Multicriteria fuzzy decision-making method using entropy weights-based correlation coefficients of interval-valued intuitionistic fuzzy sets. Applied Mathematical Modelling. 2010; 34(12): 3864–3870.
  8. 8. Emmert-Streib F, Dehmer M, Shi Y. Fifty years of graph matching, network alignment and comparison. Information Sciences. 2016; 346–347: 180–197.
  9. 9. Egghe L. Good properties of similarity measures and their complementarity. Journal of the American Society for Information Science and Technology. 2010; 61(10): 2151–2160.
  10. 10. Chiang DA, Lin NP. Correlation of fuzzy sets, Fuzzy Sets and Systems. 1999; 102(2): 221–226.
  11. 11. Chen N, Xu ZS, Xia MM. Correlation coefficients of hesitant fuzzy sets and their applications to clustering analysis, Applied Mathematical Modelling. 2013; 37(4): 2197–2211.
  12. 12. Hong DH, Hwang SY. A note on the correlation of fuzzy numbers. Fuzzy Sets and Systems. 1996; 79(3): 401–402.
  13. 13. Hong DH. Fuzzy measures for a correlation coefficient of fuzzy numbers undertow (the weakestt-norm)-based fuzzy arithmetic operations. Information Sciences. 2006; 176(2): 150–160.
  14. 14. Liu ST, Kao C. Fuzzy measures for correlation coefficient of fuzzy numbers. Fuzzy Sets and Systems. 2002; 128(2): 267–275.
  15. 15. Liao HC, Xu ZS, Zeng XJ. Distance and similarity measures for hesitant fuzzy linguistic term sets and their application in multi-criteria decision making. Information Sciences. 2014; 271: 125–142.
  16. 16. Liao HC, Xu ZS. Approaches to manage hesitant fuzzy linguistic information based on the cosine distance and similarity measures for HFLTSs and their application in qualitative decision making. Expert Systems with Applications. 2015; 42(12): 5328–5336.
  17. 17. Liao HC, Xu ZS, Zeng XJ, Merigó JM. Qualitative decision making with correlation coefficients of hesitant fuzzy linguistic term sets. Knowledge-Based Systems. 2015; 76: 127–138.
  18. 18. Wang WJ. New similarity measures on fuzzy sets and on elements. Fuzzy Sets and Systems. 1997; 85(3): 305–309.
  19. 19. Xu ZS, Xia MM. On distance and correlation measures of hesitant fuzzy information. International Journal of Intelligent Systems. 2011; 26(5): 410–425.
  20. 20. Ye J. Cosine similarity measures for intuitionistic fuzzy sets and their applications. Mathematical and Computer Modelling. 2011; 53(1–2): 91–97.
  21. 21. Ye J. Multicriteria Group Decision-Making Method Using Vector Similarity Measures For Trapezoidal Intuitionistic Fuzzy Numbers. Group Decision & Negotiation. 2012; 21(4): 519–530.
  22. 22. Ye J. Multicriteria decision-making method using the Dice similarity measure based on the reduct intuitionistic fuzzy sets of interval-valued intuitionistic fuzzy sets. Applied Mathematical Modelling. 2012; 36(9): 4466–4472.
  23. 23. Ye J. Vector similarity measures of hesitant fuzzy sets and their multiple attribute. Economic Computation & Economic Cybernetics Studies & Research. 2014; 48(4): 206–217.
  24. 24. Zhang LY, Li T, Xu XH. Consensus model for multiple criteria group decision making under intuitionistic fuzzy environment. Knowledge-Based Systems. 2014; 57:127–135.
  25. 25. Rodríguez RM, Martínez L, Herrera F. Hesitant fuzzy linguistic terms sets for decision making. IEEE Transactions on Fuzzy Systems. 2012; 20(1): 109–119.
  26. 26. Song YM, Hu J. A group decision-making model based on incomplete comparative expressions with hesitant linguistic terms. Applied Soft Computing. 2017; 59: 174–181.
  27. 27. Dice LR. Measures of the amount of Ecologic Association between Species, Ecology. 1945; 26: 297–302.
  28. 28. Jaccard P. Distribution de la flore alpine dans le Bassin des Drouces et dans quelques regions voisines. Bulletin de la Société Vaudoise des Sciences Naturelles. 1901; 37(140): 241–272.
  29. 29. Zhu B, Xu ZS. Consistency measures for hesitant fuzzy linguistic preference relations. IEEE Transactions on Fuzzy Systems. 2014; 22(1): 35–45.
  30. 30. Yager RR. On ordered weighted averaging aggregation operators in multi-criteria decision making. IEEE Transactions Systems, Man and Cybernetics. 1988; 18(1): 183–190.
  31. 31. Kaya T, Kahraman C. An integrated fuzzy AHP–ELECTRE methodology for environmental impact assessment. Expert Systems with Applications. 2011; 38(7): 8553–8562.
  32. 32. Kou G, Ergu DJ, Shang JF. Enhancing data consistency in decision matrix: Adapting Hadamard model to mitigate judgment contradiction. European Journal of Operational Research. 2014; 236(1): 261–271.
  33. 33. Lin CS, Kou G, Ergu DJ. A heuristic approach for deriving the priority vector in AHP. Applied Mathematical Modelling. 2013; 37(8): 5828–5836.
  34. 34. Lin CS, Kou G, Ergu DJ. A statistical approach to measure the consistency level of the pairwise comparison matrix. Journal of the Operational Research Society. 2014; 65: 1380–1386.
  35. 35. Li GX, Kou G, Lin CS, Xu L, Liao Y. Multi-attribute decision making with generalized fuzzy numbers. Journal of the Operational Research Society. 2015; 66: 1793–1803.
  36. 36. Nguyen HT, Dawal SZM, Nukman Y, Aoyama H, Case K. An Integrated Approach of Fuzzy Linguistic Preference Based AHP and Fuzzy COPRAS for Machine Tool Evaluation. PLOS ONE. 2015; 10(9): e0133599. pmid:26368541
  37. 37. Fei L, Hu Y, Xiao F, Chen L, Deng Y. A Modified TOPSIS Method Based on D Numbers and Its Applications in Human Resources Selection. Mathematical Problems in Engineering. 2016; Article ID 6145196, http://dx.doi.org/10.1155/2016/6145196.
  38. 38. Junior FRL, Osiro L, Carpinetti LCR. A comparison between Fuzzy AHP and Fuzzy TOPSIS methods to supplier selection. Applied Soft Computing. 2014; 21: 194–209.
  39. 39. Parameshwaran R, Kumar SP, Saravanakumar K. An integrated fuzzy MCDM based approach for robot selection considering objective and subjective criteria. Applied Soft Computing. 2015; 26: 31–41.
  40. 40. Hwang CL, Yoon K. Multiple attributes decision making methods and applications. Berlin, Heidelberg, Springer; 1981.
  41. 41. Opricovic S, Tzeng GH. Compromise solution by MCDM methods: a comparative analysis of VIKOR and TOPSIS. European Journal of Operational Research. 2004; 156(2): 445–455.
  42. 42. Olson DL. Comparison of weights in TOPSIS models. Mathematical and Computer Modelling. 2004; 40(7–8): 721–727.
  43. 43. Boran FE, Genç S, Kurt M, Akay D. A multi-criteria intuitionistic fuzzy group decision making for supplier selection with TOPSIS method. Expert Systems with Applications. 2009; 36(8): 11363–11368.
  44. 44. Beg I, Rashid T. TOPSIS for hesitant fuzzy linguistic term sets. International Journal of Intelligent Systems. 2013; 28(12): 1162–1171.
  45. 45. Chen CT. Extensions of the TOPSIS for group decision-making under fuzzy environment. Fuzzy Sets and Systems. 2000; 114(1): 1–9.
  46. 46. Chen TY, Tsao CY. The interval-valued fuzzy TOPSIS method and experimental analysis. Fuzzy Sets and Systems. 2008; 159(11): 1410–1428.
  47. 47. Li GX, Kou G, Peng Y. Dynamic fuzzy multiple criteria decision making for performance evaluation. Technological and Economic Development of Economy. 2015; 21(5): 705–719.
  48. 48. Xu ZS, Zhang XL. Hesitant fuzzy multi-attribute decision making based on TOPSIS with incomplete weight information. Knowledge-Based Systems. 2013; 52: 53–64.
  49. 49. Liao HC, Xu ZS, Zeng XJ. Hesitant fuzzy linguistic VIKOR method and its application in qualitative multiple criteria decision making. IEEE Transactions on Fuzzy Systems. 2015; 23(5): 1343–1355.