Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Deriving the priority weights from probabilistic linguistic preference relation with unknown probabilities

Abstract

Generally, the probabilistic linguistic term set (PLTS) provides more accurate descriptive properties than the hesitant fuzzy linguistic term set does. The probabilistic linguistic preference relation (PLPR), which is applied to deal with complex decision-making problems, can be constructed for PLTSs. However, it is difficult for decision makers to provide the probabilities of occurrence for PLPR. To deal with this problem, we propose a definition of expected consistency for PLPR and establish a probability computing model to derive probabilities of occurrence in PLPR with priority weights for alternatives. A consistency-improving iterative algorithm is presented to examine whether or not the PLPR is at an acceptable consistency. Moreover, the consistency-improving iterative algorithm should obtain the satisfaction consistency level for the unacceptable consistency PLPR. Finally, a real-world employment-city selection is used to demonstrate the effectiveness of the proposed method of deriving priority weights from PLPR.

Introduction

In recent years, societal and technological trends have made decision-making environments more uncertain and complex. It is difficult for decision makers (DMs) to accurately evaluate alternatives using precise metrics. Accordingly, DMs have adopted a linguistic variable [1] to express their assessment results more flexibly and appropriately. A variety of linguistic models, including the fuzzy number-based model, the 2-tuple linguistic, and the virtual linguistic, have been introduced to deal with practical problems [24]. In real situations characterized by complexity and uncertainty, it is difficult for DMs to use single terms to indicate preference values. To address the difficulties of representing complex and uncertain situations with a single-term preference value, Torra [5] proposed the hesitant fuzzy set, which allowed DMs to simultaneously consider several hesitant values to produce an overall assessment. Catering to the cognitive characteristics of DMs, the hesitant fuzzy set incorporated an increased amount of influential data to avoid the loss of information. Furthermore, Rodriguez et al. [6] presented the hesitant fuzzy linguistic term set (HFLTS) to improve the richness of linguistic representation. In recent years, HFLTSs have obtained widespread attention from scholars [713]. All HFLTS terms provided by the decision maker (DM) have equal probabilities of occurrence. However, the probabilities of possible linguistic terms in HFLTS are not equal in some actual situations. For example, if a DM employs an HFLTS, {little good, good, very good}, to represent the control of a car, the DM may consider that the control level “little good” is the most desirable, whereas the control level “good” is more desirable than the control level “very good.” However, the control level “very good” is also possible. Thus, the HFLTS {little good, good, very good} cannot be used to represent this precise situation. Pang et al. [14] extended the HFLTS to probabilistic linguistic term set (PLTS), which allowed the DMs to provide multiple possible linguistic terms, considering simultaneous probabilities of occurrence for all possible linguistic terms. The PLTS, which enriches the expressive methods of linguistic information, provides more accurate descriptive properties than HFLTS. Therefore, it is better for the DMs to represent their preference information via PLTS. For the above example, the PLTS {little good (0.6), good (0.3), very good (0.1)} can be applied to represent the control of a car, because it contains more information than the HFLTS {little good, good, very good}. Recently, the mechanism and application of PLTS has aroused wide concern and has been a hot area of research in the decision-making fields [1529].

Preference relations are pairwise comparisons of alternatives and are common representational tools for DMs. Based on PLTS, Zhang et al. [19] proposed the probabilistic linguistic preference relation (PLPR), which can be applied to solve multi-criteria decision-making problems. Generally, the PLPR decision matrix comprises the HFLTSs and their corresponding probabilities. The HFLTSs are easily given by DMs. However, it is difficult for DMs to provide probabilities for all linguistic terms in the HFLTSs. Intuitively, it is impossible or highly unlikely for DMs to provide exact probability values for all the linguistic terms. Therefore, establishing a probability computing model for the PLPR is a primary need. It is also the first objective of this paper: propose a probability computing model with unknown probabilities of PLPR.

It is well known that consistency is a significant issue widely considered in decision-making problems based on preference relations [3033]. Consistency ensures DMs are logical and non-voluntary, making the result of decision-making credible. Therefore, PLPR consistency improvement is a critical issue. However, the consistency-improving algorithm of PLPR proposed by Zhang et al. [19] must adjust all elements in each iteration. This biases the original information of DMs. Therefore, to retain DMs’ original information as far as possible, the second objective of this paper is to establish a new method to improve the consistency of PLPR.

To solve the above problems, first, we introduce the expected consistency definition of the PLPR and establish its probability computing model to get the missing occurrence probabilities and priority weights of alternatives. Then, to improve the consistency level of PLPR, the expected consistency index (ECI) of the PLPR is developed. Moreover, for a PLPR with an unsatisfactory consistent level, an improving algorithm is proposed to obtain a PLPR with an acceptable expected consistency level.

The rest of this paper is organized as follows. Section 2 reviews some basic knowledge of linguistic information, linguistic preference relation (LPR), and PLPR. Section 3 presents a probability computation model of the PLPR based on the expected consistency. In Section 4, a consistency-improving algorithm is proposed. In Section 5, an employment-city selection problem is solved and a comparison analysis with other research is also presented. Section 6 gives the concluding remarks.

Preliminaries

Linguistic information

To facilitate linguistic assessment by DMs, the linguistic term set should be determined in advance. Generally, a linguistic term set has the following characteristics: an odd value with granularity; its membership functions are symmetrical and uniformly distributed; and the linguistic set midterm represents “indifference,” with the remainder of the linguistic terms symmetrically and uniformly placed on either side of it. Let S = {s0,s1,⋯,s2τ} be a linguistic term set with odd granularity. si represents the ith linguistic term in S, and 2τ+1 is the granularity of the linguistic S. Moreover, the term set S should satisfy the following features [2]: a negation operator Neg(si) = sj, such that j = 2τ−1−i; 2); an order sisj, if ij.

To preserve all given information during the calculation process, a discrete linguistic term set S can be further expanded to the continuous form proposed by Xu [34], as follows: (1) where q>2τ is a large-enough positive integer. If sαS, the sα is called an original term; otherwise, the sα is a virtual term. Moreover, Xu [34] introduced operational laws for two linguistic terms, and λ,λ1,λ2∈[0,1], as follows:

Furthermore, the subscript function I(⋅) and its inverse function I−1(⋅) are defined as follows: (2)

Preference relations: LPR and PLPR

Definition 1 ([35]). The P = (pij)n×n is called an LPR if the following conditions hold: (3) where S = {s0,s1,⋯,s2τ} is the given linguistic scale set.

Based on HFLTS, Pang et al. [14] proposed the PLTS as follows:

Definition 2 ([14]). Let S = {s0,s1,⋯,s2τ} be a linguistic scale set. The definition of a PLTS is given as follows: (4) where L(k)(p(k)) denotes the linguistic term, L(k), associated with probability p(k), whereas #L(p) suggests the number of all different linguistic terms in L(p).

Based on the PLTS, Zhang et al. [19] defined PLPR as follows:

Definition 3. A PLPR on set X is represented by a matrix B = (Lij(p))n×nX×X, i,j = 1,2,⋯,n. Here Lij(p) = {Lij,k(pij,k)|k = 1,2,⋯,#Lij} are PLTSs based on the given linguistic scale set, S = {s0,s1,⋯,s2τ}, where , and #Lij(p) represents the number of linguistic terms in Lij(p). Lij(p) is expressed as the preference degrees of alternative xi over xj and satisfies the following conditions: (5) (6) where Lij,k and pij,k are the kth linguistic term and the occurrence probability of the kth linguistic term in Lij(p), respectively.

Probability computation model of the PLPR based on expected consistency

Zhang et al. [19] defined PLPR consistency using a normalization process. However, the normalization process-based method had two features. It extended all PLTSs to the length of the PLTS with the biggest number of elements, and it used the ordered PLTSs to judge the consistency of associated PLPR. The normalization process-based method restricted the consistency of ordered PLTSs. To address these limitations, this paper defines a new expected consistency for PLPR. In contrast to the previous consistency concepts, this new concept does not add values to be provided by the DMs.

To calculate the probability of a PLPR, we present a probability computation model in which the definition of the expected consistency of a PLPR is based on the additive consistency of LPR [36]. We give preliminary knowledge as follows:

Definition 4. Given a PLTS L(p) = {Lk(pk)|k = 1,2,⋯,#L(p)}, then its expected value can be defined as (7) where #L(p) is the number of possible elements in L(p).

Definition 5 ([36]). An LPR, A = (aij)n×n, is an additive consistent LPR if it satisfies the following conditions: (8) where S = {s0,s1,⋯,s2τ} is given a linguistic scale set and ω = {ω1,ω2,⋯,ωn}T is the priority weights of A, meeting and ωi≥0,i = 1,2,⋯,n.

Based on the additive consistency of LPR, the expected consistency of PLPR is presented as follows:

Definition 6. Given a set of alternatives, X = {x1,x2,⋯,xn}, H = (Lij(p))n×nX×X, i,j = 1,2,⋯,n is a PLPR for X, where Lij(p) = {Lij,k(pij,k)|k = 1,2,⋯,#Lij} is a PLTS expressed as the preference degrees of the alternative xi over xj. Then, H is the expectant consistency if , as expressed below. (9) where k = 1,2,⋯,#Lij, and #Lij is the number of possible linguistic terms in Lij.

Moreover, based on the expectant consistency of PLPR, the probability computing model can be developed with the following mathematical programming: (10) To simplify Eq (10), we present Theorem 1:

Theorem 1. For Eq (10), the following relationship is established: (11)

Poof. Based on the properties of the PLPR, we have Then, This completes the proof of Theorem 1.

According to Theorem 1, Eq (10) is simplified to the following: (12)

Moreover, Eq (12) can be transformed into the following mathematical programming: (13) where and are the positive and negative deviations with respect to the goal, εij, respectively. tij and mij are the weights corresponding to and , respectively. Here, the mathematical programming, Eq (13), can be called the probability computing model and can be used to compute the occurrence probabilities in the PLPR.

Generally, we assume that all goals, εij (i,j = 1,2,⋯,n,i<j), are fair, and then tij = mij = 1 (i,j = 1,2,⋯,n,i<j). Hence, Eq (13) can be translated into the following: (14) Probabilities of occurrence in the PLTS can be obtained by applying the above computing model, Eq (14). Moreover, it is noteworthy that the priority weights can also be derived by Eq (14). In the following, an example is solved.

Example 1. Given a linguistic term set, S = {s0,s1,⋯,s8}, H is a PLPR with unknown probabilities, as shown below. Based on Eq (14), we obtain the following goal programming: Via MATLAB, the optimal solutions are obtained as follows: Thus, the complete PLPR is then obtained as follows: According to ω = (0.243,0.4582,0.2988)T, we derive the ranking of alternatives, x2x3x1.

Furthermore, the PLPR is at the expected consistency if f = 0 in Eq (14). However, this situation rarely occurs (i.e., the PLPR may be inconsistent). To deal with this problem, a consistency-improving algorithm of PLPR is presented next.

Consistency improvement of the PLPR

In this section, to examine the expected consistency level of the PLPR, the ECI of PLPR is defined, and a consistency-improving algorithm is constructed to improve the expectant consistency level by adjusting certain elements of the PLPR. When the ECI of the PLPR achieves or exceeds the presupposed satisfactory level, , the consistency-improving algorithm is finished. Otherwise, the probability computing model can be applied again to get the probabilities of all linguistic terms in the acceptably consistent PLPR. Next, a numerical example is provided to show the feasibility and practicality of the consistency-improving algorithm.

Definition 7. Suppose H = (Lij(p))n×n (i,j = 1,2,⋯,n) is a PLPR based on the given linguistic scale set, S = {s0,s1,⋯,s2τ}, where Lij(p) = {Lij,k(pij,k)|k = 1,2,⋯,#Lij}. #Lij is the number of possible linguistic terms in Lij. Furthermore, and are the positive and negative deviations with respect to goal εij in Eq (14), respectively. Then, the ECI of the PLPR is defined as (15) If ECI(H) = 1, the PLPR meets the expected consistency perfectly. Otherwise, the expected consistency degree is reduced. In a real decision-making environment, it is difficult to get completely consistent PLPRs for DMs. According to practical decision problems, the threshold value of consistency-level is determined in advance. Typically, the may be set to 0.99, 0.98, and 0.95, corresponding to the expected consistent level of 99%, 98%, and 95%, respectively. To obtain credible decision-making results, the expected consistency level must achieve or surpass the threshold value of consistency-level . Otherwise, we should improve the expected consistency level.

In what follows, we establish a consistency-improving iterative algorithm whose basic architectural scheme is shown in Fig 1, and we give the specific implementation steps.

thumbnail
Fig 1. Consistency-improving process based on an iterative algorithm.

https://doi.org/10.1371/journal.pone.0208855.g001

Consistency-improving iterative algorithm

Step 1. Calculate the positive deviations, , negative deviations, , occurrence probabilities, , and priority weights, ω = {ω1,ω2,⋯,ωn}T of PLPR H = (Lij(p))n×n (i,j = 1,2,⋯,n) by using the proposed probability computing Eq (14).

Step 2. Set the threshold value of the consistency-level and calculate ECI(H) with . If , then Output pij,k and ωi (i,j = 1,2,⋯,n; k = 1,2,⋯,#Lij); otherwise, proceed to next step.

Step 3. Compute the maximum deviation, dmax, using Eq (16).

(16)

Step 4. Based on the obtained dmax, we are left with two situations, described in detail as follows:

  1. If where t = 1,2,⋯,n−1,q = 2,3,⋯,n, and q>t, then we calculate the corrective elements, , according to , where k = 1,2,⋯,#Ltq.
  2. If , where t = 1,2,⋯,n−1,q = 2,3,⋯,n, and q>t, then we calculate the corrective elements, , according to , where k = 1,2,⋯,#Ltq.

Based on the above analysis, we can get the corrective PLPR, , based on the corrective elements, . The iterative process returns to Step 1.

If the expectant consistency level of the corrective PLPR has not met the requirement, then, the consistency-improving algorithm should be reused until the consistency level is acceptable. Example 2 further provides concrete details of the consistency-improving algorithm.

Example 2. Given a PLPR, H, we get According to Eq (14), we establish the following goal programming: Via MATLAB, we obtain the optimal solution as follows: Therefore, ECI(H) = 0.9167 is obtained from Eq (15). In this example, we set . Because ECI(H)<0.95, we must carry out the consistency-improving iterative algorithm as follows:

According to Eq (16), we obtain . Then, according to , we get optimal elements and . The corrective PLTS is , Thus, another corrective PLTS is and the corrective PLPR is as follows: By means of Eq (14), we obtain the optimal solution as follows: Therefore, we obtain based on Eq (15). Because , we must keep improving the expected consistency of with the consistency-improving iterative algorithm as follows:

According to Eq (16), we obtain . Thus, according to , we get the optimal element, , and the corrected PLTS is . Thus, another corrective PLTS is , and the corrective PLPR is as follows: By means of Eq (14), we have the following optimal solution: Therefore, we obtain based on Eq (15). Then, PLPR is at the expected consistency with a confidence level of 95%. Therefore, the consistency-improving iterative algorithm is finished. Based on , we obtain the ranking of alternatives: x2x1x3.

The ranking of alternatives has been changed with the consistency-improving iterative algorithm. Table 1 shows the comparison of rankings before and after consistency improvement. It shows that the ranking between x1 and x3 is changed before and after consistency improvement. The ranking, x1x3, is more credible, because the PLPR of acceptable consistency level ensured by the DMs is logical and non-voluntary. Therefore, the consistency-improvement process plays an important role in decision results.

Calculating-examples analysis and contrastive analysis

Employment-city selection problem

Because the reforms and increased openness of China, beginning in the 1980s, large-scale population migration and rapid urbanization have attracted domestic and international scholarly interest [3739]. Selection of employment location is the key determinant of worker movement [4042]. The influences on worker employment location selection can be grouped into internal and external factors. The internal factors are age, gender, and education, and the main external influences include social networks, the economy, and the environment [41]. Some researchers pointed out that, in addition to personal characteristics of migrant workers that might influence their employment location selection, the development level of the manufacturing industry, the level of economic development, the salary level, and the working environment also directly affected the choice of employment location [4244]. However, prior studies primarily used qualitative description rather than quantitative methods to study employment location. In what follows, we study the employment-city selection problem using the proposed method from a quantitative perspective.

The employment-city selection of a graduate plays a crucial role in discriminating candidates for an enterprise and has a great impact on allocation of regional human resources and regional socio-economic operations and development. In China, with the deepening reform of the economic and educational systems, it is increasingly prominent for the employment structure of graduates to lose balance. The Ministry of Education and relevant departments have implemented policies and have conducted related research projects, hoping to explore a new path by retaining and attracting talent to achieve coordinated development of the regional economy. A graduating PhD from China is assumed to select from the following four cities to take up an occupation: xi(i = 1,2,3,4):x1: Qing Dao; x2: Zheng Zhou; x3: Shi Jia Zhuang; x4: Da Lian. For a graduating PhD, job availability, wages, work intensity and environmental conditions in the employment location directly influence the decision regarding where to migrate. Based on this, the graduating PhD makes a preference decision using four criteria to compare the cities (i.e., air cleanliness (c1), the level of urban development (c2), salary and mean consumption ratio (c3), and house prices level (c4).

The graduating PhD first provides her/his preference information with xi over xj(i,j = 1,2,3,4) using PLTS, which represents the preferences of the graduating PhD over each pair of cities (xi,xj), based on the criterion, cl(l = 1,2,3,4). The corresponding PLPRs are shown in Tables 25. Here, the graduating PhD applies a set of nine linguistic terms: These are used to compare the four city pairs. Moreover, the weight of each criterion is given by the graduating PhD as c = (0.15,0.3,0.4,0.15)T. Additionally, is set by the graduating PhD.

By means of the proposed Eq (14) and the consistency-improving algorithm, we can acquire priority weights of four cities and the occurrence probabilities for four PLPRs as follows:

  1. (1) For the first PLPR, based on criterion c1, the following mathematical optimization is established based on Eq (14).

Using MATLAB, we obtain an optimal solution as follows: Thus, we have , indicating that the consistency level of H1 achieves satisfaction. Moreover, the complete PLPR, H1, is obtained by adding the above probabilities of occurrence, as shown in Table 6.

thumbnail
Table 6. Four complete PLPR matrices with respect to four criteria.

https://doi.org/10.1371/journal.pone.0208855.t006

  1. (2) Similarly, for the second PLPR, based on criterion c2, we get Thus, we have , which shows that the consistency level of H2 achieves satisfaction. Moreover, the complete PLPR, H2, is obtained by adding the above probabilities of occurrence, as shown in Table 6.
  2. (3) For the third PLPR based on criterion c3, we get Thus, we have ECI(H3) = 0.9583<0.98, indicating that the consistency level of H3 does not achieve satisfaction. Therefore, the consistency-improving algorithm must be utilized to obtain an adjusted H3 as follows:
    According to Eq (16), we have . Then, according to , we obtain and . Then, the corrective PLTS is . Thus, another corrective PLTS is . Thus, the corrective PLPR can be constructed by introducing and .
    Using Eq (14) again, we obtain the optimal solution as follows: Thus, we get , showing that achieves the acceptable consistency level. Moreover, the complete PLPR, , is obtained by adding the above probabilities of occurrence, as shown in Table 6.
  3. (4) For the fourth PLPR, based on criterion c4, we obtain the optimal solution as follows:
    Thus, we obtain ECI(H4) = 0.9583<0.98, showing that the consistency level of H4 is dissatisfactory. Therefore, the consistency-improving algorithm is used to improve the consistency level of H4. After two iterative-improving algorithms, the complete PLPR, , achieves an acceptable consistency level. The improving processes are omitted. Finally, we obtain the following optimal solutions by means of Eq (14) Thus, we obtain , indicating that the consistency level of achieves an acceptable level. Furthermore, the complete PLPR, , is obtained by adding the above probabilities of occurrence, as shown in Table 6.

Finally, the ranking matrix of four cities is obtained as follows: Therefore, the ranking of four cities is x1x4x3x2. x1 (Qing Dao) is the best selection for the graduating PhD.

Contrastive analysis

We have defined the consistency level and the acceptable consistency of PLPR. For a PLPR with an unacceptable consistency, an iteration algorithm was designed to improve its consistency until it was acceptable. As compared to the method of Zhang et al. [19], we summarized the advantages of our method as follows:

  1. Our method can be applied to derive the priority weights of PLPR with unknown probabilities, whereas the Zhang et al. [19] method cannot.
  2. The consistency-improvement processes of the two methods differ. Zhang et al. [19] adjusted all elements each time to improve the consistency level of PLPR, whereas our method only adjusted the most inconsistent elements each time, based on the probability computing model. This should preserve the initial information of DMs as far as possible.
  3. Our method can directly obtain the priority weights of alternatives with the probability computing model, whereas Zhang et al. [19] carries out a normalization process and a PLWA operator integrating process. Therefore, our method greatly reduced the computational burden.

Conclusions

PLTS comprises HFLTSs and their corresponding occurrence probabilities, which contain more precise information than HFLTSs. However, it is either impossible or against their will for DMs to provide precise probability values for all linguistic terms in the PLPR. Therefore, based on the defined expected consistency, a probability computing model was developed to calculate the probability values of the PLPR. Thus, a complete PLPR could be obtained. During real decision-making, the PLPR may be inconsistent because of the limitation of DM knowledge. Based on the defined ECI of the PLPR, a consistency-improving iterative algorithm was established to improve the consistency level by adjusting certain elements of PLPR. When the ECI of PLPR achieves or exceeds the default satisfactory level, the consistency-improving algorithm is finished. This consistency-improving and reaching process ensures that DMs’ preference information is logical. By using a probability computing model and a consistency-improving algorithm with PLPR, the optimal alternative could be obtained. Finally, by solving the employment-city selection problem, the feasibility and effectiveness of our methods were further validated from the application view.

In the future, the proposed methods should be applied to the practical large-scale group decision-making problems. Moreover, a consensus-reaching model, based on PLPRs, is also an interesting research direction.

References

  1. 1. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning-I. Information Sciences. 1975; 8: 199–249.
  2. 2. Herrera F, Martínez L. A 2-tuple fuzzy linguistic representation model for computing with words. IEEE Transactions on fuzzy systems. 2000; 8: 746–752.
  3. 3. Tapia Garcia JM, del Moral MJ, Martínez MA, Herrera-Viedma E. A consensus model for group decision making problems with linguistic interval fuzzy preference relations. Expert Systems with Applications. 2012; 39(11): 10022–10030.
  4. 4. Xu ZS, Wang H. On the syntax and semantics of virtual linguistic terms for information fusion in decision making. Information Fusion. 2017; 34: 43–48.
  5. 5. Torra V. Hesitant fuzzy sets. International Journal of Intelligent Systems. 2010; 25(6): 529–539.
  6. 6. Rodríguez RM, Martíneza L, Herrera F. Hesitant fuzzy linguistic term sets for decision making. IEEE Transactions on fuzzy systems. 2012; 20: 109–119.
  7. 7. Dong YC, Chen X, Herrera F. Minimizing adjusted simple terms in the consensus reaching process with hesitant linguistic assessments in group decision making. Information Sciences. 2015; 297: 95–117.
  8. 8. Liao HC, Xu ZS, Zeng XJ. Distance and similarity measures for hesitant fuzzy linguistic term sets and their application in multi-criteria decision making. Information Sciences. 2014; 271: 125–142.
  9. 9. Rodríguez RM, Bedregal B, Bustince H, Dong YC, Farhadinia B, Kahraman C et al. A position and perspective analysis of hesitant fuzzy sets on information fusion in decision making. Towards high quality progress. Information Fusion. 2016; 29: 89–97.
  10. 10. Zhang ZM, Wu C. On the use of multiplicative consistency in hesitant fuzzy linguistic preference relations. Knowledge-Based Systems. 2014; 72:13–27.
  11. 11. Zhu B, Xu ZS. Consistency Measures for Hesitant Fuzzy Linguistic Preference Relations. IEEE Transactions on Fuzzy Systems. 2014; 22: 35–45.
  12. 12. Song YM, Hu J. A group decision-making model based on incomplete comparative expressions with hesitant linguistic terms. Applied Soft Computing. 2017; 59: 174–181.
  13. 13. Song YM, Hu J. Vector similarity measures of hesitant fuzzy linguistic term sets and their applications. PLOS ONE. 2017; 12(12):e0189579. https://doi.org/10.1371/journal.pone.0189579. pmid:29261710
  14. 14. Pang Q, Wang H, Xu ZS. Probabilistic linguistic term sets in multi-attribute group decision making. Information Sciences. 2016; 369:128–143.
  15. 15. Bai CZ, Zhang R, Qian LX, Wu YN. Comparisons of probabilistic linguistic term sets for multi-criteria decision making. Knowledge-Based Systems. 2017; 119: 284–291.
  16. 16. Gou XJ, Xu ZS. Novel basic operational laws for linguistic terms, hesitant fuzzy linguistic term sets and probabilistic linguistic term sets. Information Sciences. 2016; 372: 407–427.
  17. 17. Liao HC, Jiang L, Xu ZS, Xu JP, Herrera F. A linear programming method for multiple criteria decision making with probabilistic linguistic information. Information Sciences. 2017; 415–416: 341–355.
  18. 18. Wu ZB, Xu JP. Possibility Distribution-Based Approach for MAGDM With Hesitant Fuzzy Linguistic Information. IEEE transactions on cybernetics. 2016; 46: 694–705. pmid:25838535
  19. 19. Zhang YX, Xu ZS, Wang H, Liao HC. Consistency-based risk assessment with probabilistic linguistic preference relation. Applied Soft Computing. 2016; 49: 817–833.
  20. 20. Zhang YX, Xu ZS, Liao HC. A consensus process for group decision making with probabilistic linguistic preference relations. Information sciences. 2017; 414: 260–275.
  21. 21. Zhang XL, Xing XM. Probabilistic Linguistic VIKOR Method to Evaluate Green Supply Chain Initiatives. Sustainability. 2017; 9(7): 1231.
  22. 22. Song YM, Li GX. A large-scale group decision making with incomplete multi-granular probabilistic linguistic term sets and its application in sustainable supplier selection. Journal of the Operational Research Society. 2018, https://doi.org/10.1080/01605682.2018.1458017.
  23. 23. Liang DC, Kobina A, Quan W. Grey Relational Analysis Method for Probabilistic Linguistic Multi-criteria Group Decision-Making Based on Geometric Bonferroni Mean. International Journal of Fuzzy Systems. 2018, 20(7): 2234–2244.
  24. 24. Liu PD, Teng F. Some Muirhead mean operators for probabilistic linguistic term setsand their applications to multiple attribute decision-making. Applied Soft Computing. 2018, 68: 396–431.
  25. 25. Ma ZZ, Zhu JJ, Chen Y. A Probabilistic Linguistic Group Decision-Making Method From a Reliability Perspective Based on Evidential Reasoning. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2018,
  26. 26. Wu XL, Liao HC, Xu ZS, Hafezalkotob A, Herrera F. Probabilistic Linguistic MULTIMOORA: A Multi-Criteria Decision Making Method Based on the Probabilistic Linguistic Expectation Function and the Improved Borda Rule. IEEE Transactions on Fuzzy Systems. 2018,
  27. 27. Wu XL, Liao HC. An approach to quality function deployment based on probabilistic linguistic term sets and ORESTE method for multi-expert multi-criteria decision making. Information Fusion. 2018, 43: 13–26.
  28. 28. Wu XL, Liao HC. A consensus-based probabilistic linguistic gained and lost dominance score method. European Journal of Operational Research. 2019, 272: 1017–1027.
  29. 29. Xu ZS, He Y, Wang XZ. An overview of probabilistic-based expressions for qualitative decision-making: techniques, comparisons and developments. International Journal of Machine Learning and Cybernetics. 2018, https://doi.org/10.1007/s13042-018-0830-9.
  30. 30. Alonso S, Cabrerizo FJ, Chiclana F, Herrera F, Herrera-Viedma E. Group decision making with incomplete fuzzy linguistic preference relations. International Journal of Intelligent Systems. 2009; 24: 201–222.
  31. 31. Dong YC, Xu YF, Li HY. On consistency measures of linguistic preference relations. European Journal of Operational Research. 2008; 189: 430–444.
  32. 32. Herrera-Viedma E, Martínez L, Mata F, Chiclana F. A consensus support system model for group decision-making problems with multigranular linguistic preference relations. IEEE Transactions on fuzzy systems. 2005; 13: 644–658.
  33. 33. Tanino T. Fuzzy preference orderings in group decision making. Fuzzy Set and Systems. 1984; 12: 117–131.
  34. 34. Xu ZS. An approach to pure linguistic multiple attribute decision making under uncertainty. International Journal of Information Technology & Decision Making. 2005; 4: 197–206.
  35. 35. Xu ZS. EOWA and EOWG operators for aggregating linguistic labels based on linguistic preference relations. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems. 2004; 12: 791–810.
  36. 36. Pei LD, Jin FF, Ni ZW, Chen HY, Tao ZF. An automatic iterative decision-making method for intuitionistic fuzzy linguistic preference relations. International Journal of Systems Science. 2017; 48: 2779–2793.
  37. 37. Zhu N, Luo XB. The impact of migration on rural poverty and inequality: a case study in China. Agricultural Economics. 2010, 41:191–204.
  38. 38. Liu JQ, Wang CR, Liu JH. Factors affecting decision on employment destination for rural migrant workers. Population Research. 2011, 35: 73–82 (In Chinese).
  39. 39. Chiang YL, Hannum E, Kao G. Who goes, who stays, and who studies? Gender, migration, and educational decisions among rural youth in China. International Journal of Chinese Education. 2012, 1:106–131.
  40. 40. Ding JH, Liu ZY, Cheng DM, Jin L, Zou JP. Areal differentiation of interprovincial migration in China and characteristics of the flow field. Acta Geographica Sinica. 2005, 60:106–114 (in Chinese).
  41. 41. Liu SQ, Xie FT, Zhang HQ, Guo SL. Influences on rural migrant workers’ selection of employment location in the mountainous and upland areas of Sichuan, China. Journal of Rural Studies. 2014, 33: 71–81.
  42. 42. Zhang J, Xie F, Liu S, Cao M, Liu E. Influential factors in employment location selection based on “push-pull” migration theory—a case study in Three Gorges Reservoir area in China. Journal of Mountain Science. 2015, 12(6):1562–1581.
  43. 43. Willmore L, Cao GY, Xin LJ. Determinants of off-farm work and temporary migration in China. Population and Environment. 2012, 33:161–185.
  44. 44. Lamonica GR, Zagaglia B. The determinants of internal mobility in Italy, 1995–2006: A comparison of Italians and resident foreigners. Demographic Research. 2013, 29: 407–439.