Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Online evaluation method of coal mine comprehensive level based on FCE

  • Ling Shen,

    Roles Conceptualization, Investigation, Methodology, Validation, Writing – review & editing

    Affiliation School of Safety Science and Engineering, Henan Polytechnic University, Henan Jiaozuo, China

  • Guoxun Jing,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Anyang Institute of Technology, Henan Anyang, China

  • Qiang Zeng

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Validation, Writing – original draft

    zengqiang@hpu.edu.cn

    Affiliation School of Business Administration, Henan Polytechnic University, Henan Jiaozuo, China

Abstract

An online evaluation method of coal mine comprehensive level based on Fuzzy Comprehensive Evaluation method (FCE) is proposed. Firstly, following the principles of fairness, systematicness and hierarchy, taking research and development, production, sales, finance, safety and management as the first level indicators, a set of multi-level evaluation indicator system of coal mine comprehensive level combining objective and subjective evaluation indicators is established. Secondly, according to the characteristics of the indicator system, the specific process of FCE of coal mine comprehensive level is given. Then, taking SQL Server as the database management system and C#.NET as the development language, a set of B/S structure online evaluation system of coal mine comprehensive level based on FCE is designed and developed. Finally, the proposed method is applied to Coal group PM for test. The application shows that the method proposed can provide an efficient and convenient online evaluation platform to evaluate the comprehensive level of coal mines for the Coal group, and the horizontal and longitudinal comparison of the evaluation results can urge the coal mines to maintain their advantages and avoid their disadvantages, which is of some significance for improving the overall competitiveness of the Coal group.

1. Introduction

Coal mines are important economic cells that provide coal resources for a country. As a Coal group, it is of some significance to evaluate the comprehensive level of the coal mines under its jurisdiction and promote improvement through evaluation for improving the overall competitiveness of the coal mines and even the Coal group.

Current research about coal mine evaluation mainly includes safety evaluation [13], risk evaluation [47], ecological environment evaluation [8, 9], system evaluation [10], science and technology evaluation [11], etc. These belong to professional evaluations from a certain point of view, which may fall into the one-sided. As a production-oriented enterprise, we think that comprehensive evaluation including research and development, production, sales, finance, management, etc. has more guiding significance.

The comprehensive level evaluation of coal mines belongs to multi-criteria evaluation. Common methods of multi-criteria evaluation include Delphi Method [12, 13], Analytic hierarchy process method (AHP) [1416], Weight summation method (WSM), Weight product method (WPM), Entropy method [17, 18], Factor analysis method (FA) [19], TOPSIS method [2022], Artificial neural network method (ANN) [23, 24], Multiple regression analysis method (MRA) [25, 26], Fuzzy comprehensive evaluation method (FCE) [2729], etc. Among them, Delphi method and AHP method are suitable for evaluation of the subjective evaluation indicators. WSM method, WPM method, Entropy method, FA method and TOPSIS method are suitable for the evaluation of the objective evaluation indicators. ANN method, MRA method and FCE method are all suitable for the evaluation of the subjective and objective indicators. However, ANN method and MRA method are not suitable for the evaluation of multi-level indicators. FCE method is suitable for the evaluation of multi-level indicators. Through FCE method not only can the overall evaluation result be obtained, but also can the evaluation results of each indicator be obtained, which makes it easy to find out the disadvantages and propose corresponding improvement measures.

In the aspect of evaluation operation, the informationalized method of coal mine evaluation needs to be improved urgently. With the advent of the information age, manual or stand-alone evaluation has more and more exposed its shortcomings. For example, the evaluation has a certain space limitation, evaluation and calculation efficiency is low, it is difficult to make evaluation results be shared and compared.

Based on above analysis, an online evaluation method of coal mine comprehensive level based on FCE is put forward. Following the principles of fairness, systematicness and hierarchy, a set of multi-level evaluation indicator system for coal mine comprehensive level is established. The specific process of FCE for coal mine comprehensive level is given. Taking SQL Server as the database management system and C#.NET as the development language, a set of online evaluation system for comprehensive level of coal mines is designed and developed. The proposed method is applied to Coal group PM for test.

2. Establishing of evaluation indicator system

Following the principles of fairness, systematicness and hierarchy, through literature search and investigation of Coal group PM, a set of multi-level evaluation indicator system for coal mine comprehensive level is established, which takes research and development, production, sales, finance, safety and management as the first-level indicators, as shown in Table 1. The specific process is as follows. Firstly, a draft indicator system is constructed through literature search. Secondly an expert group consisting of 18 experts coming from Coal group PM and the coal mines of Coal group PM is established. Thirdly, the rationality of the selected indicators is discussed through expert meetings. Finally, the weight of each indicator is determined one by one through expert meetings.

thumbnail
Table 1. Multi-level evaluation indicator system of coal mine comprehensive level.

https://doi.org/10.1371/journal.pone.0256026.t001

3. Process design of FCE

It can be seen from Table 1 that the evaluation indicator system is a multi-level evaluation indicator system including objective evaluation indicators and subjective evaluation indicators. For this kind of evaluation indicator system, FCE method is suitable for evaluation. The quantitative indicators (hoping-large, hoping-target, hoping-small) and have-no indicators (hoping-have, hoping-no) belong to objective evaluation indicators. The qualitative indicators belong to the subjective indicators. For the objective evaluation indicators, no matter which expert evaluates it, the evaluation result is the same, so the same indicator only needs to be evaluated once. For the subjective evaluation indicators, it depends on the subjective judgment of the experts to give their grades, so the same indicator usually needs to be evaluated for more than once by different experts. Based on this, the specific process of FCE designed in this paper is as follows.

  1. Evaluation grading. Select grade A, B, C, D, E to evaluate the coal mines.
  2. Evaluation of final-level indicators. For the final-level subjective evaluation indicators, invite several experts to give grade A, B, C, D or E for each indicator. For the final-level objective evaluation indicators (hoping-large, hoping-target, hoping-small, hoping-have, hoping-no), invite one or more experts to give numeric value for each indicator according to their own expertise. Among them, for the hoping-have or hoping-no indicators, 1 or 0 should be given, 1 represents “have” and 0 represents “no”. Different from the subjective evaluation indicators, the same objective evaluation indicator is only evaluated once.
  3. Membership vector determination of final-level indicators.
  1. For the final-level subjective evaluation indicator x, apply statistical method to determine its membership vector U(x). The specific method is as follows. Count the number of grade A, B, C, D, E respectively, and assign them to nA, nB, nc, nD, nE. Let n = nA+nB+nc+nD+nE. Get the membership vector U(x) according to Formula (1).
    (1)
  2. For the final-level objective evaluation indicator x, determine its membership vector U(x) according to its characteristics (hoping-large, hoping-target, hoping-small, hoping-have, hoping-no) by appropriate methods.
  1. ① Membership vector determination of final-level hoping-small indicators. For the indicator x, apply Cauchy-type membership function to determine its membership vector, as shown in Fig 1. Specifically, when xαA, let U(x) = [1 0 0 0 0]; when αA <xαE, firstly determine U0(x) by Formula (2), then let , , , , , finally normalize it to get U(x) according to Formula (3); when x>αE, firstly determine U0(x) by Formula (4), then normalize it to get U(x) according to Formula (3). Among them, α1, α2, α3, α4, α5 are adjustment coefficients, whose values can be calculated by substituting the indicator values (Ah, Bh, Ch, Dh, Eh) with that corresponds to membership degree of 0.5 into the membership formula. Usually let β = 2.
  2. ② Membership vector determination of final-level hoping-target indicators. For the indicator x, suppose the target is m, let x’ = |x-m|. The new indicator x’ is a hoping-small indicator. Determine the membership vector U(x’) of indicator x’ by the method described in ①. Finally, let U(x) = U(x’).
  3. ③ Membership vector determination of final-level hoping-large indicators. For the indicator x, apply Cauchy-type membership function to determine its membership vector, as shown in Fig 2. Specifically, when xαE, let U(x) = [1 0 0 0 0]; when αE <xαA, firstly determine U0(x) by Formula (5), then normalize it to get U(x) according to Formula (3); when x>αE, firstly determine U0(x) by Formula (6), then normalize it to get U(x) according to Formula (3).
  4. ④ Membership vector determination of final-level hoping-have indicators. For the indicator x, apply grade exchange method to determine its membership vector. Let 1 represent “have” and 0 represent “no”. When x≤1, let U(x) = [1 0 0 0 0]; when x = 0, let U(x) = [0 0 0 0 1].
  5. ⑤ Membership vector determination of final-level hoping-no indicators. For the indicator x, apply grade exchange method to determine its membership vector. Let 1 represent “have” and 0 represent “no”. When x = 1, let U(x) = [0 0 0 0 1]; when x = 1, let U(x) = [1 0 0 0 0].
(2)(3)
thumbnail
Fig 1. Membership vector of final-level hoping-small indicator.

https://doi.org/10.1371/journal.pone.0256026.g001

thumbnail
Fig 2. Membership vector of final-level hoping-large indicator.

https://doi.org/10.1371/journal.pone.0256026.g002

Among Formula (3), (4) (5) (6) (7) (8)

  1. Membership vector determination of non-final-level indicators. For the non-final-level indicators, apply the weighted average fuzzy operator to determine the membership vector of each indicator from low level to high level. For the non-finial-level indicator x, suppose it has k sub-indicators which are x1, x2, …, xk-1, xk, with weights of w1, w2, …, wk-1, wk. Determine its membership vector U(x) according to Formula (7). Among them, take uA(x) for an example, its calculation formula is shown in Formula (8).
  2. Membership determination of evaluated coal mine. For the evaluated coal mine, apply the weighted average fuzzy operator to determine its membership vector U according to the first-level indicators. The determination method is the same as that of non-final-level indicators.
  3. Grade determination of each indicator and the evaluated coal mine. After membership vector determination of each indicator and the evaluated coal mine, give the grade of them respectively according to their maximum membership degrees. If number of the maximum membership degree are larger than one, take more than one grades. For example, if the membership degrees of both grade A and grade B of an indicator is equal to the maximum membership value of 0.3, then the evaluation grade of the indicator is A or B, denoted as AB.
  4. Score determination of each indicator and the evaluated coal mine. In order to reflect the advantages and disadvantages of each indicator and the evaluated coal mine more intuitively, apply the weighted average method to calculate their scores according to 5-point system. Taking the indicator x as an example, its calculation formula is shown in Formula (9).
(9)

4. Design of online evaluation system

It can be seen that the calculation amount of the above evaluation method is large. Manual or stand-alone evaluation method is difficult to meet needs of the Coal group’s evaluation and comparison of the comprehensive level of coal mines under its jurisdiction. In order to improve the evaluation efficiency, ensure the accuracy of calculation results, ensure the sharing of evaluation results and realize the comparison of evaluation results, taking SQL Server as database management system and C#.NET as the development language, a set of online evaluation system for coal mine comprehensive level based on FCE is designed and developed.

4.1 Function planning

There are three kinds of identities in the system which are Group administrator, Mine administrator and Expert. The function modules of Group administrator are shown in Fig 3. T The function modules of Mine administrator are shown in Fig 4. The function modules of Group administrator are shown in Fig 5.

4.2 Online evaluation process design

  1. Preparations: The Group administrator logs in the system. Add evaluation experts through the "User manage" module. Establish one or more evaluation indicator systems through the “Indicator system” module which includes indicator system name management, indicator management, objective indicator setting and indicator system inspection. Add evaluated coal mines through the "Coal mine manage" module. Add evaluation tasks through the "Task manage" module which includes specifying the evaluated coal mine, specifying the evaluation indicator system, setting evaluation start time and end time. Assign evaluation tasks to experts through the "Assign tasks" module. Among them, the "indicator management" module provides the form of tree-shaped to add, modify the indicators and set their weights; the "objective indicator setting" module is used to set specific parameters of objective indicators, including characteristics, target, αA, αB, αC, αD, αE, Ah, Bh, Ch, Dh, Eh, etc.; the "indicator system inspection" module is used to check whether the sum of the weights of the sub-indicators of each non-final level indicator is 1, and whether the parameters of each objective indicator meet the requirements. If the result of inspection is “Y”, the indicator system is effective; otherwise, it is invalid. Only the "effective" indicator systems can be used in the "Task manage" module, so as to ensure the effectiveness of the evaluation.
  2. Evaluation: After the preparations, the Expert logs in the system. View the list of evaluation tasks assigned by the Group administrator through the "My evaluation task" module. Enter the evaluation page to evaluate the finial-level indicators through the "objective indicator evaluation" and "subjective indicator evaluation" sub-module. For each final-level subjective evaluation indicator, check its explanation, choose grade A, B, C, D or E according to his own subjective judgment. For the final-level objective evaluation indicator, check its explanation, accurately input the numeric value of the indicator as required. In particular, for the hoping-have or hoping-no indicator, 1 or 0 should be input, where 1 represents "have" and 0 represents "no".
  3. Evaluation data management: After collecting the evaluation data, the Group administrator logs again in the system. Set the status of the evaluation task as "over" through the "Task manage" module to prohibit further evaluation. View the evaluation data through the "Evaluation data" module. If the number of evaluation data is insufficient, incomplete, or any of the evaluation data are obviously unreasonable, he can reset the status of the evaluation task as "not over" through the "Task manage" module, urge relevant experts to supplement or modify the evaluation data, or assign evaluation tasks to other experts to evaluate through the "Assign tasks" module. This process is repeated until the evaluation data collected is sufficient, complete and reasonable. In this condition, set the status of the evaluation task as "over".
  4. Evaluation summary: After the completion of the evaluation, get the membership vector, grade and score of each indicator and the evaluated coal mine through the "Evaluation Summary" module.
  5. Query of evaluation results: After the evaluation summary, the Group administrator or Mine administrator can login in the system to view the evaluation result. The Group administrator can view the evaluation results of each coal mine under his jurisdiction through the modules of "Membership result" and "Score result". The Mine administrator can view the evaluation results of his own coal mine through the modules of "Membership result" and "Score result".
  6. Evaluation result comparison: After the evaluation summary, the Group administrator or Mine administrator can make some comparison through the modules of "Membership comparison” and “Score comparison”. The Group administrator can make comparison of each evaluated coal mine between different evaluations which are evaluated by the same indicator system at different periods (Longitudinal comparison), and make comparison of selected evaluated coal mines which are evaluated by the same indicator system at the same period (Horizontal comparison). The Mine administrator can make comparison of his own coal mine between different evaluations which are evaluated by the same indicator system at different periods (Longitudinal comparison).

4.3 Database design

Taking SQL Server as the database management system and following the standardized design principle, the database of the evaluation system is designed.

(1) Database structure design.

The E-R diagram of the database is shown in Fig 6. Set "cascade" to the update rule between the primary table and the child table so as to guarantee data integrity. Set "do nothing" to the delete rule between the primary table and the child table to guarantee data security.

The table “Coal mine and group” used to store the information of coal mines and Coal groups. The field type has two kinds of value which are “Coal mine” and “Coal group”.

The table “User” is used to store the users of the system. The default value of the field “Permission” is “available”. If a user leaves or cannot continue to use the system for some reasons, set "disable" to it. There are three identities for the users in the system, which are Group administrator, Mine administrator and Expert. Among them, the user of Group administrator and Expert comes from one of the Group companies, while the user of Mine administrator comes from one of the coal mines.

The table “Indicator system” is used to store information of the indicator systems. The default value of field "Status" is "unchecked". After system inspection, if an indicator system is valid, set "valid" to it, otherwise set "invalid" to it.

The table “Indicator” is used to store information of the indicators. It has a special structure. When adding a first-level indicator to an indicator system through the system, set 0 to the field “Parent indicator No.”. When adding a second-level indicator to an indicator with the Indicator No. x, set x to the field “Parent indicator No.”. When adding a third-level indicator to a second-level indicator with the Indicator No. y, set y to the field “Parent indicator No.”. And so on. It can be seen that each indicator should be set a field “Indicator system name”. In the system, a first-level indicator is led out by the system name, the second-level indicators of each first-level indicator is led out by the field “Parent indicator No.”. And so on. For each first-level indicator, an inverted tree can be established through “recursive process”. All inverted trees for all of the first-level indicators can form a tree-shaped indicator system. By the special structure, the table "Indicator" can store contents of all indicators of infinite levels. The default value of the field “Final level” is “Y”. When adding a sub-indicator to a parent indicator, set “N” to the field of the parent indicator. The value of the field “Class” is Subjective, Objective or “”, which should be specified by the user through the system. If an indicator is a final-level indicator, set "subjective" or "objective" to it, otherwise set "subjective" or "objective" or “” to it according to the specific condition. The field "Feature" is only specific for the final-level objective indicators. For the final-level objective indicators, set one of “hoping-large”, “hoping-target”, “hoping-small”, “hoping-have”, “hoping-no” to it, otherwise set NULL to it. The field “Target” is only specific for the final-level objective hoping-target indicators, that means for other indicators, set NULL to it. The fields “αA”, “αB”, “αC”, “αD”, “αE”, “Ah”, “Bh”, “Ch”, “Dh”, “Eh” are only specific for the final-level objective indicators of hoping-large, hoping-target or hoping-small type. These fields are used to calculation the adjustment coefficients α1, α2, α3, α4, α5. The fields “α1”, “α2”, “α3”, “α4”, “α5” are the parameters needed to determine the membership degree of an objective indicator of hoping-large, hoping-target or hoping-small type by the Cauchy membership function.

The table “Evaluation task” is used to store information of the evaluation tasks. Among them, the fields “Coal mine name”, “Indicator system name” and “Start time” are defined as the unique index to prevent the same record from being input repeatedly. The default value of the field “status” is “not over”. When the evaluation is over, set “over” to it. The default value of the field "Summary mark" is "N". When the evaluation data is summarized, set “Y” to it.

The table “Assigning of evaluation tasks” is used to assign evaluation tasks to evaluation experts. Where, the field "Class" takes the value of "Objective" or "Subjective".

The table “Evaluation data of final-level objective indicators” is used to store the evaluation data of final-level objective indicators. The fields "Indicator No." and "Task No." are defined as the compound primary key so as to ensure that the same final-level objective indicator of the same evaluation task is only evaluated once. The type of field "Evaluation value" is defined as "real" to ensure that evaluation value of the objective indicators of "hoping-large", "hoping-target”, “hoping-small”, “hoping-have” or “hoping-no” type can be stored by it.

The table “Evaluation data of final-level subjective indicators” is used to store the evaluation data of final-level subjective indicators. Different from table “Evaluation data of final-level objective indicators”, here the fields "Indicator No.", "Task No." and “Expert” are defined as the compound primary key. By this means, the same subjective indicator of the same evaluation task can be evaluated more than once. The value of field "Evaluation grade " is one of "A", "B", "C", "D", and "E".

The table “Summary result of final-level indicators” is used to store the membership degree, grade and score of the indicators obtained by evaluation summary. Among them, fields "A", "B", "C", "D" and "E" are used to store the membership degree of the indicators; field "Grade" is used to store the grade of the indicators determined according to the membership degree of the indicators; field "Score" stores the score calculated by the 5-point system according to the membership degree of the indicators.

The table “Overall evaluation result” is used to store the general evaluation result of each coal mine. The role of each field is the same as that of the table “Summary result of final-level indicators”. The relation between this table and table “Evaluation task” is one-to-one. In theory, they can be merged into one table. However, from the process of the system, it makes more sense to design them separately.

(2) Trigger design.

For the table “Indicator”, design the triggers shown in Table 2. Among them, the trigger “Indicator_insert” is used to calculate the fields “α1”, “α2”, “α3”, “α4”, “α5”; trigger “Indicator_update” is used to update the fields “α1”, “α2”, “α3”, “α4”, “α5”. Triggers “Indicator_noinsert”, “Indicator_noupdate”, “Indicator_nodelete” are used to ensure the validity of the evaluation data and results.

(3) Stored procedure design.

It can be seen from the system evaluation process described in section 4.2 that the work with the largest amount of calculation in the system is the summary of evaluation results. In order to simplify the front-end program, design a stored procedure named “Summary by Task No.” with the parameter “@taskno" to realize the evaluation summary. It firstly uses the “cursor”, “while loop” to determine the membership vector, grade and score of the final-level indicators from tables “Evaluation data of final-level objective indicators” and "Evaluation data of final-level subjective indicators” by the parameter evaluation task “@taskno” based on the step (3) described in section 3, then determines the membership, grade and score of the non-final-level indicators and the evaluated coal mine from low level to high level respectively, finally stores them into the data tables “Summary result of indicators” and “Overall evaluation result”. The specific code is shown in S3 Appendix.

4.4 Program design

Taking C#.NET as the development language, a set of online evaluation system of coal mine comprehensive level base on FCE is designed and developed. The specific design is not described in this paper. Among it, the program calls the stored procedure “Summary by Task No.” to get summary result of evaluation.

5. Case study

Taking Coal group PM as an example, five coal mines under its jurisdiction are evaluated for test.

Fig 7 is the main interface of Group administrator (username: lq). The main interfaces of Mine administrator (username: zw) and Expert (username: lxs) are not shown in this paper.

In the interface of “Indicator system management” shown in Fig 8, the Group administrator can add or delete the indicator system, set contents of indicators for the indicator system, set parameters for the final-level objective indicators, and check the indicator system. In order to ensure the effectiveness of the evaluation, before modifying or deleting the indicator system, the trigger designed in the database will check whether the indicator system has been used to evaluate any coal mines. Once used, modification or deletion is not allowed.

In the interface of “Indicator management” shown in Fig 9, the Group administrator can click on the indicator system name to add first-level indicators for it, or click on any indicator to add sub-indicators for it, modify it or delete it.

In the interface of “Indicator system management” shown in Fig 8, click the button “Obset” to enter the interface as shown in Fig 10. This interface lists all of the final-level objective indicators of the indicator system. Click the button “Set” in column 1 to enter the interface shown in Fig 11. In this interface, the parameters of the objective evaluation indicator can be set. Fig 11 shows the parameter setting interface with the Indicator No. 856.

thumbnail
Fig 11. Setting of final-level objective indiator (Indicator No.: 856).

https://doi.org/10.1371/journal.pone.0256026.g011

In the interface of “Assigning tasks to experts” shown in Fig 12, the Group administrator can assign tasks to evaluation experts. It should be pointed out that because each evaluation expert has his own expertise, it is not necessary for each evaluation expert to evaluate all of the objective indicators and subjective indicators, but to make reasonable arrangements according to their expertise. For example, some evaluation experts are responsible for evaluation of the objective indicators, and some experts are responsible for evaluation of the subjective evaluation indicators, and some experts are responsible for evaluation of both objective and subjective indicators.

In the interface of “Evaluation of final-level objectvie indicators” shown in Fig 13, the Expert can select the objective indicators he is familiar with and input or modify the evaluation value of these indicators according to their explanation. It can be seen that current Expert cannot modify or delete evaluation data given by other Experts.

In the evaluation interface of “Evaluation of final-level subjective indicators” shown in Fig 14, the Expert can choose the familiar subjective evaluation indicators to give their grades.

In the interface of “Evaluation data of final-level objective indicators” shown in Fig 15, the Group administrator can view the evaluation data of final-level objective indicators given by all of the Experts. On the one hand, he can check whether the evaluation data are complete. On the other hand, he can check whether the evaluation data are reasonable, and give some human intervention when necessary.

thumbnail
Fig 15. Evaluation data of final-level objective indicators.

https://doi.org/10.1371/journal.pone.0256026.g015

In the interface of “Evaluation data of final-level subjective indicators” shown in Fig 16, the Group administrator can view the evaluation data of final-level subjective indicators given by all of the Experts.

thumbnail
Fig 16. Evaluation data of final-level subjective indicators.

https://doi.org/10.1371/journal.pone.0256026.g016

In the interface of “Evaluation summary” shown in Fig 17, the Group administrator can summarize each evaluation task in turn. For example, click the Summary button of Task No. 16, the system calls the stored procedure “Summary by Task No.” with 16 as the parameter. Wait a moment, the Summary is completed, and the summary results are stored into the data tables “Summary result of indicators” and “Overall evaluation result”.

In the interface of “Membership evaluation result” shown in Fig 18, the Group administrator can view the membership degree of each indicator or the evaluated coal mine. He can also click the first row to view the membership degrees of each first-level indicators, or click the non-final-level indicator to view the membership degrees of its sub-indicators.

In the interface of “Score evaluation result” shown in Fig 19, the Group administrator can view the score of each indicator or the evaluated coal mine. He can also click the first row to view the scores of each first-level indicators, or click the non-final-level indicator to view the scores of its sub-indicators.

After evaluation summary of each evaluation task, the Group administrator can select the evalations of the coal mines evaluated by the same indicator system at the same period to get the membership comparison or score comparison(Horizontal comparison), as shown in Figs 20 and 21. He can also select the evaluations of the same coal mine evaluated by the same indicator system at different periods to get the membership comparison or score comparison(Horizontal comparison), as shown in Figs 22 and 23. The Mine administrator can select the evalations of his own coal mine evaluated by the same indicator system at different periods to get the membership comparison or get the score comparison(Horizontal comparison), as shown in Figs 22 and 23.

Through comparison, the Mine adminstrator can easily seen the change trend of the evaluation result of the coal mine and each indicator of his own coal mine, and the Group adminstrator can easily seen the advantages and disadvantages of each coal mine under its jurisdiction.

6. Conclusion and prospect

Aiming at the coal industry group, an online evaluation method of coal mine comprehensive level based on FCE is put forward. The research conclusions are as follows.

  1. According to the comprehensive level of coal mines, a multi-level evaluation indicator system is established from research and development, production, sales, finance, safety and management. Only in a more systematic and comprehensive perspective can the comprehensive level of coal mines be evaluated, so as to ensure the comprehensiveness of the evaluation results.
  2. For the final-level objective evaluation indicators (hoping-large, hoping-small, hoping-target, hoping-have, hoping-no) and subjective evaluation indicators, appropriate methods are adopted to determine their membership vectors, and then FCE is adopted to evaluate the coal mines, which expands the application scope of the evaluation method.
  3. The online evaluation system of coal mine comprehensive level designed in this paper can make evaluation, summary and comparison of coal mines conveniently and efficiently.
  4. For a coal mine, by comparing the evaluation results of the coal mine or each indicator in different periods (horizontal comparison), the change trend can be seen. If there is a good trend, it should be maintained. However, if there is a deterioration trend, improvement measures should be taken to prevent it from continuing to deteriorate. For the Coal group, by comparing the evaluation results of different coal mines and each indicator in the same period (longitudinal comparison), the advantages and disadvantages of each coal mine can be seen. For the disadvantages, the Coal group can timely urge the coal mine to improve them so as to improve the competitiveness of the coal mine and the Coal group.
  5. The method proposed in this paper can not only be used to evaluate coal mines, but also to evaluate similar enterprises or organizations after a little modification.

It should be pointed that the method proposed in this paper is suitable for the evaluation of subjective indicators or the combination of subjective and objective indicators. If all of the evaluation indicators are objective indicators, other accurate quantitative methods may be more suitable, such as Entropy method, FA method and TOPSIS method, etc.

Although the method proposed in this paper has realized the online evaluation of the comprehensive level of coal mines based on FCE, there are two research directions in the next step. One is to give improvement measures on the basis of the evaluation to make the evaluation system more intelligent. The second is to develop mobile online evaluation system (phone APP) so as to make the evaluation more convenient.

Supporting information

References

  1. 1. Yuzhong YANG, Liyun WU, Jianchun CONG. Fuzzy synthetic evaluation on safety of coal mine transportation systems based on entropy weight[J]. Journal of Harbin Institute of Technology, 2009, 41(4): 257–259.
  2. 2. Qingkui CAO, Yanli YANG, Ruilong YU. The coal mines safety appraisal based on unascertained set[J]. Journal of China Coal Society, 2007(02):181–185.
  3. 3. Fanxiu LI, Ping MEI. Application of the Multi-Element Connection Number Model in Safety Evaluation of Coal Mine[J]. Journal of Mining & Safety Engineering, 2011,28(01):163–166.
  4. 4. Fangpeng CUI, Qiang WU, Yufei CAO, et al. Using random forest for the risk assessment of coal-floor water inrush in Panjiayao Coal Mine, northern China[J]. Hydrogeology journal, 2018, 26(7):2327–2340.
  5. 5. Qixiong GU, Huang ZHEN, Shijie LI, et al. An approach for water-inrush risk assessment of deep coal seam mining: a case study in Xinlongzhuang coal mine[J]. Environmental Science and Pollution Research, 2020, 27:1–14. pmid:31912387
  6. 6. Yanbo HU, Wenping LI, Shiliang LIU, et al. Risk assessment of water inrush from aquifers underlying the Qiuji coal mine in China[J]. Arabian Journal of Geosciences, 2019, 12(3): 98.
  7. 7. Alison Mc Quillan Ismet Canbulat, Payne Dan, et al. New risk assessment methodology for coal mine excavated slopes[J]. International Journal of Mining Science and Technology,2018,28(04):583–592.
  8. 8. Chaodong YAN, Hongjun DAI, Wen GUO. Evaluation of Ecological Environmental Quality in a Coal Mining Area by Modelling Approach[J]. Sustainability, 2017, 9(8): 1265.
  9. 9. Jiaxing XU, Hua ZHAO, Pengcheng YIN, et al. Landscape ecological quality assessment and its dynamic change in coal mining area: a case study of Peixian[J]. Environmental Earth Sciences, 2019, 78(4):702–887.
  10. 10. Wang Hongtu, Zhenhua HUANG, Xiaogang FAN, et al. The application of rough sets-neural network theory to mine ventilation system evaluation[J]. Journal of Chongqing University, 2011, 34(9): 94.
  11. 11. Shugang CAO, Yaxing WEI. A study on comprehensive evaluation of technological progress level of coal enterprises[J]. Journal of Chongqing University, 2016, 39(2): 25–33.
  12. 12. Kai CUI, Fuhai SHEN, Bing HAN, et al. Establishment and application of an index system for prevention of coal workers’ pneumoconiosis: a Delphi and analytic hierarchy process study in four state-owned coal enterprises of China[J]. Occupational and Environmental Medicine, 2018, 75(9):654–660. pmid:29563194
  13. 13. Chong TAN, Yi SONG, Heng CHE. Application of set pair analysis method on occupational hazard of coal mining[J]. Safety Science, 2017, 92:10–16.
  14. 14. Min LI, Hetang WANG, Deming WANG, et al. Risk assessment of gas explosion in coal mines based on fuzzy AHP and bayesian network[J]. Process Safety and Environmental Protection, 2020, 135:207–218.
  15. 15. Lianchun ZHOU, Jinshan ZHANG, Konrad Fröhling. Evaluation of coal mine pollution abatement benefit based on analytic hierarchy process[J]. Arabian Journal of Geosciences, 2020, 13(19):71–86.
  16. 16. Xiaomin LIU, Haiyan LIU, Zheng WAN, et al. The comprehensive evaluation of coordinated coal-water development based on analytic hierarchy process fuzzy[J]. Earth Science Informatics, 2020,: 1–10.
  17. 17. Jinhui LIU, Lingkang CHEN, Chuanyi LIU, et al. Pb speciation in rare earth minerals and use of entropy and fuzzy clustering methods to assess the migration capacity of Pb during mining activities[J]. Ecotoxicology and Environmental Safety, 2018, 165:334–342.
  18. 18. Zhongchang WANG, Chuan WANG, Zechuan WANG. The Hazard Analysis of Water Inrush of Mining of Thick Coal Seam Under Reservoir Based on Entropy Weight Evaluation Method[J]. Geotechnical and Geological Engineering, 2018, 36(5):3019–3028.
  19. 19. Wenquan ZHANG, Zaiyong WANG, Xianxiang ZHU, et al. A Risk Assessment of a Water-Sand Inrush during Coal Mining under a Loose Aquifer Based on a Factor Analysis and the Fisher Model[J]. Journal of Hydrologic Engineering, 2020, 25(8), 1061.
  20. 20. Mahdevari Satar, Shahriar Kourosh, Esfahanipour Akbar. Human health and safety risks management in underground coal mines using fuzzy TOPSIS[J]. Science of the Total Environment, 2014, 488–489:85–99.
  21. 21. Nan ZHANG, Daoxi WANG, Lin LI, et al. Two-way coordinated evaluation of mine water supply and demand in coal base-Empirical Research Based on TOPSIS Method[J]. Journal of Physics: Conference Series, 2019, (2): 1176.
  22. 22. Miloš Gligorić, Zoran Gligorić, Čedomir Beljić, et al. Multi-Attribute Technological Modeling of Coal Deposits Based on the Fuzzy TOPSIS and C-Mean Clustering Algorithms[J]. Energies, 2016, 9(12): 1059.
  23. 23. Rahul , Manoj KHANDELWAL, Rajesh RAI, et al. Evaluation of dump slope stability of a coal mine using artificial neural network[J]. Geomechanics and Geophysics for Geo-Energy and Geo-Resources, 2015, 1(3–4): 69–77.
  24. 24. Haibin LIU, Guangrong LI, Huan LIU, et al. Coal mine safety risk assessment based on ART-2 neural network[J]. Journal of Safety Science and Technology, 2014, 10(2): 81–85.
  25. 25. Taras SHEPEL, Bruno GRAFE, Philipp HARTLIEB, et al. Evaluation of cutting forces in granite treated with microwaves on the basis of multiple linear regression analysis[J]. International Journal of Rock Mechanics and Mining Sciences, 2018, 107: 69–74.
  26. 26. Heo JAE, Park BUMSOO, Kim BYUNGIL, et al. Multiple Linear Regression Analysis of PV Power Forecasting for Evaluation and Selection of Suitable PV Sites[J]. Korean Journal of Construction Engineering and Management, 2019, 20(6): 126–131.
  27. 27. Zeyang SONG, Hongqing ZHU, Guowei JIA, et al. Comprehensive evaluation on self-ignition risks of coal stockpiles using fuzzy AHP approaches[J]. Journal of Loss Prevention in the Process Industries, 2014, 32:78–94.
  28. 28. Yi WANG, Weifeng YANG, Ming LI, et al. Risk assessment of floor water inrush in coal mines based on secondary fuzzy comprehensive evaluation[J]. International Journal of Rock Mechanics and Mining Sciences, 2012, 52:50–55.
  29. 29. Xueyi YU, Chi MU, Dongdong ZHANG. Assessment of Land Reclamation Benefits in Mining Areas Using Fuzzy Comprehensive Evaluation[J]. Sustainability, 2020, 12(5): 1176.