Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Crash severity analysis of vulnerable road users using machine learning

  • Md Mostafizur Rahman Komol ,

    Contributed equally to this work with: Md Mostafizur Rahman Komol, Md Mahmudul Hasan, Mohammed Elhenawy, Shamsunnahar Yasmin

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    mdmostafizurrahman.komol@hdr.qut.edu.au

    Affiliations Centre for Accident Research and Road Safety-Queensland, Queensland University of Technology, Brisbane, Australia, Institute of Health and Biomedical Innovation (IHBI), Queensland University of Technology (QUT), Brisbane, Australia

  • Md Mahmudul Hasan ,

    Contributed equally to this work with: Md Mostafizur Rahman Komol, Md Mahmudul Hasan, Mohammed Elhenawy, Shamsunnahar Yasmin

    Roles Methodology, Writing – original draft, Writing – review & editing

    Affiliations Centre for Accident Research and Road Safety-Queensland, Queensland University of Technology, Brisbane, Australia, Institute of Health and Biomedical Innovation (IHBI), Queensland University of Technology (QUT), Brisbane, Australia

  • Mohammed Elhenawy ,

    Contributed equally to this work with: Md Mostafizur Rahman Komol, Md Mahmudul Hasan, Mohammed Elhenawy, Shamsunnahar Yasmin

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Software, Supervision, Writing – review & editing

    Affiliations Centre for Accident Research and Road Safety-Queensland, Queensland University of Technology, Brisbane, Australia, Institute of Health and Biomedical Innovation (IHBI), Queensland University of Technology (QUT), Brisbane, Australia

  • Shamsunnahar Yasmin ,

    Contributed equally to this work with: Md Mostafizur Rahman Komol, Md Mahmudul Hasan, Mohammed Elhenawy, Shamsunnahar Yasmin

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Centre for Accident Research and Road Safety-Queensland, Queensland University of Technology, Brisbane, Australia, Institute of Health and Biomedical Innovation (IHBI), Queensland University of Technology (QUT), Brisbane, Australia

  • Mahmoud Masoud ,

    Roles Supervision

    ‡ MM and AR also contributed equally to this work.

    Affiliations Centre for Accident Research and Road Safety-Queensland, Queensland University of Technology, Brisbane, Australia, Institute of Health and Biomedical Innovation (IHBI), Queensland University of Technology (QUT), Brisbane, Australia

  • Andry Rakotonirainy

    Roles Funding acquisition, Supervision

    ‡ MM and AR also contributed equally to this work.

    Affiliations Centre for Accident Research and Road Safety-Queensland, Queensland University of Technology, Brisbane, Australia, Institute of Health and Biomedical Innovation (IHBI), Queensland University of Technology (QUT), Brisbane, Australia

Abstract

Road crash fatality is a universal problem of the transportation system. A massive death toll caused annually due to road crash incidents, and among them, vulnerable road users (VRU) are endangered with high crash severity. This paper focuses on employing machine learning-based classification approaches for modelling injury severity of vulnerable road users—pedestrian, bicyclist, and motorcyclist. Specifically, this study aims to analyse critical features associated with different VRU groups—for pedestrian, bicyclist, motorcyclist and all VRU groups together. The critical factor of crash severity outcomes for these VRU groups is estimated in identifying the similarities and differences across different important features associated with different VRU groups. The crash data for the study is sourced from the state of Queensland in Australia for the years 2013 through 2019. The supervised machine learning algorithms considered for the empirical analysis includes the K-Nearest Neighbour (KNN), Support Vector Machine (SVM) and Random Forest (RF). In these models, 17 distinct road crash parameters are considered as input features to train models, which originate from road user characteristics, weather and environment, vehicle and driver condition, period, road characteristics and regions, traffic, and speed jurisdiction. These classification models are separately trained and tested for individual and unified VRU to assess crash severity levels. Afterwards, model performances are compared with each other to justify the best classifier where Random Forest classification models for all VRU modes are found to be comparatively robust in test accuracy: (motorcyclist: 72.30%, bicyclist: 64.45%, pedestrian: 67.23%, unified VRU: 68.57%). Based on the Random Forest model, the road crash features are ranked and compared according to their impact on crash severity classification. Furthermore, a model-based partial dependency of each road crash parameters on the severity levels is plotted and compared for each individual and unified VRU. This clarifies the tendency of road crash parameters to vary with different VRU crash severity. Based on the outcome of the comparative analysis, motorcyclists are found to be more likely exposed to higher crash severity, followed by pedestrians and bicyclists.

Introduction

Road crash is a major health burden globally. More alarmingly, the fatal crash records are reported to rise remarkably across different nations in recent years. For example, in Queensland, Australia, road fatalities are reported to increase 21.5% in 2020 relative to 2019 [1]. However, before 2020, several developed countries were able to achieve a significant reduction in road crash fatalities through multisectoral responses. But the targeted road safety of vulnerable road users (VRU) is still far-reaching. In road safety research, pedestrians, bicyclist, motorcyclist are generally referred to as VRUs. These road users are not protected by an external shell or other external protective measures as motor vehicle occupants are, and hence these groups are prone to get severely injured if involved in a road traffic crash [2]. In Australia, in 2020, it was reported that fatalities for pedestrians were around 12.3% in comparison to all road user fatalities. Moreover, 832 pedestrians were reported to be fatally injured in Australia between the years 2014 through 2018 [3]. On the other hand, 179 bicyclists were reported to be involved in fatal crashes between 2014 to 2018. This number represents 3% of all fatal crashes in Australia [4, 5]. Also, motorcyclists represent 13% of all road fatalities in Australia for the years 2014 through to 2018 [6]. These number clearly signify that VRU safety is a serious road safety concern in Australia, like many other nations around the world.

To improve road safety and reduce such unfortunate events, it is crucial to identify the relevant factors that contribute to crash severity outcomes of VRUs. The contribution of some of these critical factors is likely to vary across different VRU groups, whereas other critical variables might play a similar role. It might be beneficial to compare different critical factors contributing to crash severity outcomes of different VRU groups in order to identify a unified solution in mitigating such unfortunate events. Moreover, comparing crash feature patterns of severity outcomes across different VRU groups might be useful in identifying guidance for road safety education targeting different VRU road user groups. The comparative analysis of VRU crash severity outcomes may contribute towards a broad understanding of the current safety concerns of all VRUs. At the same time, the statistics of crash feature characteristics with high crash severity outcomes could be analysed for identifying several preventive countermeasures, such as engineering, enforcement or educational countermeasures, to reduce the road crash-related trauma of VRU groups [7].

In existing safety literature, machine learning modelling techniques recently have emerged as a promising modelling tool for VRU crash severity classification and analysis on the relationship of road crash features with respect to the severity levels. Employing several machine learning algorithms to analyse critical factors of crash severity outcomes for all VRUs together and separately for each VRU group will allow us to develop our understanding of the importance of these factors for each group, while comparisons across different machine learning modelling techniques will enable us to identify the best-performed models. Analysing the importance and relation of road crash features with respect to VRU crash severity levels will give more intuition to a comparative study of crash severity among different VRU modes separately and for all VRUs together.

With the advancement of the intelligent transportation system (ITS), several improved collision preventions and safety techniques targeted towards improving safety for VRU groups with intersection signal control and vehicle communications have been developed and deployed [8]. However, these technologies are expensive due to the installation and maintenance complexities, and it will be prohibitively expensive to implement these technologies across the entire region. So, it is essential to identify the higher crash severity locations for VRU in prioritising these locations for implementations of these advanced traffic management technologies. Moreover, for further development of these collision prevention technologies, researchers need extensive information on which crash parameters and elements are likely to contribute towards high VRU crash severity and require a higher focus on improving safety. The direct involvement implementation of countermeasures without the evidence from data analysis may require several trial-and-error, and thus it could cause superficial management in road safety improvement. In such scenarios, road safety management is less likely to be economical. Moreover, a countermeasure might not be effective if location-specific safety concerns are not considered. So, analysing the road crash severity of VRU groups is of utmost importance to inform the road safety improvement framework targeted towards improving VRUs safety.

As such, the overarching aim of this study is to analyse critical features associated with different VRU groups—for pedestrian, bicyclist, motorcyclist and all VRU groups together. The critical factor of crash severity outcomes for these VRU groups is estimated in identifying the similarities and differences across different important features associated with different VRU groups. Specifically, three machine learning algorithms, including (1) Random Forest (RF), (2) Support Vector Machine (SVM) and (3) K-Nearest Neighbour (KNN), is used in classifying the crash severity features for VRU groups. So far, there is no specified rule to apply a particular machine learning model for a specific application [9]. Therefore, most of the research uses multiple machine learning models to the same dataset and use comparative analysis. For example, the study performed by Thanh Noi and Kappas [10] compared the performance of three supervised machine learning models, i.e., KNN, RFC and SVM, in the classification of remote sensing images. The authors found the SVM classifier to be the best performing model in this application, while considering accuracy as performance measure. This indicate that different machine learning models show promises in different applications; however, which classifier is best for a specific application is still not clear.

Specifically, in the existing road safety and crash severity analysis research, several studies have compared the performance between machine learning models where KNN, SVM, and RF models show their performance advantages at different domains [1113]. Therefore, all of these models bear the significance to be used in machine learning-based analysis for road crash severity. These models perform better in different applications and it is not feasible to conclude superiority of one without comparing their performance for the specific application.

The performances of these models are compared by employing different performance measures, such as accuracy, sensitivity, specificity, precision, F1 test, under the receiver operating characteristic curve (ROC), the area under the ROC curve (AUC) score to identify the best fit models across different VRU groups. The comparisons of critical crash features among different VRU groups are performed by measuring the partial dependency of road crash features with the severity levels. For the analysis, the crash data is sourced from the state of Queensland, Australia, for the years through 2013 to 2019.

The rest of the paper is organised as follows: the literature review section provides an overview of the previous literature on VRU crash severity analysis. The methodology section describes the data while also presenting the data pre-processing and classification models. The results section provides the outcome of the study, and it scopes the performance of the machine learning models, the feature ranking analysis and the crash severity probability analysis. The paper is concluded following the discussion on the outcomes, which includes the interpretation of the research outcome and limitations.

Literature review

In road safety research, analysis of crash severity outcomes is a mature field. In identifying the critical factors contributing to crash severity outcomes, in existing literature, the application of the statistical approaches has remained the workhorse. Researchers are implementing different statistical approaches and econometric models to identify the crash features contributing to higher crash severity outcomes [1422]. Discrete choice model, such as random parameter model, random parameter ordered probit analysis, random parameter logit model, mixed logic model are most common statistical approaches used in different road crash data analysis [2333]. It is beyond the scope of this study to present a detailed literature review of these statistical modelling. Please see Slikboer, Muir [34] for a detailed literature review on these studies. More recently, several studies have also adopted machine learning-based techniques to identify the important crash features for crash severity [3538]. With the advancement of artificial intelligence, machine learning-based modelling has become popular in identifying road crash severity factors.

Machine learning models perform better in handling data outliers, noisy and missing data values [37]. With the black box tactics, machine learning models do not need any presumption mathematical function. These models have complex structures with robust learning ability [39, 40]. Even the complex crash severity structures can be quickly interpreted using machine learning models [38, 4143]. Different machine learning algorithms were compared with different statistical models for road crash severity prediction by analysing the accurate prediction rate. These studies concluded that the machine learning algorithms provide a superior prediction of crash severity [44]. Moreover, recent research based on California read-end crash severity data, prediction accuracy was compared among multinomial logit (MNL), mixed multinomial logit (MMNL), and machine learning algorithm: support vector machine (SVM). The study found that SVM shows better results [45]. Therefore, machine learning-based technique for road crash severity analysis is emerging as a promising modelling technique.

A machine learning approach was used with different algorithms for defining the influence weight of different features for the fatal crash severity of Lebanese Roads [46]. A study on SHARP 2 naturalistic driving data was done to compare the impact of different crash severity features between logistic regression analysis and SVM analysis, where they have found superior outcome from SVM [47]. In another research, crash severity was predicted by four machine learning algorithms with 15 different road crash features. They only analysed and compared the severity models and did not measure the feature ranking or feature relation to crash severity levels. The study developed an improved clustering algorithm to enhance prediction accuracy and significantly improved prediction accuracy [48]. However, the application of machine learning approaches in analysing crash severity outcomes for VRU is limited, and very few studies have focused on VRU crash severity analysis [35, 36, 49]. These studies were also limited by the number of explanatory variables considered in existing machine learning-based crash severity modelling techniques.

VRU Crash severity was predicted in a study using decision tree and ensemble prediction models for bicyclist and pedestrians, where the study found significant prediction improvement from ensemble techniques [49]. For motorcyclist crash severities in Ghana, an analogous machine learning algorithm was demonstrated and compared with a multinomial logit model. Here, the machine learning algorithms were found more precise and reliable in predicting crash severity than the multinomial logit model and found the best performance using the Random Forest model among all the classifiers. The study also calculated feature importance and gain information base on the random forest model to show feature ranking with respect to crash severity, and the location type, time of crash and settlement type features showed the highest ranking among them all [36]. In another research conducted by the same researchers on identifying motorcyclist crash severity in Ghana, they considered three different machine learning algorithms. The study found the Simple Cart model with the best accuracy and identified some significant factor responsible for motorcyclist crash severity, including location type, settlement type, time of the crash, collision type and collision partner [35].

From the analysis of previous literature, it can be observed that different machine learning algorithms and models were implemented for crash severity analysis of different aspects. However, there are still a significant research gap. First, no studies were found on comparative analysis of VRU crash severity by machine learning modelling either for individual or unified VRU groups. Second, a limited number of road crash parameters were considered as input features in existing machine learning-based VRU crash severity modelling. Even though some studies analysed feature importance and ranking [36], there is no dependency analysis of road crash parameters to show how they are changing with high and low crash severity levels. Lastly, the crash severity mechanism is a complex phenomenon that occurred due to a multitude of factors. Therefore, it is important to consider more explanatory variables, such as crash type and nature, the gender and age group of the VRU, road and environmental conditions. Therefore, it would be worthwhile to perform a comprehensive analysis and compare different road crash parameters based on machine learning-based modelling for all VRUs and for each VRU mode separately (pedestrian, bicyclist, and motorcyclist).

The current study is contributed to the analysis of VRU crash severity of Queensland, Australia, by considering crash data for the years 2013–2019. Seventeen different road crash parameters are considered as input features of machine learning models (all feature information is shown in Table 1). For VRU crash severity classification, three machine learning models are built using RF, SVM and KNN as classifiers, and the best performing model is determined based on the comparison of models’ performance measures. This model is further used in measuring the partial dependency of individual crash features for each VRU crash severity modes, showing how the crash severity (dependent variable) changes as the feature (independent variables) changes. This partial dependency analysis represents the impact of road crash parameters over the trend of VRU crash severity levels. This helps in understanding the road crash features responsible for severe crashes for different VRU groups. The outcome of this study is likely to inform road safety countermeasure in improving VRU safety for each VRU group while also identifying a unified safety solution targeting all VRU groups.

Methodology

Queensland crash dataset

The crash data for the study is sourced from the official crash database of Queensland collected and compiled by the Department of Transport and Main Roads (TMR). The crash data for VRU groups were collected through for the years 2013 to 2019. The crash data reported in QLD does not record any injury crashes since 2010. Therefore, the data has injury severity levels information for the crashes resulting in casualty only and are reported as four scale injury severity levels—minor injury, medical treatment, hospitalisation, and fatal injury. During the 2013–2019 time period, 69 fatal and 1273 hospitalised injury crashes were reported for the VRU groups under consideration—pedestrian, bicyclist and motorcyclist. Among them, motorcyclist bears the highest percentage in both fatal and hospitalised severity. A crash is defined as fatal when the crash victim dies within 30 days of hospitalisation. The crash victim being admitted to the hospital is defined as hospitalised injury. If the crash victim is admitted to the hospital but released after few hours with treatment, then the injury severity is defined as medically treated injury. If the crash victim evades the crash with first-aid treatment, then it is defined as a minor injury severity level.

Data pre-processing

Data pre-processing and cleaning is an important preliminary step for the downstream analysis using machine learning algorithms. The raw data had 65 different features having 21,989 data points. The data were filtered in several steps. First, all the crash data related to VRU and their associated crash events were filtered (bicyclists, motorcyclists, and pedestrians). Second, one of the features from the features containing similar information was considered. Last, the manual check was done on the whole dataset, and finally, 17 features were extracted. The final dataset has a record of 21,158 VRU crashes, including 11,190 data records for motorcyclists, 5,390 records for bicyclist and, 4,578 records for pedestrian for the years 2013 through to 2019.

For our research purpose of classifying the distinction between the major crash injuries and minor crash severity condition of different road crash features, the injury severity levels are divided into two broad categories—low severity (including minor and medically treated injuries) and high severity (including hospitalised and fatal injuries). The four different severity levels are associated with data imbalance since there are few data records for fatal (572) and minor injury (2000) categories, while the data records are higher for the hospitalised (11814) and medically treated (6772) injury severity categories. The imbalance in the datasets may result in the deteriorated performance of the classification models having an imbalanced confusion matrix and thus a higher gap between sensitivity and specificity. Therefore, to tackle the data imbalance issue in injury severity levels, these were converted to a binary class—low severity (positive class) and high severity (negative class). Such aggregation of injury severity categories helps in clarifying confident viewpoints of road crash features to show their distinction in high and low crash severity levels. The final dataset had 21,158 VRU data records, including 12,386 high severity and 8,772 low severity cases.

The filtered VRU data is further divided into three sub-datasets based on the VRU types—pedestrians, bicyclists, and motorcyclists. In the data, all information of feature and classes are given in descriptive view. However, to work on the methodological procedure, the features were transformed using a label encoder system in Python 3.7.7 platform. The levels of each feature are converted to numerical value counting from zero (0) to the maximum number of levels minus one. Some similar features of the data were incorporated into a single feature to ensure improved performance of classification and to demonstrate their behaviour sequentially. The numerical denotation of selected features of pre-processed data for VRU crash severity is showed in Table 1.

Classification approaches

The classification approach defines the crash severity classification methodology, outputs, and comparison among different classifiers for unified VRU and for different VRU groups separately: motorcyclists, bicyclists and pedestrians. Followed by the pre-processing stage, the dataset is divided into three different mediums for each individual type of VRU, and the ensemble pre-processed data was set for unified VRU. Three machine learning algorithms: RF, SVM and KNN, are used as classifiers to classify the crash severity for unified VRU and individual motorcyclists, bicyclists, pedestrians. Most of the statistical models work to infer the relationship between or among two or more variables, whereas the machine learning models deal with making the best accurate predictions [50]. The predictor outcomes are used to identify the class of the target variables. On the one hand, the statistical models can handle very small datasets, whereas the machine learning models are designed to deal with big data [51]. The dataset contains 21158 data points, having 17 features. Using statistical methods, such as ANOVA F Test or Correlation-based methods, could make the interpretation complex; thus, we have used machine learning models in this study. Given the different machine learning-based predictive models works on their specific principles, it is worth comparing their performances on the same dataset. The three selected models are supervised learning algorithms. SVM is a linear model that identifies the best classification hyperplane to separate data into desired classes [52]. KNN algorithm analyses the similarity of the data to classify different classes [53]. It considers a K value at the nearest neighbour to the data point for classification. The random forest acts as an ensemble method bagging multiple decision trees for classification [54]. The decision tree is an algorithm containing series of trees with the binary decision about the class. As such, random forest outperforms decision tree as an ensemble technique, decision tree model is not separately used for our crash severity analysis.

The whole data was split into train and test data by 3:1 ratio, where 75% of the data was used to train the models after necessary hyperparameter tuning with cross-validation. Holdout validation was done with the remaining 25% data, which was used for the testing purpose. The hyperparameters of each classifier were set using a consecutive iteration process for precise gradient optimisation, reduction of the loss function and increase the accuracy as well. For the KNN classifiers, a set of the best value of ‘k’ was used to train the model, and the ‘k’ value corresponding to the best training accuracy was chosen. For example, the plot for the KNN model of training accuracy for the pedestrian group with different values of ‘k’ is illustrated in Fig 1.

For the gaussian SVM model, ‘rbf kernel’ was used, and ‘grid-search’ for ‘C’ and ‘γ’ parameters using the ‘grid-search’ algorithm and the best values were chosen for the best accuracy after cross-validation. For the random forest classifier models, a grid-search was done on the ‘n_estimate’ and max depth to tune the number of trees in the forest and the maximum depth of the tree, respectively. Different performance measures are used to evaluate the performance of machine learning models, including sensitivity (true positive rate), specificity (true negative rate), accuracy, area under the receiver operating characteristic curve, precision, and f1 score.

Analysis results

Performance of the machine learning models

For model performance measures, accuracy, sensitivity, specificity, precision, F1 test, under the receiver operating characteristic curve (ROC), area under the ROC curve (AUC) score were compared comprehensively. The result of different classification model for different VRU types is illustrated sequentially in following Table 2.

thumbnail
Table 2. Performance of classification models for crash severity levels.

https://doi.org/10.1371/journal.pone.0255828.t002

From the results and scores of different models for different VRU, it can be observed that the Random Forest classifier shows the best result with model accuracy of 72.30%, 64.45%, 67.23% and 68.57%, respectively, for motorcyclists, bicyclists, pedestrians and unified VRU. For a clear comparison of different machine learning models for different VRU, a bar graph with measurement detail is presented in Fig 2.

thumbnail
Fig 2. Comparison performance measures of classifiers for different VRU models.

https://doi.org/10.1371/journal.pone.0255828.g002

Fig 2 represents the performance of the three different classifiers for four different scenarios, i.e. motorcyclists, bicyclists, pedestrians and unified VRU. The output of different classifiers is coded through specific colours. For RF, SVM and KNN, the coloured green, yellow and red bars are used, respectively.

From the performance measure bars of motorcyclists, RF’s test accuracy and F1 score are the highest. Nonetheless, SVM generates the nearest sensitivity score (94.12%) compared to 94.53% when using RF. The specificity score for RF (29.79%) is much higher in differences in comparison to SVM specificity (17.51%) for motorcyclists, and RF is the best in precision (70%) too. For Bicyclists, RF is advanced in test accuracy (64.45%) and other performance parameters than other classifiers. The f1 score (67.15%) and precision score (75.87%) is drastically high for RF than the second largest f1 score (47.69%) and precision (54.23) of SVM. The KNN specificity score (77.36%) shows the highest score, and on the other hand, the RF sensitivity (53.53%) shows the high priority. However, the difference between RF sensitivity with KNN sensitivity and the difference between RF specificity with KNN specificity is almost equivalent.

For Pedestrians, the RF classifier has the best accuracy, f1 score, test accuracy, precision and specificity. The best sensitivity score (98.12%) is achieved from SVM, but the unified score of RF is mostly above the other two classifiers’ scores. In the case of unified VRU integrating all motorcyclist, bicyclist and pedestrian, the classification model was generated with RF, SVM and KNN too. Analysing their results, only the sensitivity of SVM (82.23%) is very close to the sensitivity of RF (83.56%). Apart from that, the RF classifier model for unified VRU is found supreme.

Based on comparison and analysis of all classification model for each individual and unified VRU, it is identifiable that the RF classifier is superior to other classifiers in unified performance measure comparison for different VRU types. But still, SVM and KNN classifiers have some advanced scores in a specific field than RF classifier for different VRU groups. So, before pronouncing the RF model as most legitimate and accepted in classifying VRU crash severity, further evaluation step is proceeded by comparing the receiver operating characteristic (ROC) curve of different classifier models for different VRU types. The ROC curve with true positive rate and false positive rate for different VRU types by different classifier models are shown in Fig 3.

thumbnail
Fig 3. ROC curves of different classifiers.

(A) Motorcyclists (B) Bicyclists (C) Pedestrians (D) VRUs.

https://doi.org/10.1371/journal.pone.0255828.g003

In Fig 3, the ROC curves of RF, SVM, KNN classifiers are illustrated using blue, orange and green curves, respectively, for each VRU type. From the curves of three individual VRU and unified VRU, it is observed that the RF AUC score for all VRU categories is higher in comparison to other classifiers, and it is around 70% for all VRU except cyclist (66%). As the AUC shows the best compromise between the true positive rate and false positive rate, the higher value of AUC is always preferable while considering a machine learning algorithm. After analysing ROC curves for all VRU groups, it is clearly understandable that the RF classification model outperforms the other three classifiers (KNN, SVM and ANN) in the current study context. So, RF was considered as most authentic and legitimate among other classifiers for modelling the classification of QLD VRU crash severity levels for the years 2013 through 2019. Thus, further analysis, as presented in the following sections, of QLD VRU feature impact for all different VRU types and feature behaviour with the crash severity level was proceeded using the RF classification model.

Feature ranking analysis

Features ranking refers to the response of each feature to vary with VRU crash severity classification. The feature ranking is done using the random forest feature importance algorithm. As the random forest is a tree-based model, each of the nodes of the decision tree works as a condition for a specific feature, and thus the similar values ended up being listed in the same set. The measure for feature ranking is called ‘impurity’, and during the training phase of the decision tree, the contribution of impurity decreases for each feature in a particular tree is computed. As the first is the combination of trees, the impurity decrease from all the trees are averaged, and the features are ranked accordingly [55, 56]. Feature ranking analysis based on RF is shown in following Fig 4.

In Fig 4, the feature ranking was plotted separately for each of the VRU groups, where the vertical axis presents the feature scores, and the horizontal axis represents the included features for analysis. The features of motorcyclists, bicyclists, pedestrian and unified VRU, are displayed using red, blue, yellow, and green bars, respectively. From the plots, it is observed that hour, posted speed limit and age group are most significant in VRU crash severity analysis as it is drastically higher for all VRU types than any other features. For pedestrians, drink and drug-related crashes and traffic control also impact highly for crash severity classification. Pedestrian and bicyclist of different ages at different times of day show different behaviour on crash severity. Bicyclist crash severity classification has a high impact on road rule violation, and both bicyclist and motorcyclist groups are found highly related to posted speed limit parameter. For the speeding and roadway features, motorcyclist involved crashes were top in the feature ranking, as it shows the highest feature scores compared to the other VRU groups. Moreover, the speed limit factor is found as the top important feature in classifying crash severity of unified VRU. Speeding behaviour also influences motorcyclist crash severity classification, while the speeding factor to any other VRU found to be negligible.

Crash severity probability analysis

To evaluate the probability for severe crashes in different road crash features, model-based partial dependency plots are generated and discussed in this section. The partial dependence plots illustrate the marginal dependency of the crash severity on each feature. Here, partial dependency is plotted based on the RF classifier model to demonstrate the impact of individual feature classes over the change of crash severity for all VRU categories of QLD road. Partial plots show the effect of adding one feature (independent variable) to a model, which already contains single or multiple independent features/variables. In this study, the contribution of the different features (independent variables) is interpreted with the corresponding crash severity levels (dependent variables) with the partial plots. Most of the features show a clear indication of their contribution towards the crash severity levels. The probability of crash severity with different road features is interpreted with partial dependency plots as follows in Figs 57.

thumbnail
Fig 5. Partial dependency plots of different features with respect to VRU crash severity.

(A) Age Group (B) Disobey Road Rule (C) Drink, Drug and Alcohol Related (D) Area Remoteness (E) Day of Week (F) Driver Condition.

https://doi.org/10.1371/journal.pone.0255828.g005

thumbnail
Fig 6. Partial dependency plots of different features with respect to VRU crash severity.

(G) Roadway Features (H) Hour (Time of Day) (I) Road Section Authority (J) Road Region (K) Month (L) Road and Environment Condition.

https://doi.org/10.1371/journal.pone.0255828.g006

thumbnail
Fig 7. Partial dependency plots of different features with respect to VRU crash severity.

(M) Year (N) Speed Limit (O) Vehicle Condition (P) Traffic Control (Q) Speed Driving.

https://doi.org/10.1371/journal.pone.0255828.g007

From the partial dependency plots of different road crash features, it is clearly evident that motorcyclist crash severity is extremely higher in almost all road crash feature conditions than any other VRU crash severity. For few road crash features and their subclasses, unified VRU crash severity is found to exceed motorcyclist crash severity. For speeding crashes, unified VRU crash severity slightly surpasses motorcyclist crash severity at the very end. Also, drink driving, alcohol-impaired pedestrians, and unrestrained vehicle condition crashes show a higher severity trend for unified VRU crash severity than motorcyclist severity. For higher posted speed limit crashes (above 80 kmph), unified VRU are found most vulnerable to crash severity and pedestrians with age group near 75, and above are found more likely confronting to high crash severity exceeding both motorcyclist and unified VRU crash severity. Followed by the motorcyclist crash severity, pedestrian severity intervenes with unified VRU crash severity. Bicyclist crash severity is found comparatively mild in comparison to all other VRU crash severity at Queensland.

For different years and time, the QLD VRU crash severity trend varies significantly. Motorcyclist crash severity is found increasing near 2019, whereas pedestrian crash severity decreases near 2019. Motorcyclist and unified VRU crash severity are found comparatively higher in the middle of weekdays and evening to early morning. All VRU crash severity is comparatively scaled down in major cities and intersections rather than remote areas. Atmospheric condition responses to high motorcyclist crash severity and road condition and lighting condition cause higher unified VRU crash severity. Among different road regions, motorcyclist crash severity is found less in metropolitan areas, and pedestrian crash severity also reduces in Down South West and North Coast regions. Moreover, a drastic drop in pedestrian crash severity is identified under improved traffic control crashes, and bicyclists are found zero crash interaction with alcohol-impaired pedestrians. Unregistered vehicles lead to high crash severity for all VRU. Also, fatigue and inattentive driving conditions are most responsible for all VRU crash severity than any other driving conditions. For all VRU groups, crash severity increases proportionally to the ease of posted speed limit restriction, and this severity trend varies with different road rule violations too.

Overall, motorcyclist crash severity is found comparatively extreme than other VRU types. For all features and their labels, there is a significant difference between motorcyclist crash severity than other VRU types. The pedestrian and unified VRU compete in median position, and still, they are on the verge of higher crash severity levels than the bicyclists, who are found less prone to crash severity than any other VRU types. The partial dependency plots show that VRU crashes are highly affected by several features like age group, speed limits and crash hour. Though there is a major difference found between motorcyclist and bicyclist crash severity level, they show similar trends in variation in most of the plots, whereas the pedestrian-related crash factors are showing a bit different trend, especially in high severity. All VRU types of early age and old age are more vulnerable to the road with higher crash severity, and middle-aged vulnerable road users are found less confronting to severe road crashes.

Discussion and limitation

This research demonstrates the detailed analysis of VRU crash severity by using crash data from the state of Queensland, Australia, for the years 2013 through to 2019. The factors that highly influence VRU crash severity are identified using machine learning-based classification algorithms RF, SVM and KNN. Also, the most befitting classifier for VRU crash severity classification is evaluated with meticulous feature engineering and consecutive iterations of hyperparameters. The RF classifier performs the best among the three classifiers, which is consistent with a previous study [36]. Probably this is due to the robustness of the random forest classifier in the large dataset with higher dimensionality. As the RF algorithm works on the ensemble learning based on the voting of multiple decision trees, this model is less prone to overfit, and so the result obtained from the analyses gives a convincing report. Furthermore, the partial dependency plots of each feature provide the depth analysis and relation of each feature with crash severity levels. This also shows a clear distinction of each feature with crash severity levels for different individual VRU groups and unified VRU.

However, some limitations are confronted to achieve higher specificity and accuracy from classification models. With the existing traditional machine learning algorithms, it was a hurdle to get more accuracy keeping all the considerable features. However, the feature ranking and behaviour with respect to VRU crash severity is found quite relevant. Moreover, the sensitivity is found accurate, which refers to the precise classification of high crash severity. Thus, the research fulfils its purpose of analysing VRU crash severity. As deep learning is now getting increasing popularity and giving much utility in the applied machine learning world, future works on this aspect could be done on deep neural network modelling with the existing dataset. For our analysis, we only consider the dataset of road crash data provided by the Department of Transport and Main Road (Queensland). However, the type of collided vehicles (e.g., private cars, vans, trucks or buses) may have a predominant effect on crash severities of vulnerable road users. Such information can be available in the Queensland police records and can be included for the further improvement of crash severity model specification if available. Also, It might be beneficial to compare the performance of discrete choice models with the selected machine learning approaches of our study as a future research avenue.

Implications

The results found from this study can be used for real-world implications for reducing crash severity of VRU groups. Given that the reported attributes such as crash hour, posted speed limit, age group and traffic control are highly responsible for crashes associated with high severity, the appropriate countermeasures specific to these factors could effectively help to reduce the crash for vulnerable road users. Public awareness and campaign on the given factors could effectively mitigate the risk of VRU crashes. In the peak crash hours, a warning could be given in the specific regions, and the speed limits could be revised during crash peak hours by the law enforcement authority. Speed harmonisation, such as imposing variable speed limit (VSL) using wireless communication based on estimating traffic congestion intensity at peak hours, can help to improve QLD crash severity as well as reduce probable traffic congestions for VRU groups [57]. Also, using police vehicles during historic peak hours with its emergency lights on and maintaining reduced speed triggers other vehicles to maintain harmonic speed causing the reduction of crash severity and traffic congestion [58]. Drink driving and alcohol-impaired pedestrians are still found responsible and vulnerable to higher crash severity. So, more litigation can be imposed to prevent drink driving, and awareness can be raised among people to avoid road crossing in drunk condition. Such preventive measures can be highly ensured in city bar and night club zones where alcohol consumption is regularly higher. Also, inattentive and fatigue driving condition needs frequent observation as they highly trigger road crash severity for VRU. Some advanced technologies and sensors are innovated recently to detect drivers drowsiness [59] which can be effective for drivers. As the elderly peoples are more vulnerable to road crashes, some countermeasures could be taken, such as enforcing an exclusive placard for elderly people aged 75 up (like learner’s placard), additional driving training and designing road crossings and footpaths exclusively for the elderly people. Adding more traffic control features could also help to minimise the crash risk for VRU.

Conclusion

This study contributes towards identifying crash severity factors of different Vulnerable Road User Groups (pedestrian, bicyclist and motorcyclist) while also comparing these factors across different groups. Moreover, the study identified critical factors for all VRU groups together in developing a unified framework to inform road safety solutions. The models we estimated by employing three different machine learning algorithms—RF, SVM and KNN by using data from Queensland, Australia, for the years 2013 through to 2019. The identification of the impact of different features on VRU crash severity with respect to crash severity levels is practically crucial in future planning and improvement of QLD road for vulnerable road users. Among three machine learning algorithms, the random forest-based classification model was found to perform better relative to other algorithms while getting insight into the contribution of the features on crash severity for different VRU. Moreover, this research analysed the contribution of each feature on the crash severity levels with partial plots and feature importance wrapping with random forest. Thus, the latest condition of QLD road for VRU was compared to identify the most critical condition of QLD VRU crash severity features. By scrutinising the most critical condition of these features and their time, the probable VRU friendly factors can be distinguished and used to improve QLD roads for VRU. The result analysis shows higher motorcyclist crash severity among VRU groups for any road crash parameter conditions at QLD. The pedestrians and unified VRU are also highly vulnerable to severe crashes. Only bicyclist crash severity is found comparatively mild than other VRU at QLD.

Acknowledgments

The authors would like to acknowledge the Department of Transport and Main Road (TMR), Australia, for providing the road crash data for this study.

References

  1. 1. TMR. Queensland Road Crash Weekly Report. Queensland Government Open Data Portal; 2020. Report No.: 1196.
  2. 2. Canberra A. Vulnerable Road Users. Canberra ACT Government Website. 2016.
  3. 3. NRSS. Road Deaths by Road Users. National Road Safety Strategy, Australia Government Road Safety Website. 2020.
  4. 4. Bureau of Infrastructure TaREB. Road Trauma Australia 2018 Statistical Summary. BITRE, Canberra ACT. 2019.
  5. 5. Bahrololoom S, Young W, Logan D. Modelling injury severity of bicyclists in bicycle-car crashes at intersections. Accident Analysis & Prevention. 2020;144:105597. pmid:32559658
  6. 6. Dpti. Department of Planning, Transport and Infrastructure Road Crash Database. Government of South Australia, Dpti Website. 2019.
  7. 7. Tingvall C, Haworth N. Vision Zero-An ethical approach to safety and mobility. 1999.
  8. 8. Komol MMR, Elhenawy M, Yasmin S, Masoud M, Rakotonirainy A. A Review on Drivers Red Light Running and Turning Behaviour Prediction. arXiv, csAI. 2020.
  9. 9. Chen J, Wang H, Hua C. Assessment of driver drowsiness using electroencephalogram signals based on multiple functional brain networks. International Journal of Psychophysiology. 2018;133:120–30. pmid:30081067
  10. 10. Thanh Noi P, Kappas M. Comparison of random forest, k-nearest neighbor, and support vector machine classifiers for land cover classification using Sentinel-2 imagery. Sensors. 2018;18(1):18.
  11. 11. Elamrani Abou Elassad Z, Mousannif H, Al Moatassime H. A real-time crash prediction fusion framework: An imbalance-aware strategy for collision avoidance systems. Transportation Research Part C: Emerging Technologies. 2020;118:102708.
  12. 12. Zhang J, Li Z, Pu Z, Xu C. Comparing Prediction Performance for Crash Injury Severity Among Various Machine Learning and Statistical Methods. IEEE Access. 2018;6:60079–87.
  13. 13. Fiorentini N, Losa M. Handling Imbalanced Data in Road Crash Severity Prediction by Machine Learning Algorithms. Infrastructures. 2020;5(7).
  14. 14. Munyazikwiye BB, Karimi HR, Robbersmyr KG, editors. Fuzzy logic approach to predict vehicle crash severity from acceleration data. 2015 International Conference on Fuzzy Theory and Its Applications (iFUZZY); 2015 18–20 Nov. 2015.
  15. 15. Afghari AP, Haque MM, Washington S. Applying a joint model of crash count and crash severity to identify road segments with high risk of fatal and serious injury crashes. Accident Analysis & Prevention. 2020;144:105615. pmid:32534289
  16. 16. Barman S, Bandyopadhyaya R. Crash Severity Analysis for Low-Speed Roads Using Structural Equation Modeling Considering Shoulder- and Pavement-Distress Conditions. Journal of Transportation Engineering, Part A: Systems. 2020;146(7):04020065.
  17. 17. Champahom T, Jomnonkwao S, Watthanaklang D, Karoonsoontawong A, Chatpattananan V, Ratanavaraha V. Applying hierarchical logistic models to compare urban and rural roadway modeling of severity of rear-end vehicular crashes. Accident Analysis & Prevention. 2020;141:105537. pmid:32298806
  18. 18. Ferreira S, Amorim M, Couto A. The prehospital time impact on traffic injury from hospital fatality and inpatient recovery perspectives. Journal of Transportation Safety & Security. 2020;12(8):1025–45.
  19. 19. Islam M, Mannering F. A temporal analysis of driver-injury severities in crashes involving aggressive and non-aggressive driving. Analytic Methods in Accident Research. 2020;27:100128.
  20. 20. Behnood A, Al-Bdairi NSS. Determinant of injury severities in large truck crashes: A weekly instability analysis. Safety Science. 2020;131:104911.
  21. 21. Hu L, Wu X, Huang J, Peng Y, Liu W. Investigation of clusters and injuries in pedestrian crashes using GIS in Changsha, China. Safety Science. 2020;127:104710.
  22. 22. Yasmin S, Eluru N, Ukkusuri SV. Alternative Ordered Response Frameworks for Examining Pedestrian Injury Severity in New York City. Journal of Transportation Safety & Security. 2014;6(4):275–300.
  23. 23. Dong B, Ma X, Chen F. Analysing the Injury Severity Sustained by Non-Motorists at Mid-Blocks considering Non-Motorists’ Pre-Crash Behavior. Transportation Research Record. 2018;2672(38):138–48.
  24. 24. Shao X, Ma X, Chen F, Song M, Pan X, You K. A Random Parameters Ordered Probit Analysis of Injury Severity in Truck Involved Rear-End Collisions. International Journal of Environmental Research and Public Health. 2020;17(2). pmid:31936087
  25. 25. Alogaili A, Mannering F. Unobserved heterogeneity and the effects of driver nationality on crash injury severities in Saudi Arabia. Accident Analysis & Prevention. 2020;144:105618. pmid:32535248
  26. 26. Chang F, Xu P, Zhou H, Chan AHS, Huang H. Investigating injury severities of motorcycle riders: A two-step method integrating latent class cluster analysis and random parameters logit model. Accident Analysis & Prevention. 2019;131:316–26. pmid:31352193
  27. 27. Chen F, Song M, Ma X. Investigation on the Injury Severity of Drivers in Rear-End Collisions Between Cars Using a Random Parameters Bivariate Ordered Probit Model. International Journal of Environmental Research and Public Health. 2019;16(14). pmid:31340600
  28. 28. Mannering FL, Bhat CR. Analytic methods in accident research: Methodological frontier and future directions. Analytic Methods in Accident Research. 2014;1:1–22.
  29. 29. Mannering FL, Shankar V, Bhat CR. Unobserved heterogeneity and the statistical analysis of highway accident data. Analytic Methods in Accident Research. 2016;11:1–16.
  30. 30. Wang J, Huang H, Xu P, Xie S, Wong SC. Random parameter probit models to sanalyse pedestrian red-light violations and injury severity in pedestrian–motor vehicle crashes at ssignalised crossings. Journal of Transportation Safety & Security. 2020;12(6):818–37.
  31. 31. Waseem M, Ahmed A, Saeed TU. Factors affecting motorcyclists’ injury severities: An empirical assessment using random parameters logit model with heterogeneity in means and variances. Accident Analysis & Prevention. 2019;123:12–9. pmid:30448708
  32. 32. Zhou H, Yuan C, Dong N, Wong SC, Xu P. Severity of passenger injuries on public buses: A comparative analysis of collision injuries and non-collision injuries. Journal of Safety Research. 2020;74:55–69. pmid:32951796
  33. 33. Zichu Z, Fanyu M, Cancan S, Richard T, Zhongyin G, Lili Y, et al. Factors associated with consecutive and non-consecutive crashes on freeways: A two-level logistic modeling approach. Accident Analysis & Prevention. 2021;154:106054. pmid:33667844
  34. 34. Slikboer R, Muir SD, Silva SSM, Meyer D. A systematic review of statistical models and outcomes of predicting fatal and serious injury crashes from driver crash and offense history data. Systematic Reviews. 2020;9(1):220. pmid:32988410
  35. 35. Wahab L, Jiang H. Severity prediction of motorcycle crashes with machine learning methods. International Journal of Crashworthiness. 2020;25(5):485–92.
  36. 36. Wahab L, Jiang H. A comparative study on machine learning based algorithms for prediction of motorcycle crash severity. PLOS ONE. 2019;14(4):e0214966. pmid:30947250
  37. 37. Mafi S, AbdelRazig Y, Doczy R. Machine Learning Methods to sAnalyse Injury Severity of Drivers from Different Age and Gender Groups. Transportation Research Record. 2018;2672(38):171–83.
  38. 38. Pande A, Abdel-Aty M, Das A. A classification tree based modeling approach for segment related crashes on multilane highways. Journal of Safety Research. 2010;41(5):391–7. pmid:21059456
  39. 39. Tang J, Liu F, Zou Y, Zhang W, Wang Y. An Improved Fuzzy Neural Network for Traffic Speed Prediction Considering Periodic Characteristic. IEEE Transactions on Intelligent Transportation Systems. 2017;18(9):2340–50.
  40. 40. Tavakoli Kashani A, Rabieyan R, Besharati MM. A data mining approach to investigate the factors influencing the crash severity of motorcycle pillion passengers. Journal of Safety Research. 2014;51:93–8. pmid:25453182
  41. 41. Chang L-Y, Chien J-T. Analysis of driver injury severity in truck-involved accidents using a non-parametric classification tree model. Safety Science. 2013;51(1):17–22.
  42. 42. Chang L-Y, Wang H-W. Analysis of traffic injury severity: An application of non-parametric classification tree techniques. Accident Analysis & Prevention. 2006;38(5):1019–27. pmid:16735022
  43. 43. Chang L-Y, Chen W-C. Data mining of tree-based models to sanalyse freeway accident frequency. Journal of Safety Research. 2005;36(4):365–75. pmid:16253276
  44. 44. Iranitalab A, Khattak A. Comparison of four statistical and machine learning methods for crash severity prediction. Accident Analysis & Prevention. 2017;108:27–36. pmid:28841408
  45. 45. Ahmadi A, Jahangiri A, Berardi V, Machiani SG. Crash severity analysis of rear-end crashes in California using statistical and machine learning classification methods. Journal of Transportation Safety & Security. 2020;12(4):522–46.
  46. 46. Ghandour AJ, Hammoud H, Al-Hajj S. Analyzing Factors Associated with Fatal Road Crashes: A Machine Learning Approach. International Journal of Environmental Research and Public Health. 2020;17(11). pmid:32526945
  47. 47. Hao H, Li Y, Medina A, Gibbons RB, Wang L. Understanding crashes involving roadway objects with SHRP 2 naturalistic driving study data. Journal of Safety Research. 2020;73:199–209. pmid:32563395
  48. 48. Assi K, Rahman SM, Mansoor U, Ratrout N. Predicting Crash Injury Severity with Machine Learning Algorithm Synergized with Clustering Technique: A Promising Protocol. International Journal of Environmental Research and Public Health. 2020;17(15). pmid:32751470
  49. 49. Rahman MS, Abdel-Aty M, Hasan S, Cai Q. Applying machine learning approaches to sanalyse the vulnerable road-users’ crashes at statewide traffic analysis zones. Journal of Safety Research. 2019;70:275–88. pmid:31848006
  50. 50. Tang J, Zheng L, Han C, Yin W, Zhang Y, Zou Y, et al. Statistical and machine-learning methods for clearance time prediction of road incidents: A methodology review. Analytic Methods in Accident Research. 2020;27:100123.
  51. 51. Makridakis S, Spiliotis E, Assimakopoulos V. Statistical and Machine Learning forecasting methods: Concerns and ways forward. PLOS ONE. 2018;13(3):e0194889. pmid:29584784
  52. 52. Cristianini N, Ricci E. Support Vector Machines. In: Kao M-Y, editor. Encyclopedia of Algorithms. New York, NY: Springer New York; 2016. p. 2170–4.
  53. 53. Peterson LE. K-Nearest Neighbour. Scholarpedia. 2009;4(2).
  54. 54. Pal M. Random forest classifier for remote sensing classification. International Journal of Remote Sensing. 2005;26(1):217–22.
  55. 55. Qi Y. Random forest for bioinformatics. Ensemble machine learning: Springer; 2012. p. 307–23.
  56. 56. Menze BH, Kelm BM, Masuch R, Himmelreich U, Bachert P, Petrich W, et al. A comparison of random forest and its Gini importance with standard chemometric methods for the feature selection and classification of spectral data. BMC bioinformatics. 2009;10(1):213. pmid:19591666
  57. 57. Fontaine M, Miller JS, editors. Planning for active traffic management in Virginia: international best practices and implementation strategies2012.
  58. 58. CDOT. Colorado Department of Transport Website2012 [https://www.codot.gov/news/2012-news-releases/03-2012/i-70-speed-harmonization-sunday.
  59. 59. Solaz J, Laparra-Hernández J, Bande D, Rodríguez N, Veleff S, Gerpe J, et al. Drowsiness Detection Based on the Analysis of Breathing Rate Obtained from Real-time Image Recognition. Transportation Research Procedia. 2016;14:3867–76.