Figures
Abstract
Highly accurate traffic flow prediction is essential for effectively managing traffic congestion, providing real-time travel advice, and reducing travel costs. However, traditional traffic flow prediction models often fail to fully consider the correlation and periodicity among traffic state data and rely on static network topology graphs. To solve this problem, this paper proposes a expressway traffic flow prediction model based on multi-feature spatial-temporal adaptive periodic fused graph convolutional network (MFSTAPFGCN). First, we make fine preprocessing of the raw data to construct a complete and accurate dataset. Second, by deeply investigating the correlation properties among section speed, traffic flow, and section saturation rate, we incorporate these features into a multi-feature temporal attention mechanism in order to dynamically model the correlation of traffic flow in different time periods. Next, we adopt a spatial-temporal adaptive fusion graph convolutional network to capture the daily cycle similarity and potential spatial-temporal dependence of traffic flow data. Finally, the superiority of the proposed MFSTAPFGCN model over the traditional baseline model is verified through comparative experiments on real Electronic Toll Collection (ETC) gantry transaction data, and the effectiveness of each module is demonstrated through ablation experiments.
Citation: Zhang X, Ren Q, Zhang Y, Quan C, Guo S, Li F (2024) Expressway traffic flow prediction based on MF-TAN and STSA. PLoS ONE 19(2): e0297296. https://doi.org/10.1371/journal.pone.0297296
Editor: Zhihong (Arry) Yao, Southwest Jiaotong University, CHINA
Received: September 15, 2023; Accepted: January 2, 2024; Published: February 22, 2024
Copyright: © 2024 Zhang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying the results presented in the study are available from Fujian Expressway Science & Technology Innovation Research Institute Co., Ltd. To obtain access to the use of the data, please contact 1013191086@qq.com. Minimal anonymized data can be found in the uploaded file.
Funding: This work is supported by relevant scientific research projects: Science and Technology Research Plan Project of 2022 Chongqing Municipal Education Commission (KJQN202202402, KJQN202202401).
Competing interests: The authors have declared that no competing interests exist.
Introduction
As an important transportation channel and transportation hub, expressway has a key role in the convenient travel of people, safe transportation of goods and solid economic development. At the end of 2022, China’s total expressway mileage increased to 177 thousand kilometres, which has grown more than 30% for five consecutive years [1]. At the same time, with the spillover of resources from central cities and the continuous growth of car ownership, the traffic between regions is becoming more frequent, which poses a serious challenge to the carrying capacity of expressways [2]. The contradiction between road supply and demand is becoming more and more prominent, and traffic congestion on the expressways is gradually becoming a normalized phenomenon. Traffic congestion on expressways not only reduces travel efficiency, increases the frequency of traffic accidents, and travel costs, but also worsens environmental pollution problems, such as the inability of vehicles to perform at their best due to congestion, which increases fuel consumption and pollutant emissions, and to a certain extent hinders the realization of the carbon peaking and carbon neutrality goals [3]. Accurate and reliable traffic flow forecasting methods are a key core component of Intelligent Transport Systems (ITS) and the basis for improving the efficiency of expressway operations using ITS systems [4]. Therefore, it is of great significance to research expressway traffic state prediction, timely detect changes in traffic state, and provide a basis for traffic management [5]. The 14th Five-Year Plan for Digital Transportation points out that it is one of the important tasks of digital transportation construction during the 14th Five-Year Plan to focus on promoting the application of ETC on expressways to alleviate traffic congestion, improve operational efficiency, strengthen the monitoring, control and scheduling capabilities of expressways [6]. At present, 27 thousand ETC gantries have been built nationwide, and the number of ETC-installed users exceeds 260 million [7]. The gantry system provides a large amount of ETC transaction data. Therefore, in the context of “strong transportation country”, the carbon peaking and carbon neutrality goals and smart expressway, it is necessary to dig out the complex traffic flow change trend through ETC transaction data, so as to further improve the accuracy of traffic status discrimination and prediction precision.
The traffic state changes with time and space. Because of its own characteristics, the traffic network can be divided into different grid graphs according to other geographical locations [8]. Convolutional Neural Networks (CNN) are effective for the extraction of spatial characteristics of spatial-temporal data and have been widely used in many [9–12]. The literature [13] labeled vehicle speed and vehicle density based on a differential entropy approach, and then used CNN to implement supervised congestion prediction based on traffic meta-parameters (temporal, spatial, date, holiday, special road conditions). The literature [14] uses a CNN model to achieve periodic and random prediction of traffic parameter information using empirical mode decomposition methods. The literature [15] designs a hybrid spatial and temporal feature selection algorithm to reconstruct the traffic speed, then uses CNN to extract the features, and finally captures the temporal characteristics of the data by bidirectional GRU to improve the prediction effect. However, CNNs are unable to fully capture spatial correlations for non-Euclidean spaces, in order to portray the graph structure of the traffic grid, the existing research uses the graph convolution model to gather the node information of the traffic network, and uses its spatial correlation to predict the traffic state of each node as a whole. The literature [16, 17] uses CNN and Recurrent Neural Networks (RNN) to simulate temporal correlation, while Graph Convolution Networks (GCN) are used to simulate spatial correlation. However, GCN cannot assign different weights to its adjacent nodes according to their importance in the convolution process, resulting in the same weight of each node, which has an impact on the accuracy. In recent years, it has been found that the dynamic correlation of spatial-temporal nodes in different scenarios can be calculated by introducing a mechanism to focus on traffic data in the spatial-temporal dimension.
Zhu et al. [18] improved the prediction accuracy by introducing a temporal attention mechanism to adjust the importance of each moment based on the Temporal Graph Convolution Network (T-GCN) [19]. Guo et al. [20] analyzed the recent correlation, daily period correlation and weekly period correlation of traffic flow respectively. Firstly, they processed the temporal attention mechanism of traffic flow, then added the attention mechanism to the spatial graph convolution, and designed a spatial-temporal graph convolution model to predict the change of traffic state. However, the existing methods still do not break through the predefined graph limitations, and the static topology graph established by relying on the existing prior knowledge is missing and insufficient, and cannot be directly related to the actual traffic flow prediction work. Yang et al. [21] designed a Spatial-Temporal Adaptive Fusion Graph Network (STAFGN) for capturing incomplete information on the hidden spatial-temporal dependence of the data, but the correlation and periodicity of the data were not considered.
To solve the above problems, this paper proposes MFSTAPFGCN for expressway traffic flow prediction. Firstly, the section speed and section saturation rate are taken as multivariate variables. In the time dimension, a temporal attention mechanism is introduced to describe the dynamic correlation between section speed and traffic flow, section satiation rate and traffic flow. Then, a Spatial-Temporal Adaptive Period Fusion Graph Convolutional Network (STAPFGCN) is constructed, and the period processing layer captures the daily period similarity of traffic flow data, and adaptively fuses the spatial-temporal graphs of different time periods, and then captures their spatial-temporal correlation in parallel. Finally, comparative experiments and ablation experiments were conducted and validated for the proposed model. The prediction results of the model match well the traffic distribution on the actual road with high accuracy. The main contributions of this work are as follows. (1) From the perspective of time, the dynamic temporal correlation between different traffic variables at the same node is characterized by a multi-feature temporal attention mechanism; (2) The period processing layer is added to the spatial-temporal adaptive fusion graph network, which effectively captures the daily period similarity of traffic flow data; (3) A large number of experiments have been done on the actual data with the model. The experimental results show that MFSTAPFGCN has better performance.
Related work
Several domestic and foreign researchers have invested in the field of traffic prediction research. The three primary categories of traffic prediction methods include statistical learning models, shallow machine learning, and deep learning. For example, Emami et al. [22] introduced a traffic flow prediction method based on Kalman filtering. Xu et al. [23] presented a methodology combining Autoregressive Integrated Moving Average (ARIMA) and Kalman filter techniques for the prediction of road traffic conditions. Evans et al. [24] conducted road section state prediction using the Random Forest (RF) approach. Through experimentation with varied prediction ranges and training data volumes, their algorithm demonstrated superior performance compared to alternative methods. Lv et al. [25] introduced an advanced spatio-temporal prediction model for the traffic revitalization index utilizing a tree structure. This model comprises key components, namely the spatial convolution module, temporal convolution module, and matrix data fusion module, resulting in improved prediction outcomes. Li et al. [26] presented a spatio-temporal model employing multifactor feature capture. This model integrates various influencing factors that impact cab demand at the spatio-temporal level, distinguishing it from existing baseline approaches. Lv et al. [27] introduced Tree Convolutional Networks (TreeCN), which are designed to capture directional and hierarchical features between nodes. Notably, this approach has demonstrated impressive results, even in scenarios involving small-scale aggregated distributions.
Graph Neural Network (GNN) is a hot research topic in recent years, and it is widely used in processing graph structured data [28], and plays an important role in many fields such as computer vision [29] and natural language processing [30]. Because the traffic network structure is a natural graph structure, many scholars have tried to use GNN to capture the spatial dependence of traffic flow data.
Kong et al. [31] proposed a multi-pattern passenger flow prediction framework based on GCN, which takes into account human mobility knowledge and makes the prediction accuracy become higher. Yu et al. [32] first proposed a combination of Graph Convolution and Gated Causal Convolution for modeling temporal and spatial dependencies. Huang et al. [33] integrated diffusion convolution, the sequence to sequence architecture and scheduled sampling techniques to propose diffusion convolution recurrent neural networks, which captured spatial dependence using bidirectional random wandering on the graph, and temporal dependence using an encoding-decoding framework and scheduled sampling. Zhao et al. [19] proposed T-GCN, which uses GCN to capture spatial dependencies in complex topologies, and uses Gated Recurrent Units (GRU) to learn time dependencies in dynamic traffic data. Wang et al. [34] proposed the Spatial-Temporal Graph Neural Network (STGNN) to fully capture complex spatial-temporal patterns. It uses a learnable location attention mechanism to summarize information from adjacent roads, combines RNN and Transformer to capture local and global temporal correlations, respectively. Each of the above models employs two independent GCN or CNN approaches for modeling spatial correlation, while RNN is used for modeling temporal correlation, which splitting the overall spatial-temporal correlation. Song et al. [17] proposed the Spatial-Temporal Synchronous Graph Convolutional Networks (STSGCN), which uses the spatial-temporal synchronization model to describe the complex local spatial-temporal correlation, and effectively captures the spatial-temporal heterogeneity by setting independent weights for different periods. Li et al. [35] proposed a Spatial-Temporal Fusion Graph Neural Networks (STFGNN) based on the temporal graph. This network uses data-driven methods to supplement the hidden spatial-temporal correlation between nodes, and realizes the learning of long-term correlation of spatial-temporal sequences by stacking spatial-temporal fusion processing modules and gated convolution modules. The above models are based on the static topological graph defined by the physical connection relationship or distance, which is missing and inaccurate, and have no direct connection with the actual traffic flow prediction task itself. In the case that the graph cannot be predefined according to prior knowledge, the prediction accuracy of the above models will be greatly affected.
Wu et al. [36] proposed Graph WaveNet, which uses an adaptive adjacency matrix to supplement the potential spatial dependencies in learning data, and uses a one-dimensional convolution of stacked hole causality to efficiently capture the long-term correlation of traffic flow data. Diao et al. [37] proposed a Dynamic Spatial-Temporal Graph Convolutional Neural Networks model to track the spatial correlation of changes. The dynamic Laplacian matrix estimator is used to capture the change of the Laplacian matrix, introducing tensor decomposition to reduce the complexity, and decomposing the real-time traffic flow data into global components of long-term traffic trends and local components of short-term fluctuations. Zhang et al. [38] proposed the graph convolution framework SLCNN, which introduces a dynamic graph structure learning module that can fully consider the dynamic, real-time, complex relationships and uncertainties in the actual environment.
Wu et al. [39] proposed MTGNN, which analyzes multivariate time series from the perspective of a graph for the first time, uses a graph structure learning module to learn potential spatial dependencies between data in end-to-end training, and proposes a joint framework to learn multivariate time series without predefined graph structure in a graph structure, which solves the limitations of existing models when graph structure is unknown or missing to some extent. Guo et al. [40] proposed a novel Dynamic Graph Convolutional Network (DGCN), which introduced a latent network to extract spatial-temporal features for adaptively constructing dynamic road network graph adjacency matrices. Bai et al. [41] proposed an Adaptive Graph Convolutional Recurrent Network (AGCRN) without using a predefined graph, and enhanced the graph convolutional network by using a node adaptive parameter learning module that captures node-specific patterns and an adaptive graph generation module that automatically infers mutual data between different traffic flow time series.
GCN has natural advantages in non-Euclidean data such as traffic networks. Models such as STGCN and T-GCN use GCN to capture spatial correlation, and use RNN and CNN to capture temporal correlation. However, these methods are based on known graph structures and cannot be used for uncertain or dynamically changing graph structures. GraphWaveNet, ASTGCN, GCNN, SLCNN, MTGNN, AGCRN, and DGCN use dynamic graph structures to effectively capture potential data associations. But such models use separate components to capture the temporal and spatial correlation of traffic flow data, splitting the overall spatial-temporal correlation, and not fully considering the spatial-temporal correlation between adjacent nodes at different times. STSGCN is based on the synergistic processing of potential spatial-temporal correlations in traffic flow through time blocks, but it does not evenly process the global and heterogeneous features of traffic flow, resulting in the weakening of temporal correlations between adjacent time periods. In addition, the spatial-temporal correlation of functionally similar road segments, as well as the periodic correlation of traffic flow data and the influence of special events, are not considered, resulting in their inapplicability to the dynamic graph structure.
Preliminaries
In order to represent the spatial topological relationship of each ETC gantry in the expressway road network, the expressway road network is represented as a graph G = (V, E, A), where |V| = {Node1, ⋯Noden} is the set of all ETC gantries on the expressway, N denotes the number of ETC gantries; E denotes the set of interconnecting edges between ETC gantries. A ∈ RN×N means the spatial adjacency matrix of the gantry, and Aij is 1 if there is a connection between Nodei and Nodej, otherwise, it is 0. Traffic flow, section speed and section saturation rate can all be used as attribute features of a node. Xt ∈ RN×d is defined as the value taken by a node at time t, and d denotes the dimension of traffic flow, section speed and section saturation rate. Expressway traffic flow prediction can be described as learning a mapping function f based on the traffic flow at T moments in history to predict the zone speed at T′ moments in the future.
(1)
Methodology
The general framework of the proposed MFSTAPFGCN model is shown in Fig 1. It consists of three main parts. The first part is to process the redundant and missing data in the ETC gantry transaction data in a relevant way, and then use the vehicle trajectory repair algorithm to repair the erroneous data, and then construct the traffic flow data. The second part constructs a multi-featured temporal attention mechanism, and uses the correlation functions of section speed and section saturation rate with traffic flow to fuse and calculate the process state importance at each moment, and enhance the model’s ability to portray the feature correlation on the time sequence. The third part constructs a Spatial-Temporal Adaptive Fusion Graph Convolutional Network (STFAGCN), It consists of four modules, firstly a cycle processing module based on splicing, dimension expanding, and diffusion convolution operations to model the similarities of daily cycles of traffic flow data; then a spatial-temporal adaptive fusion graph construction module to realize the effective fusion of temporal and spatial; and finally, a spatial-temporal adaptive fusion graph module and a gated convolution module to adaptively extract the long-time spatial-temporal correlations.
Data preprocessing
Due to the influence of uncontrollable random factors such as equipment abnormality, wireless crosstalk and bad weather, ETC transaction data will produce the following three types of abnormal problems in the collection process [42]. (1) Data redundancy: There will be duplication between multiple data, which will lead to waste of storage space, complex modification and potential data inconsistency. (2) Missing data: There will be some key segments such as date, time, vehicle type, vehicle model, etc. in and out of the toll station missing, resulting in the inability to effectively collect data, thus causing unreliable output, and there are generally two methods to deal with the missing problem: deletion and interpolation. (3) Data error: data that is inconsistent with normal traffic rules, such as pass numbers and incorrect gantry numbers. These abnormal data reduce the application value of ETC data mining. Firstly, redundant data and error data should be eliminated, and missing data should be repaired to reduce the impact on the model and improve the reliability of the prediction.
Vehicle trajectory repair algorithm [42]: Build the running path of each car according to chronological order. By searching the ETC gantry on the vehicle running path and the adjacent ETC gantry on the path, the topological relationship between the adjacent ETC gantry in the expressway G is determined. If so, the travel time and speed can be calculated directly. If not, a segment search is carried out according to the two gantries and inserts the running path of the car. The average speed of cars in each lane is calculated, which is used as the speed of each lane, and the driving time between lanes is obtained by the distance between lanes. In this way, the running route of the car can be restored.
Multi-feature temporal attention mechanism
From the temporal perspective, there is a certain correlation between the traffic flows of ETC gantries in the expressway road network at different time points, and this correlation changes with the change in road network conditions. Guo et al. [20] proposed a method for traffic flow prediction based on an attention mechanism that assigns different importance to the traffic flow of the road network at different moments in time, and their temporal attention mechanism in the time domain is shown as follows:
(2)
where Ve, be ∈ RT×T, Ve, be ∈ RN, U3 ∈ R1 are the parameters to be learned.
Each ETC gantry in the expressway network records different time series, such as traffic flow, section speed, and section saturation rate. The three variables of the same ETC gantries are correlated among different moments, and the correlation of the section speed and section saturation rate to the traffic flow is calculated separately with the help of cosine similarity, and the formulas are:
(3)
(4)
(5)
mean the traffic flow, section speed measured and section saturation rate by N ETC gantries in time period t respectively, M1 is the similarity matrix of traffic flow and section speed, and M2 is the similarity matrix of traffic flow and section saturation rate.
The multi-feature temporal attention mechanism is used to assign different importance to the traffic state data of the road network at different moments. The difference with the literature [20] is that the multi-feature temporal attention mechanism considers the correlation in both time and variable dimensions. The structure of the multi-feature temporal attention mechanism is shown in Fig 2. The blue part X1 is the input data of the first moment of a certain ETC gantry, containing the multi-dimensional parameters of section saturation rate Xo1, section speed Xs1 and traffic flow Xf1. The multidimensional data of the ETC ganZtry measured once in 15 minutes are parameterized, and finally the new traffic flow is obtained. The specific parameter fusion process is as follows:
When calculating the first moment , the influence of section saturation rate and section speed on traffic flow is calculated by adding green section saturation rate Xo1 and yellow section speed Xs1 and multiplying with gray traffic flow Xf1. When calculating
, the traffic flow of the previous i time steps is considered to have an impact on the traffic flow at the current i moment, which is obtained by adding the traffic flow at the previous i − 1 moment and the current moment’s section saturation rate and section speed and multiplying them with the current traffic flow. Finally, using the activation function to make a projection into a new function space, this is done for each input data, and then using Softmax
is calculated. The calculation formula is as follows:
(6)
(7) Ei,j represents the correlation of the traffic state data of the road network at moment i, j.
is the correlation of the traffic state data of the road network nodes at moment i, j after normalization. The multi-feature time attention matrix E is determined by the input, and as the input changes, E also changes with it, so that the multi-feature time attention mechanism can dynamically obtain multiple information correlations on the time domain of traffic data. Similarly, a Softmax normalization of the elements on E is required. The normalized multi-feature time attention matrix
is directly applied to the input to obtain the traffic flow updated by the multi-feature temporal attention mechanism.
Spatial-temporal adaptive period fusion graph convolutional network
As shown in Fig 3, the STAPFGCN consists of four modules, including the Period Processing Module (PPM), Spatial-Temporal Adaptive Fusion Graph Construct Module (STAFGCM), Spatial-Temporal Adaptive Fusion Graph Module (STAFGM) and Gated Convolution Module (GCM). Firstly, the PPM based on splicing, dimensional expansion, and diffusion convolution operations is designed, and the daily period similarity of traffic flow data is modeled. Second, the temporal and spatial fusion adjacency matrix MF is constructed using STAFGCM to achieve an effective fusion of temporal and spatial. MF contains the temporal adjacency matrix ATG, spatial adjacency matrix ASG, and temporal connectivity graph matrix ATC computed by fast-DTW [35]. Then, a STAFGM based on fused adaptive convolutional layers and stacked gated multiplication layers with maximum pooling action is proposed. By the end-to-end supervised method, the adjacency matrix is continuously learned in the adaptive convolution layer to construct the adaptive fused adjacency matrix . Finally, the GCM uses a highly scalable grid method to extract long-term spatial-temporal correlations, stacking k STFAGN layers to capture potential spatial-temporal dependencies.
Period processing module.
The form of the period processing module is shown in Fig 4(a), where the NP strips of spatial-temporal sequential traffic flow Sinput input model with the periodical association after updated by the multi-feature temporal attention mechanism are cross-spliced by the period processing module to obtain Sconcat in the form shown in Fig 4(b), where the yellow line represents the interconnection between the nodes and their predecessors or successors on the period axis. Sconcat is expanded with feature channels by a fully connected layer, and finally, by using a 1D CNN to process , the output size of the convolutional layer is calculated as follows:
(8)
Where Inputshape = Np × T, Filtershape = Np, Pad = 0, Stride = Np, the output of the convolution layer is the output of the period fusion processing layer, and the length T contains the mixed spatial-temporal sequence Smixed with periodic features, in the form of Fig 4(c).
Spatial-temporal adaptive fusion graph construct module.
The spatial-temporal fusion adjacency matrix MF ∈ RKN×KN consists of the fast-DTW computed temporal adjacency matrix ATG ∈ RN×N, the spatial adjacency matrix ASG ∈ RN×N and the temporal connectivity graph matrix ATC ∈ RN×N. STFGNN handles temporal by introducing the data-driven temporal adjacency matrix ATG ∈ RN×N non-neighborhood similarity between nodes with highly similar patterns. Given two time series X = (x1, x2, ⋯, xn) and Y = (Y1, Y2, ⋯, Ym), a distance matrix Mn×m can be introduced with Mi,j = |xi − yj|. Then the cost matrix Mc can be defined by the following equation:
(9)
After several iterations of i and j, is the best similarity between time series X and time series Y. DTW [43] obtained twisted paths by matching xi and yj based on dynamic programming, and wξ denotes the matching of xi and yj.
(10)
where max(n, m) ≤ ξ ≤ n + m. It follows that the algorithmic complexity of fast-DTW is O(n2) can be reduced to O(Tn) by limiting the search length T [35]:
(11)
Adding temporal trend similarity to fast-DTW for constructing temporal adjacency matrix. In the temporal adjacency matrix, the K nodes that are most similar to node N in terms of temporal patterns are considered to be interconnected, and the value of K in STFGNN is fixed as K = sparsity × N, where sparsity is a hyperparameter given in advance based on experience. However, the lack of complete connectivity prevents the model from effectively learning the nonproximate similarities between nodes, which in turn affects the prediction accuracy of the model. Using Algorithm1 in the literature [35] to calculate the temporal graph, the hyperparameter K is the degree of nodes in the temporal graph, which determines the sparsity of the temporal graph and has a large impact on the prediction accuracy of the model, and hyperparameter optimization experiments need to be conducted for the value of K. ATG means the correlation between a node and its own predecessor or successor nodes on the time axis. At each node l ∈ {1, 2, ⋯, N}, MF(ij) = 1 when i = t × N + l and j = (t + 1) × N + l, where t is the current time step. Using matrix multiplication with MF, the spatial correlation, temporal correlation, and autocorrelation from the nearest time step are integrated for each node. Finally, the spatial-temporal adaptive fusion adjacency matrix is constructed. The spatial-temporal adaptive fusion graph construction module is shown in Fig 5.
Spatial-temporal adaptive fusion graph module.
Fig 6 shows the STAFGM. The STAFGM module consists of fused adaptive convolution layers with stacked gated multiplication layers and a maximum pooling layer connected to ReZero [44]. The input of each fusion self-adaptive convolution layer is the output of the PPM or the output of the previous fusion self-adaptive convolution layer. In order to be able to complete the incomplete connection of graphs adaptively, Yang et al. [21] introduced a spatial-temporal adaptive fusion graph module in the STFGNN. Compared with STFGNN, the spatial-temporal adaptive fusion graph module completes the incomplete spatial-temporal adjacency matrix by constructing the fused adjacency matrix of spatial-temporal relations.
Fusion Self-Adaptive Convolution layer: based on spatial-temporal fusion adjacency matrix and diffusion adaptive convolution, a new fusion adaptive convolution (FSAC) [21] algorithm is designed to realize the adaptive fusion of adjacency matrix .
, where Mi and Mj are the spatial-temporal fused node embeddings of the source and target nodes, which are learnable parameters, and the ReLU activation function is used to prevent the occurrence of overfitting. Define Sf = MF/rowsum(MF) and
. Finally, the convolutional layer of the graph with
can be summarized as:
(12)
Gated multiplication layer: Each node in H0 is synchronized with complex correlations of spatially adjacent nodes, non-neighboring similar nodes, and adjacent temporal nodes by Lth matrix multiplication with . The graph convolution module also introduces the nonlinear activation property of the gating unit:
(13)
where Hl represents the lth hidden state,
is the spatial-temporal adaptive fusion graph, W1, W2 and b1, b2 are the parameters of the GLU module, ⊙ the Hadamard product, and σ represents the sigmoid function. The spatial-temporal adaptive fusion graph module aggregates complex nonlocal spatial dependencies by stacking L graph convolutions in combination with ReZero connections [45]. To reduce the complexity, the maximum pooling layer output HM = maxpool(H1, ⋯, HL) keeps only the intermediate time steps, so the spatial-temporal adaptive fusion graph module output H0 is as follows:
(14)
Gated convolution module.
Gated TCNs with different dilation factors k can learn complex temporal correlations [36]. the GCM uses a larger dilation rate and two parallel 1D dilation convolutions to form the GCM, which can effectively obtain the long-term temporal dependence of the spatial-temporal sequence. The output of the gated convolution module is calculated by the following:
(15)
where θ represents the tanh function, σ represents the sigmoid function, and θ1 and θ2 are two independent 1D dilation convolutions with a K − 1 expansion rate. It could enlarge the receptive field along the time axis thus strengthening model performance for extracting spatial-temporal dependence.
Experiments
The experimental setup for this study was configured as follows: Our model was trained on a computer running the Windows 11 operating system, equipped with an AMD Ryzen 7 5800H eight-core processor (with a base frequency of 3.2GHz) and an NVIDIA GeForce RTX 4060 Laptop GPU. The system was supported by 16GB of memory. We utilized the Anaconda software distribution and JetBrains’ Python development tool.
Data
The data used in this paper are mainly divided into two types of data, one is the ETC gantry transaction data of a province from May 2021, the main attributes are shown in Table 1, the layout of the gantry is shown in Fig 7. Two is the road network topology data, which contains each ETC gantry, the connection relationship between ETC gantries and the actual distance. The traffic flow data of each ETC gantry are counted and aggregated into a 15-minute window. The data are normalized by removing the mean and scaling to unit variance:
(16)
where mean(X) and std(X) are the mean and standard deviation of the traffic flow data, respectively.
Evaluation metrics and experiment setup
To evaluate the prediction performance of different models, the experiments use Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and Root Mean Square Error (RMSE) as evaluation metrics. And Hubor Loss was used as the loss function. Compared with the common loss function, Hubor Loss is more robust against outliers, and according to Eq (20), the squared error is used when the error is less than δ, and the linear error is used when the error is greater than δ, and the training speed is improved.
(17)
(18)
(19)
(20)
where Y is the actual traffic flow,
is the predicted traffic flow, N is the number of ETC gantries, and δ is the hyperparameter.
The data set is split into the training set, validation set, and test set according to the ratio of 6:2:2, and all experiments are repeated ten times to take the average. The hyperparameters involved are configured as follows: Np is 3, the sparsity of the temporal adjacency graph ATG is 0.01, the number of layers of STAFGL for this model is 3, each STAFGL consists of 9 STAFGM and 1 gated convolution module with a dilation rate of 3, the filter used for all convolutions is 64, the learning rate is 0.001 using the Adam optimizer, the threshold δ in the loss function is 1, the batch size is 32, and the training epoch is 100. We use the last 12 consecutive time steps to predict the traffic flow for the next hour.
The sparsity of the temporal graph ATG has a large impact on the prediction accuracy of the model. Specifically, a denser temporal graph contains more comprehensive potentially spatially relevant information, which helps the model learn the complex spatial-temporal dependencies at the overall level of the large-scale road network structure. On the other hand, a too-densely connected temporal graph weakens the influence weights of the more valuable nodes, making the prediction results more generalized and smooth, and more prone to overfitting. To ensure that the model can learn more adequate and necessary non-neighboring potential associations, the following optimization-seeking experiments are set up for the hyperparameter K.
The results of the optimization search experiment are shown in Fig 8. When K = 5, the model has the best prediction performance, and the temporal graph generated by the five nodes connecting the nodes with the most similar temporal patterns to theirs is the local optimal temporal graph corresponding to the data set.
Baseline models
In order to fully validate the prediction performance of MFSTAPFGCN, a fair comparison is made with the following eight representative traffic forecasting models.
FC-LSTM [46]: long short-term memory neural network, using forgetting gate, input gate, and output gate structures to process different state information separately, modeling the time series long time dependence.
DCRNN [33]: diffusion convolution recurrent neural network, using diffusion graph convolution to encode spatial information, using seq2seq to encode temporal information, and extending graph convolution to directed graphs.
STGCN [32]: spatial-temporal graph convolution network that captures the spatial and temporal correlation of the data using ChebNet and 2D convolutional networks, respectively.
ASTGCN [20]: spatial-temporal graph convolutional network based on attention mechanism using spatial attention mechanism to deal with dynamic spatial correlation and temporal attention mechanism to deal with dynamic temporal correlation, and weighted fusion of three independent components to model the multi-scale periodicity of traffic data.
Graph WaveNet [36]: Graph WaveNet uses an adaptive adjacency matrix to complement the hidden spatial dependencies in the learning data and combines graph convolution, null causal one-dimensional convolution to capture long-term temporal relationships at low cost.
STSGCN [17]: spatial-temporal synchronized graph convolutional network uses localized spatial-temporal subgraph modules to synchronously model localized spatial-temporal correlations in spatial-temporal networks.
STFGNN [35]: spatial-temporal fusion graph neural network introduces data-driven temporal graphs and models spatial correlation, non-neighborhood similarity, and temporal correlation in spatial-temporal networks by parallel stacking of spatial-temporal fusion layers and gated expansion convolutional fusion.
STFAGN [21]: combines fused convolutional layers with a new adaptive dependency matrix through end-to-end training to capture hidden spatial-temporal dependencies on the data to complete incomplete information.
Experimental results and analysis
The experiment uses 12 historical data samples to predict the future 15-min, 30-min, 45-min, 60-min traffic flow. Fig 9 shows the results of the visualization of the predicted, they are four randomly selected sections. The black color in the figure indicates the predicted traffic flow and the red color indicates the actual traffic flow. The prediction accuracy decreases in the road sections where the traffic flow changes in a complicated way, but the model can capture a similar trend when the traffic flow changes suddenly.
(a)Section a (b)Section b (c)Section c (d)Section d.
Table 2 shows the evaluation metrics for each model prediction result. Since the FC-LSTM model only considers temporal correlation and does not fully exploit the spatial correlation of traffic flow data, the prediction performance accuracy is much lower than other graph convolutional-based models with spatial correlation, which cannot meet the large-scale traffic flow prediction tasks. Graph WaveNet uses an adaptive adjacency matrix to complement the hidden spatial dependence in the learning data, because it cannot simultaneously superimpose on time and spatial, and therefore has the worst prediction performance among the graph convolutional neural network-based approaches. DCRNN, STGCN, and ASTGCN use separate components to deal with temporal and spatial correlations in traffic flow data separately, splitting the overall spatial-temporal correlations. STSGCN uses local spatial-temporal graphs to model spatial-temporal correlations, local heterogeneity simultaneously and has better prediction results. However, the spatial-temporal correlation and heterogeneity properties are not balanced, and the spatial-temporal graph weights are independent of each other, which leads to the high complexity of model operations, and the model will only learn local noise when data are lost, STFGNN introduces data-driven temporal graphs to capture potential spatial-temporal dependencies, constructs predefined static topological graphs with more complete connections, and adopts parallel stacked spatial-temporal fusion layers and gated expansion convolutional fusion to achieve spatial correlation, non-neighborhood similarity, and temporal correlation in spatial-temporal networks modeling, with high prediction accuracy. However, for different specifications of road network structures, setting up temporal maps with fixed sparsity based on experience, insufficient or unnecessary connections can limit the prediction performance of the model.
Based on STFGNN, STFAGN is designed for traffic prediction by combining fused convolutional layers with a new adaptive dependency matrix to handle the complex correlation, node heterogeneity of traffic flow data. In addition, STFAGN ignores the correlation and periodicity of each traffic state of the expressway. MFSTAPFGCN model, based on STFAGN, assigns different importance to the traffic state data of the road network at different moments with a multi-featured temporal attention mechanism, and models the daily periodicity similarity of the traffic flow data through splicing, dimensional expansion, and diffusion convolution operations. MFSTAPFGCN consistently and overwhelmingly outperforms all benchmark models in predicting traffic flow for the next 15 mins, improving the prediction accuracy by 6.7%, 9.3%, and 5%, respectively, over the accuracy-leading baseline model STFAGN.
The prediction accuracy of each model gradually decreases as the prediction time step increases, which indicates that long-term prediction of traffic flow is more difficult than short-term prediction. Among the STSGCN, STFGNN, STFAGN and MFSTAPFGCN models, STSGCN uses the local spatial-temporal graph mechanism to model the spatial-temporal correlation of traffic flow in short time synchronously, which overly emphasizes the local heterogeneous features and does not fully learn the global shared features in traffic flow, and does not fully deal with the long-term time dependence of traffic flow, and has the worst prediction results. STFGNN processes the potential non-proximity similarity in traffic flow data based on a data-driven time graph, and uses stacked gated diffusion convolution to model long-term time dependence, with slightly higher accuracy than STSGCN. STFAGN uses a fusion convolutional layer of adaptive dependency matrix to capture hidden spatial-temporal dependent traffic data, and the accuracy is slightly improved compared with STFGNN. In addition, STSGCN, STFGNN and STFAGN all ignore the correlation and periodicity of traffic states in expressways. The MFSTAPFGCN, which integrates the temporal correlation, spatial correlation, non-proximity correlation and periodic correlation of traffic flow data, is superior to other models in each evaluation index and each prediction time step.
Ablation experiments
To further explore the role of different mechanisms in the MFSTAPFGCN model architecture in the prediction, we conducted relevant Ablation Experiments in predicting the traffic flow in the next 15 mins. Table 3 shows the experimental results of different mechanisms.
- (1) STAPFGC: The multi-feature time attention mechanism is removed from the architecture of MFSTAPFGCN, and the other structures remain unchanged.
- (2) MFSTAFGCN: The period processing module is removed from the architecture of MFSTAPFGCN, and other structures remain unchanged.
- (3) MFSTPFGCN: The adaptive adjacency matrix is removed from the architecture of MFSTAPFGCN, and other structures remain unchanged.
We can draw the following conclusions from Fig 10. The multi-featured temporal attention mechanism can provide more information to assist model prediction in the temporal dimension. The period processing layer can capture the daily similarity of traffic flow data and improve the model prediction accuracy. The adaptive adjacency matrix can model the road network structure more adequately and analyze data correlation more comprehensively, which can balance the limitation of dealing with node heterogeneity and improve the model prediction accuracy.
Conclusion
In this paper, we propose an expressway traffic flow prediction model based on a multi-feature spatial-temporal adaptive periodic fusion graph convolutional network. In the temporal dimension, the relationship between different traffic variables at the same node in traffic forecasting is considered, and the dynamic temporal correlation between different times is captured using a multi-feature temporal attention mechanism. A spatial-temporal self-adaptive period fusion graph neural network is constructed using a period processing module, a spatial-temporal adaptive fusion graph module, and a gated convolution module, where the period processing module handles the period correlation and the learnable spatial-temporal fusion adjacency adaptively adjusts the spatial-temporal connections. The spatial-temporal adaptive fusion graph module is integrated with the gated convolution module to expand the reception on time series and stack them to comprehensively handle the spatial-temporal correlation of traffic flow data. The experiment results show that the model has some advantages in terms of mining features and prediction accuracy compared with existing models. The next research will collect data sets such as road function features, weather features, holidays, and social events to provide users with the most comprehensive information and form a complete intelligent traffic system, which is important for the subsequent development of smart expressways.
Supporting information
S1 File. ETC gantry transaction data.
Desktop_ Lane_ In.csv is the ETC Gantry transaction data.
https://doi.org/10.1371/journal.pone.0297296.s001
(CSV)
S2 File. Road network topology data.
t_etc_gantry.csv is the Road network topology data.
https://doi.org/10.1371/journal.pone.0297296.s002
(CSV)
References
- 1. Chen L, Ren Q, Zeng J, Zou F, Luo S, Tian J, et al. CSFPre: Expressway key sections based on CEEMDAN-STSGCN-FCM during the holidays for traffic flow prediction. Plos one. 2023;18(4):e0283898. pmid:37018350
- 2. Chen L, Shao W, Lv M, Chen W, Zhang Y, Yang C. AARGNN: An attentive attributed recurrent graph neural network for traffic flow prediction considering multiple dynamic factors. IEEE Transactions on Intelligent Transportation Systems. 2022;23(10):17201–17211.
- 3. Shin Y, Yoon Y. Incorporating dynamicity of transportation network with multi-weight traffic graph convolutional network for traffic forecasting. IEEE Transactions on Intelligent Transportation Systems. 2020;23(3):2082–2092.
- 4. Wen H, Zhang D, Siyuan L. Application of GA-LSTM model in highway traffic flow prediction. Journal of Harbin Institute of Technology. 2019;51(9):81–87.
- 5. Huang J, Luo K, Cao L, Wen Y, Zhong S. Learning Multiaspect Traffic Couplings by Multirelational Graph Attention Networks for Traffic Prediction. IEEE Transactions on Intelligent Transportation Systems. 2022;23(11):20681–20695.
- 6. Jia X, Zhou W, Yang H, Li S, Chen X. Short-term traffic travel time forecasting using ensemble approach based on long short-term memory networks. IET Intelligent Transport Systems. 2023;.
- 7.
Liu W, Zhao M. Highway travel speed prediction based on ETC toll data. In: Seventh International Conference on Electromechanical Control Technology and Transportation (ICECTT 2022). vol. 12302. SPIE; 2022. p. 763–769.
- 8.
Lin Z, Feng J, Lu Z, Li Y, Jin D. Deepstn+: Context-aware spatial-temporal neural network for crowd flow prediction in metropolis. In: Proceedings of the AAAI conference on artificial intelligence. vol. 33; 2019. p. 1020–1027.
- 9.
Siriborvornratanakul T. Pixel-level thin crack detection on road surface using convolutional neural network for severely imbalanced data. Computer-Aided Civil and Infrastructure Engineering. 2023;.
- 10. Siriborvornratanakul T. Human behavior in image-based Road Health Inspection Systems despite the emerging AutoML. Journal of Big Data. 2022;9(1):96. pmid:35879937
- 11. Sayeed A, Choi Y, Jung J, Lops Y, Eslami E, Salman AK. A deep convolutional neural network model for improving WRF simulations. IEEE Transactions on Neural Networks and Learning Systems. 2021;.
- 12. Zhuang W, Cao Y. Short-Term Traffic Flow Prediction Based on CNN-BILSTM with Multicomponent Information. Applied Sciences. 2022;12(17):8714.
- 13. Mehdi MZ, Kammoun HM, Benayed NG, Sellami D, Masmoudi AD. Entropy-based traffic flow labeling for CNN-based traffic congestion prediction from meta-parameters. IEEE Access. 2022;10:16123–16133.
- 14. Pholsena K, Pan L, Zheng Z. Mode decomposition based deep learning model for multi-section traffic prediction. World Wide Web. 2020;23:2513–2527.
- 15. Ma C, Zhao Y, Dai G, Xu X, Wong SC. A novel STFSA-CNN-GRU hybrid model for short-term traffic speed prediction. IEEE Transactions on Intelligent Transportation Systems. 2022;.
- 16. Wang H, Zhang R, Cheng X, Yang L. Hierarchical traffic flow prediction based on spatial-temporal graph convolutional network. IEEE Transactions on Intelligent Transportation Systems. 2022;23(9):16137–16147.
- 17.
Song C, Lin Y, Guo S, Wan H. Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting. In: Proceedings of the AAAI conference on artificial intelligence. vol. 34; 2020. p. 914–921.
- 18. Zhu J, Han X, Deng H, Tao C, Zhao L, Wang P, et al. KST-GCN: A knowledge-driven spatial-temporal graph convolutional network for traffic forecasting. IEEE Transactions on Intelligent Transportation Systems. 2022;23(9):15055–15065.
- 19. Zhao L, Song Y, Zhang C, Liu Y, Wang P, Lin T, et al. T-gcn: A temporal graph convolutional network for traffic prediction. IEEE transactions on intelligent transportation systems. 2019;21(9):3848–3858.
- 20.
Guo S, Lin Y, Feng N, Song C, Wan H. Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In: Proceedings of the AAAI conference on artificial intelligence. vol. 33; 2019. p. 922–929.
- 21. Yang S, Li H, Luo Y, Li J, Song Y, Zhou T. Spatiotemporal adaptive fusion graph network for short-term traffic flow forecasting. Mathematics. 2022;10(9):1594.
- 22. Emami A, Sarvi M, Bagloee SA. Short-term traffic flow prediction based on faded memory Kalman Filter fusing data from connected vehicles and Bluetooth sensors. Simulation Modelling Practice and Theory. 2020;102:102025.
- 23. Xu Dw, Wang Yd, Jia Lm, Qin Y, Dong Hh. Real-time road traffic state prediction based on ARIMA and Kalman filter. Frontiers of Information Technology & Electronic Engineering. 2017;18:287–302.
- 24. Evans J, Waterson B, Hamilton A. Forecasting road traffic conditions using a context-based random forest algorithm. Transportation planning and technology. 2019;42(6):554–572.
- 25. Lv Z, Wang X, Cheng Z, Li J, Li H, Xu Z. A new approach to COVID-19 data mining: A deep spatial–temporal prediction model based on tree structure for traffic revitalization index. Data & Knowledge Engineering. 2023;146:102193. pmid:37251597
- 26. Li J, Lv Z, Ma Z, Wang X, Xu Z. Optimization of Spatial-temporal Graph: A Taxi Demand Forecasting Model Based on Spatial-Temporal Tree. Information Fusion. 2023;p. 102178.
- 27. Lv Z, Cheng Z, Li J, Xu Z, Yang Z. TreeCN: Time Series Prediction With the Tree Convolutional Network for Traffic Prediction. IEEE Transactions on Intelligent Transportation Systems. 2023;.
- 28.
Li Y, Vinyals O, Dyer C, Pascanu R, Battaglia P. Learning deep generative models of graphs. arXiv preprint arXiv:180303324. 2018;.
- 29.
Chen ZM, Wei XS, Wang P, Guo Y. Multi-label image recognition with graph convolutional networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; 2019. p. 5177–5186.
- 30.
Guo Z, Zhang Y, Lu W. Attention guided graph convolutional networks for relation extraction. arXiv preprint arXiv:190607510. 2019;.
- 31. Kong X, Wang K, Hou M, Xia F, Karmakar G, Li J. Exploring human mobility for multi-pattern passenger prediction: A graph learning framework. IEEE Transactions on Intelligent Transportation Systems. 2022;23(9):16148–16160.
- 32.
Yu B, Yin H, Zhu Z. Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. arXiv preprint arXiv:170904875. 2017;.
- 33.
Huang Y, Weng Y, Yu S, Chen X. Diffusion convolutional recurrent neural network with rank influence learning for traffic forecasting. In: 2019 18th IEEE International conference on trust, security and privacy in computing and communications/13th IEEE International conference on big data science and engineering (TrustCom/BigDataSE). IEEE; 2019. p. 678–685.
- 34.
Wang X, Ma Y, Wang Y, Jin W, Wang X, Tang J, et al. Traffic flow prediction via spatial temporal graph neural network. In: Proceedings of the web conference 2020; 2020. p. 1082–1092.
- 35.
Li M, Zhu Z. Spatial-temporal fusion graph neural networks for traffic flow forecasting. In: Proceedings of the AAAI conference on artificial intelligence. vol. 35; 2021. p. 4189–4196.
- 36.
Wu Z, Pan S, Long G, Jiang J, Zhang C. Graph wavenet for deep spatial-temporal graph modeling. arXiv preprint arXiv:190600121. 2019;.
- 37.
Diao Z, Wang X, Zhang D, Liu Y, Xie K, He S. Dynamic spatial-temporal graph convolutional neural networks for traffic forecasting. In: Proceedings of the AAAI conference on artificial intelligence. vol. 33; 2019. p. 890–897.
- 38.
Zhang Q, Chang J, Meng G, Xiang S, Pan C. Spatio-temporal graph structure learning for traffic forecasting. In: Proceedings of the AAAI conference on artificial intelligence. vol. 34; 2020. p. 1177–1185.
- 39.
Wu Z, Pan S, Long G, Jiang J, Chang X, Zhang C. Connecting the dots: Multivariate time series forecasting with graph neural networks. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining; 2020. p. 753–763.
- 40. Guo K, Hu Y, Qian Z, Sun Y, Gao J, Yin B. Dynamic graph convolution network for traffic forecasting based on latent network of Laplace matrix estimation. IEEE Transactions on Intelligent Transportation Systems. 2020;23(2):1009–1018.
- 41. Bai L, Yao L, Li C, Wang X, Wang C. Adaptive graph convolutional recurrent network for traffic forecasting. Advances in neural information processing systems. 2020;33:17804–17815.
- 42. Zou F, Ren Q, Tian J, Guo F, Huang S, Liao L, et al. Expressway speed prediction based on electronic toll collection data. Electronics. 2022;11(10):1613.
- 43.
Mueen A, Keogh E. Extracting optimal performance from dynamic time warping. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining; 2016. p. 2129–2130.
- 44.
Bachlechner T, Majumder BP, Mao H, Cottrell G, McAuley J. Rezero is all you need: Fast convergence at large depth. In: Uncertainty in Artificial Intelligence. PMLR; 2021. p. 1352–1361.
- 45.
Targ S, Almeida D, Lyman K. Resnet in resnet: Generalizing residual architectures. arXiv preprint arXiv:160308029. 2016;.
- 46. Bellec G, Salaj D, Subramoney A, Legenstein R, Maass W. Long short-term memory and learning-to-learn in networks of spiking neurons. Advances in neural information processing systems. 2018;31.