Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Open Access

Peer-reviewed

Research Article

Design deep neural network architecture using a genetic algorithm for estimation of pile bearing capacity

Abstract

Determination of pile bearing capacity is essential in pile foundation design. This study focused on the use of evolutionary algorithms to optimize Deep Learning Neural Network (DLNN) algorithm to predict the bearing capacity of driven pile. For this purpose, a Genetic Algorithm (GA) was developed to select the most significant features in the raw dataset. After that, a GA-DLNN hybrid model was developed to select optimal parameters for the DLNN model, including: network algorithm, activation function for hidden neurons, number of hidden layers, and the number of neurons in each hidden layer. A database containing 472 driven pile static load test reports was used. The dataset was divided into three parts, namely the training set (60%), validation (20%) and testing set (20%) for the construction, validation and testing phases of the proposed model, respectively. Various quality assessment criteria, namely the coefficient of determination (R2), Index of Agreement (IA), mean absolute error (MAE) and root mean squared error (RMSE), were used to evaluate the performance of the machine learning (ML) algorithms. The GA-DLNN hybrid model was shown to exhibit the ability to find the most optimal set of parameters for the prediction process.The results showed that the performance of the hybrid model using only the most critical features gave the highest accuracy, compared with those obtained by the hybrid model using all input variables.

Citation: Pham TA, Tran VQ, Vu H-LT, Ly H-B (2020) Design deep neural network architecture using a genetic algorithm for estimation of pile bearing capacity. PLoS ONE 15(12): e0243030. https://doi.org/10.1371/journal.pone.0243030

Editor: Le Hoang Son, Vietnam National University, VIET NAM

Received: August 22, 2020; Accepted: November 16, 2020; Published: December 17, 2020

Copyright: © 2020 Pham et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the paper and supporting information files.

Funding: The authors received no specific funding for this work.

Competing interests: The authors have declared that no competing interests exist.

1. Introduction

In pile foundation design, the axial pile bearing capacity (Pu) is considered one of the most critical parameters [1]. Throughout years of research and development, five main approaches to determine the pile bearing capacity have been adopted, namely the static analysis, dynamic analysis, dynamic testing, pile load testing, and in-situ testing [2]. It is needless to say each of the above methods possesses advantages and disadvantages. However, the pile load test is considered as one of the best methods to determine the pile bearing capacity in view of the fact that the testing process is close to the working mechanism of driven piles [3]. Having said that, this method remains time-consuming and unaffordable for small projects [3], the development of a more feasible approach is vital. Thus, many studies have been conducted to determine the pile bearing capacity in taking advantage of the in-situ test results [4]. Meanwhile, the European standard (Euro code 7) [5] recommends using several ground field tests such as the dynamic probing test (DP), press-in and screw-on probe test (SS), standard penetration test (SPT), pressuremeter tests (PMT), plate loading test (PLT), flat dilatometer test (DMT), field vane test (FVT), cone penetration tests with the measurement of pore pressure (CPTu). Among the above approaches, the SPT is commonly used to determine the bearing capacity of piles [6].

Many contributions in the literature relying on the SPT results have been suggested to predict the bearing capacity of piles. As examples, Meyerhof [7], Bazaraa and Kurkur [8], Robert [9], Shioi and Fukui [10], Shariatmadari et al. [11] have proposed several empirical formulations for determining the bearing capacity of piles in sandy ground. Besides, Lopes and Laprovitera [12], Decort [13], the Architectural Institute of Japan (AIJ) [14] have introduced several formulations to determine the pile bearing capacity for various types of soil, including sandy and clayed ground. Overall, traditional methods have used several main parameters to estimate the mechanical properties of piles, such as pile diameter, pile length, soil type, number of SPT blow counts of each soil layer. However, the choice of appropriate parameters, along with the failure in covering other parameters, have led to the disagreement of results given by these methods [15]. Therefore, the development of an universal approach for the selection of a suitable set of parameters is imperative.

Over a half-decade, a newly developed approach using machine learning (ML) algorithms has been widely used to deal with real-world problems [16], especially in civil engineering applications. Employing ML algorithms, many practical problems have been successfully addressed and thus, paved the way for many promising opportunities in the construction industry [17–26]. Moreover, miscellaneous ML algorithms have been developed, for instance, decision tree [22], hybrid artificial intelligence approaches [27–29], artificial neural network (ANN) [30–35], adaptive neuro-fuzzy inference system (ANFIS) [36,37] and support vector machine (SVM) [16], for analyzing technical problems, including the prediction of pile mechanical behavior.

It is worth noticing that the development of the artificial neural network (ANN) algorithm has gained intense attention to treat design issues in pile foundation. For example, Goh et al. [38,39] have presented an ANN model to predict the friction capacity of driven piles in clays, in which the algorithm was trained by on-field data records. Besides, Shahin et al. [40–43] have used an ANN model to predict the driven piles loading capacity and drilled shafts using a dataset containing in-situ load tests along with CTP results. Moreover, Nawari et al. [44] have presented an ANN algorithm to predict the settlement of drilled shafts based on SPT data and shaft geometry. Momeni et al. [45] have developed an ANN model to predict the axial bearing capacity of concrete piles using Pile Driving Analyzer (PDA) from project sites. Last but not least, Pham et al.[15] have also developed an ANN algorithm and Random Forest (RF) to estimate the axial bearing capacity of driven pile. Regarding other ML models, Support Vector Machine Regression (SVR) and “nature inspired” meta-heuristic algorithm, namely Particle Swarm Optimization (PSO-SVR) [46] have bene used to predict the soil shear strength. Furthermore, Pham et al. [47] have presented a hybrid ML model combining RF and PSO (PSO-RF) to predict the undrained shear strength of soil. Also, Momeni et al. [48] have developed an ANN-based predictive model optimized with Genetic Algorithm (GA) technique to choose the best weights and biases of ANN model in predicting the bearing capacity of piles. In addition, Hossain et al. [49] used GA to optimize parameters of three hidden layers deep belief neural network (DBNN), include number of epochs, number of hidden units and learning rates in the hidden layers. It is interesting to notice that all the studies have confirmed the effectiveness when implementing the hybrid ML models as a practical and efficient tool in solving geotechnical problems, and particularly the axial bearing capacity of pile. Despite the recent successes of machine learning, this method has some limitations to keep in mind: It requires large amounts of of hand-crafted, structured training data and cannot be learned in real time. In addition, ML models still lack the ability to generalize conditions other than those encountered during the training. Therefore, the ML model only correctly predicts in a certain data range but is not generalized in all cases.

With a particular interest in a recently developed Deep Learning Neural Network (DLNN), which has gained tremendous success in many areas of application [50–54], the main objective of this study is dedicated to the development of a novel hybrid ML algorithm using DLNN and GA to predict the axial load capacity of driven piles. For this aim, a dataset consisting of 472 pile load test reports from the construction sites of Ha Nam—Vietnam was gathered. The database was then divided into the training, validation, and testing subsets, relating to the learning, validation and phases of the ML models. Next, a novel ML algorithm using GA-DLNN hybrid model was developed. ML model using GA is used to select the most important input variables to create a new smaller dataset due to the reason that many unimportant input variables could reduce the accuracy of output forecasting. Next, a GA-DLNN hybrid model was used to optimize the parameters of the DLNN model. The optimal architecture of DLNN is used to test with the new dataset and compare with the full-size case of input variables. Besides, DLNN model can be optimized to better estimate axial load capacity of pile, including number of hidden layers, number of neurons in each hidden layer, activation function for hidden layers and training algorithm. Various error criteria, especially, the mean absolute error (MAE), root mean squared error (RMSE), the coefficient of determination (R2) and Index of Agreement (IA)—were applied to evaluate the prediction capability of the algorithms. In addition, 1000 simulations relating to the random shuffling of dataset were conducted for each model in order to evaluate the accuracy of final DLNN model precisely.

2. Significance of the research study

The numerical or experimental methods in the existing literature still have some limitations, such as lack of data set samples (Marto et al.[55] with 40 samples; Momeni et al. [45] with 36 samples; Momeni et al.[56] with 150 samples; Bagińska and Srokosz [57] with 50 samples; Teh et al. [58] with 37 samples), refinement of ML approaches or failure to fully consider key parameters which affects the predicting results of the model.

For this, the contribution of the present work can be marked through the following ideas: (i) large data set, including 472 experimental tests; (ii) reduce the input variables from 10 to 4 which help the model achieve more accurate results with faster training time, (iii) automatically design the optimal architecture for the DLNN model, all key parameters are considered, include: the number of hidden layers, the number of neurons in each hidden layer, the activation function and the training algorithm. In which, the number of hidden layers is not fixed but can be selected through cross-mating between the parent with different chromosome length. Besides, the randomness in the order of the training data set is also considered to assess the stability of predicting result of models with the training, validate and testing set.

3. Data collection and preparation

3.1. Experimental measurement of bearing capacity

The experimental database used in this study was derived from pile load test results conducted on 472 reinforced concrete piles at the test site in Ha Nam province–Vietnam (Fig 1A). In order to obtain the measurements, pre-cast square-section piles with closed tips were driven to the ground by hydraulic pile presses machine with a constant rate of penetration. The tests started at least 7 days after the piles had been driven, and the experimental layout is depicted in Fig 1B. It can be seen that the load increased gradually in each pile test. Depending on the design requirements, the load could be varied up to 200% of the pile load design. The time required to reach 100%, 150%, and 200% of the load could last for about 6 h to 12 h or 24 h, respectively. The bearing capacity of piles was determined following these two principles: (i) when the settlement of pile top at the current load level was 5 times or higher than the settlement of pile top at the previous load level, the pile bearing capacity was taken as the given failure load; (ii) when the load—settlement curve was nearly linear at the last load level, condition (i) could not be used. In this case, the pile bearing capacity was approximated as the load level when the settlement of the pile top exceeded 10% of the pile diameter.

thumbnail
Download:
Fig 1.

(a) Experimental location(*); (b) experimental layout. (*): Source: CIA Maps.

https://doi.org/10.1371/journal.pone.0243030.g001

3.2. Data preparation

The primary goal of the development of ML algorithms is to estimate the axial bearing capacity of the pile accurately. Therefore, as a first attempt, all the known factors affecting the pile bearing capacity were considered. Besides, it was found that most traditional approaches have used three groups of parameters: the pile geometry, pile constituent material properties, and soil properties [7–14]. It is worth noticing that the depth of the water table was not considered since it is shown that this effect have already been accounted in SPT blow counts [59]. The bearing capacity of piles was predicted based on the soil properties, determined through SPT blow counts (N) along the embedded length of the pile. In this study, the average number of SPT blows along the pile shaft (Nsh), and tip (Nt) was used. In addition, according to Meyerhof's recommendation (1976) [7], the average SPT (Nt) value for 8D above and 3D below the pile tip was also utilized, where D represented the pile diameter.

Consequently, the input variables in this work were: (1) pile diameter (D); (2) thickness of first soil layer that pile embedded (Z1); (3) thickness of second soil layer that pile embedded (Z2); (4) thickness of third soil layer that pile embedded (Z3); (5) elevation of the natural ground (Zg); (6) elevation of pile top (Zp); (7) elevation of extra segment pile top (Zt); (8) deepness of pile tip (Zm); (9) the average SPT blow count along the pile shaft (Nsh) and (10) the average SPT blow count at the pile tip (Nt). The axial pile bearing capacity was considered as the single output (Pu). For illustration purposes, a diagram for soil stratigraphy and input, output parameters are depicted in Fig 2.

thumbnail
Download:
Fig 2. Diagram for stratigraphy and pile parameters.

https://doi.org/10.1371/journal.pone.0243030.g002

The dataset containing 472 samples is statistically introduced and summarized in Table 1, including several pile tests, min, max, average and standard deviation of the input and output variables. As showed in Table 1, the pile diameter (D) ranged from 300 to 400 mm. The thickness of the first soil layer that pile embedded (Z1) ranged from 3.4 m to 5.7 m. The thickness of the second soil layer that pile embedded (Z2) varied from 1.5 m to 8 m. The thickness of the third soil layer that pile embedded (Z3) ranged from 0 m to 1.7 m, where a value of 0 means that the pile was not embedded in this layer. Besides, the elevation of pile top (Zp) varied from 0.7 m to 3.4 m. The elevation of natural ground (Zg) ranged from 3.0 m to 4.1 m. The elevation of extra segment pile top (Zt) varied from 1.0 m to 7.1 m. The deepness of pile tip (Zm) ranged from 8.3 m to 16.1 m. The average SPT blow count along the pile shaft (Nsh) ranged from 5.6 to 15.4. The average SPT blow count at the pile tip (Nt) ranged from 4.4 to 7.8. The axial bearing capacity load of pile (Pu), ranged from 407.2 kN to 1551 kN with a mean value of 955.3 kN, and a standard deviation of 355.4 kN. Besides, the histograms of all the input and output variables are shown in Fig 3. An example of 100 data samples is given in the appendix (S1 Appendix).

thumbnail
Download:
Fig 3. Histograms of the variables used in this study.

https://doi.org/10.1371/journal.pone.0243030.g003

thumbnail
Download:
Table 1. Inputs and output of the present study.

https://doi.org/10.1371/journal.pone.0243030.t001

In this study, the collected dataset was divided into the training, validation, and testing datasets. The training part (60% of the total data) was used to train the ML models. The validation part (20% of the total data) was used to give an estimate of model skill and tuning model’s hyperparameters whereas testing data (20% of the remaining data), which was unknown during the training and validation phases, was used to validate the performance of the ML models.

4. Machine learning methods

4.1. Deep learning neural network (DLNN) with multi-layer perceptron

The multi-layer perceptron (MLP) is a kind of feedforward artificial neural network [60]. In general, the MLP includes at least three units, called the layers: the input layer, the hidden layer, and the output layer. When the hidden layer consists of more than two layers, the multi-layer perceptron could be called Deep learning neural network (DLNN) [61,62]. In DLNN, each node in a layer is associated with a certain weight, denoted as wij, with every node in the other layers creating a fully linked neural system [63]. Except for the input layer, each node is a neuron that uses a non-linear activation function [64]. Besides, MLP uses a supervised learning technique called backpropagation for the training process [64]. Thanks to its multi-layer, non-linear activation functions, DLNN could distinguish non-linear separable data. Fig 4 shows the DLNN architecture used in this investigation consisting of 10 inputs, three hidden layer and one output variable

thumbnail
Download:
Fig 4. Illustration of the DLNN used in this study, including 10 inputs, three hidden layers, and one output variable.

https://doi.org/10.1371/journal.pone.0243030.g004

A multi-layer perceptron having a linear activation function associated with all neurons represents a linear function network that links the weighted inputs to the output. Using linear algebra, it has been proved that such a network, with any number of layers, can be reduced to a two-layer input-output model. Therefore, the development of the DLNN network using non-linear activation functions is crucial to enhance the accuracy of the model, and better mimic the working mechanism of biological neurons. The use of sigmoid functions is commonly adopted in DLNN network, with two conventional activation functions as below: (1) The first one represents a hyperbolic tangent, ranges from -1 to 1, whereas the second one is a logistic function with similar shape but ranges from 0 to 1. In these functions, y(vi) represents the output of the ith node, and vi is the total weight of the input connection. Besides, alternative activation functions, such as the rectifier, or more specialized function, namely radial basis functions, are also proposed.

In function of the errors of the output compared with the target, the connection weights and biases are adjusted, making the learning process occurs. This could be considered as an example of the supervised learning process using the least-squares average algorithm, which is generalized as a backpropagation algorithm. Precisely, an error in the output node j in the nth data point is given by: (2) where d refers to the target value, y denotes the value generated by the perceptron system. The following expression relies on error correction to minimize errors of the predicted output to determine the node weights: (3) Furthermore, the following expression uses the gradient descent algorithm to calculate the change, or the correction, for each weight: (4) where yi denotes the output of the previous neuron, refers to the learning rate. These parameters are chosen to ensure that the error quickly converges without oscillation. Besides, the derivative is calculated based on the local field induced vj, which can be expressed as: (5) where ϕ′ is the derivative of the activation function. With the change in weight associated with a hidden node, the relevant derivative can be shown as: (6) This function depends on the weight changes of nodes representing the kth output layer. This algorithm reflects the inverse backpropagation process, as the output weights change according to the activation function derivative, then the weights of the hidden layer change accordingly.

4.2. Genetic Algorithm (GA)

Holland was the first researcher who proposed a genetic algorithm (GA), a stochastic search algorithm, and optimization technique [65]. Later, GA has been investigated by other scientists, especially Deb et al. [66], Houck et al. [67]. Generally, GA is considered a simple solution for complex non-linear problems [68]. The basis of the method lies in the process of mating, breeding in an initial population, along with several activities such as selection, cross-exchange, and mutation, which help to create new, more optimal individuals [69]. In GA algorithm, the population size is an important factor reflecting the total number of solutions and significantly affects the results of the problem [70], whereas the so-called “generations” refers to the iterations of the optimization process. This process could be conditioned by several selected stopping criteria [71].

Practically, GA method has shown many benefits in finding an optimal resource set to optimize both cost and production [69]. In the field of construction, especially when evaluating the load capacity of piles, many studies have successfully and efficiently used GA method. As an example, Ardalan et al. [72] have used GA algorithm combined with neural network to predict driven piles unit shaft resistance from pile loading tests. In another study, 50 PDA (Pile Driving Analyzer) restriction tests were conducted on pre-cast concrete piles to predict the pile bearing capacity. The proposed hybrid method has provided excellent results with R2 of 0.99 [71]. Moreover, other studies on the behavior of piles in soil using the GA method whose effectiveness has been clearly proven [68,70,72–74].

In this work, taking advantage of the GA algorithm, such an optimization technique was used to optimize DLNN to predict the bearing capacity of driven pile. The pseudo algorithm is summarized below (Table 2):

thumbnail
Download:
Table 2. Pseudo algorithm of the GA algorithm used in this study.

https://doi.org/10.1371/journal.pone.0243030.t002

4.3. Features selection with GA

It is well-known that the training process with DLNN is a time-consuming and costly method due to the use of computer resource procession [75,76]. In addition, some features in the dataset might affect the regression results, as well as unnecessary features might generate noises and reduce prediction accuracy [77]. The selection of appropriate features requires considerable effort, for instance, sum of combinations C(10,i) for i from 1 to 10 could be generated with a dataset containing 10. In order to facilitate the feature selection process, the GA algorithm was used to choose the appropriate features within the dataset, expecting that fewer input variables could enhance the prediction accuracy of GA-DLNN. The detailed process of the selection mechanism is summarized in the following parts.

Firstly, genes inside the chromosome should be selected. In this study, each feature affecting the pile bearing capacity is considered as a gene. As a result, the length of the chromosome is 10, corresponding to 10 features, or 10 genes (Fig 5).

thumbnail
Download:
Fig 5. Representation chromosome of features selection.

https://doi.org/10.1371/journal.pone.0243030.g005

Considering the chromosome, each gene is associated with a unique value, i.e., 1 when it is selected or 0 in the other case [78]. Next, to create the population, original chromosomes are randomly selected [78]. After that, several parents were chosen for mating to create offspring chromosomes based on their fitness value associated with each solution (i.e., chromosome). The fitness value is calculated using a fitness function. The support vector regression (SVR) is chosen as the fitness function for this investigation. In the next step, the regression model is trained with the training dataset, and evaluated on the validation (or testing) dataset. In this study, the mean absolute error (MAE) cost function was used to evaluate the accuracy of the fitness function. The lower the fitness value shows a better solution. Based on the fitness function, the “parents” are filtered from the current population. The nature of GA lies in the hypothesis that mating two good solutions could produce the best solution [79]. Children born to parents can randomly choose their parents' genes. Mutations are then applied to make new genes in the next generation.

4.4. Evolution of DLNN parameters using GA and parameters tuning process

It is universally challenging to find out an optimal neural network architecture. A broad and continuous discussion of this problematic work has been the subject of intense researches. To date, no universal rules are given to define the proper number of hidden layers, neurons in each hidden layer, or functions that connecting the neurons. Considering that in the DLNN algorithm, various possibilities could be assembled to build the final network structure, the selection process becomes unachievable. To overcome this problem, the GA could be used to find the best DLNN architecture in an automatic manner. The mechanism of GA could be summarized as the following.

Firstly, the genes inside the chromosome are determined. Four parameters to be investigated are selected, including (i) the network optimizer algorithm, (ii) the activation function of the hidden layers, (iii) the number of hidden layers, and (iv) the number neurons in each hidden layer. As the number of neurons in each hidden layer is different, more genes are required. Each gene contains data representing the number of neurons in each hidden layer. Considering the maximum number of hidden layers is P2, then the maximum length of the chromosome is L = (3 + P2). In particular, the first three genes refer to the first three parameters of the model, previously presented. It is worth noticing that in this case, each chromosome has a different length, depending on the corresponding number of hidden layers. Hence, the parameters used for the DLNN architecture could be depicted in Fig 6, such as network optimizer algorithm (P0), the activation function of hidden layers (P1), the number of hidden layers (P2), and the number neurons in each hidden layer (P3…PL).

thumbnail
Download:
Fig 6. Chromosome representation of the parameters selection process.

https://doi.org/10.1371/journal.pone.0243030.g006

The considered fitness function is DLNN model, along with four cost functions to evaluate the performance, namely R2, IA, MAE, and RMSE. Detailed descriptions of these criteria are given in the next section. Given that the length of the chromosome might be different, the mating progress occurs under the following principles:

  1. If the length of the parents' chromosomes is similar, the child will randomly select the number of hidden layers and the number of neurons from father or mother.
  2. If the length of the parents' chromosomes is different, two cases could be considered in this case. In the first case, supposing the child chooses the number of hidden layers from a person with fewer genes, the selection will be random from the parents. In the second case, a child chooses to take the number of hidden layers from a parent that has more genes. The only option is to select the missing gene from a person with a higher chromosome length, and other genes are taken randomly from their parents. The mating process is highlighted in Fig 7.
thumbnail
Download:
Fig 7. The mating process with different chromosomes length.

https://doi.org/10.1371/journal.pone.0243030.g007

During the mutation process, few children are selected. Besides, a random gene is selected and replaced with another random value within a given range. Particularly, since the DLNN model has many parameters, the mutation rate is set at 50% of the number of children born in order to maximize the chance to find the best genes. Finally, the parameters of DLNN were finely tuned by GA through population generations to find out the best prediction performance. Table 3 summarizes the tuned parameters and their tuning ranges and options.

thumbnail
Download:
Table 3. Parameters of DLNN and their tuning ranges/options to be optimized by GA.

https://doi.org/10.1371/journal.pone.0243030.t003

4.5. Performance evaluation

In order to verify the effectiveness and performance of the ML algorithms, four different criteria were selected in this study, namely, root mean square error (RMSE), mean absolute error (MAE), the coefficient of determination (R2), and Willmott’s index of agreement (IA). The criterion RMSE is the mean squared difference between the predicted outputs and targets, whereas MAE is the mean magnitude of the errors. The similarity between the two error criteria RMSE and MAE is that the closer these errors' criterion values to 0, the better performance of the model. The criterion R2 is the correlation between targets and outputs [80]. The accuracy of the model is superior in the cases of small values of RMSE and MAE. The values of R2 are in the range of [−∞÷1], where higher accuracy is obtained when the values are close to 1. The Index of Agreement (IA) was presented by Willmott [81,82]. The IA points out the ratio of the mean square error and the potential error. Similar to R2, the values of IA vary between −∞ and 1, in which 1 indicates a perfect correlation, and negative value indicates no agreement. These coefficients can be calculated using the following formulas [83,84]: (7) (8) (9) (10) Where k inferred the number of the samples, vi and were the actual and predicted outputs, respectively, and was the average value of the vi.

5. Results and discussion

5.1. Feature selection

The results of the feature selection process using the GA model is presented in this section. The initialization parameters of GA used in this study are given in Table 4. Fig 8 illustrates the evolution of MAE values using GA after 200 generations. It can be seen that the MAE value was progressively decreased with the generation of GA. The lowest MAE was 116.91 (kN) at the first generation and decreased to 95.54 (kN) at the 87th generation. This value was unchanged from the 87th to the 200th generation. The optimum representation chromosome of feature selection were [0, 1, 1, 0, 0, 1, 0, 0, 0, 1]. This result suggested a new dataset, more compact, corresponded to [Z1, Z2, Zg, Nt]. Therefore, the number of input variables for a compact dataset included 4 variables. As a result, the input space was reduced by 6 variables compared to the original dataset.

thumbnail
Download:
Fig 8. Features selection using the GA model.

https://doi.org/10.1371/journal.pone.0243030.g008

thumbnail
Download:
Table 4. GA feature selection initialization parameters.

https://doi.org/10.1371/journal.pone.0243030.t004

5.2. Optimization of DLNN architecture

The evolutionary results in predicting the pile bearing capacity of GA-DLNN model are evaluated in this section. The initialization parameters of GA-DLNN used in this study are given in Table 5. Fig 9 illustrates the evolution of the GA-DLNN model through 200 generations with 4 and 10 input variables. A summary of the best predictability of the models is presented in Table 6. For the sake of conparison and highlight the performance of the reduced input space, three different scenarios were performed. The first one used the 4-input space and simulated with GA-DLNN, denoted as 4-input GA-DLNN model. The second one contained the initial input space and performed with GA-DLNN, denoted as the 10-input GA-DLNN model. The last scenario referred to the case using 4 input variables but using DLNN as a predictor, denoted as 4-input DLNN model.

thumbnail
Download:
Fig 9. Parameters tuning using the model using the GA-DLNN model with 4 and 10 inputs.

https://doi.org/10.1371/journal.pone.0243030.g009

thumbnail
Download:
Table 5. GA-DLNN initialization parameters.

https://doi.org/10.1371/journal.pone.0243030.t005

thumbnail
Download:
Table 6. Summary of best prediction capability of models.

https://doi.org/10.1371/journal.pone.0243030.t006

It can be seen that the 4-input GA-DLNN model performed better accuracy, the best generation yielded correlation of R2 = 0.923, MAE = 75.927, RMSE = 95.118 and IA = 0.981. Compared to the first generation, the 4-input DLNN model produce accurate intermediate precision (R2 = 0.858, MAE = 90.785, RMSE = 123.788 and IA = 0.967).

The results also show that the 4-input GA-DLNN model gives slightly better performance than the 10-input GA-DLNN model. The GA-DLNN model with 10 variables predicts correlation results at most efficient generation as follows: R2 = 0.918, MAE = 75.838, RMSE = 97.092 and IA = 0.980. The analysis time cost through 200 generations of the 4-input model is much lower than the 10-input model with the normalized time of the two models, respectively: 0.7 and 1.0.

The optimum parameters of models are shown in Table 7. It shows that all three models choose the same network optimization algorithm (Quasi-Newton), the number of hidden layers range from 2 to 4 and the number of neurons in each hidden layer is relatively complex, ranging from 9 to 80. However, each model chooses a different type of activation function.

thumbnail
Download:
Table 7. The optimum parameter of models.

https://doi.org/10.1371/journal.pone.0243030.t007

5.3. Predictive capability of the models

Fig 10 shows a visual comparison of test results and predictions based on Pu from a representative ML model. The performance of ML models has been tested on all three datasets: training, validation and testing. In this case, two representative DLNN models were selected based on the best performance through the model evolution (Fig 9), corresponding to input variables 4 and 10. One 4-input DLNN model which has the best fitness value in the first generation, was chosen to compare with the two optimal models to prove the effectiveness of model evolution. The predictive capability of the models is also summarized in Table 8.

thumbnail
Download:
Fig 10.

Measured and predicted values of axial bearing capacity of pile using the models: 4-input GA-DLNN model for training (a), validation (b), testing dataset (c); 10-input GA-DLNN model for training (d), validation (e), testing dataset (f); 4-input DLNN model for training (g), validation (h), testing dataset (i).

https://doi.org/10.1371/journal.pone.0243030.g010

thumbnail
Download:
Table 8. Predictive capability of the models.

https://doi.org/10.1371/journal.pone.0243030.t008

From a statistical standpoint, the performance of ML algorithms should be fully evaluated. As mentioned during the simulation, 60% of the test data was randomly selected to train ML models. The performance of such a model can be affected by the selection order of the training data set. Therefore, a total of 1000 simulations were performed next, taking into account the random splitting effect in the dataset. The result is shown in Fig 11 and Tables 9–12. It can be seen that the performance of the 4-input GA-DLNN model was improved after tuning the parameters of the DLNN model and outperformed the best model in the first generation (4-input DLNN). On training set, R2 value has increased from 0.919 to 0.932. The result can be also observed on the validation set, in which the R2 value is increased (from 0.884 to 0.898). The most difference can be seen in the testing set in which R2 increased from 0.777 to 0.882. Compared to the 10-input GA-DLNN model, the R2 value is similar in training and validation, the big difference only appears in the test data set, whereas R2 value of the 4-input GA-DLNN model gives better results (R2 = 0.882) compared to 10-input GA-DLNN models (R2 = 0.8). On testing set, SD value of 4-input GA-DLNN model is smallest (SD = 0.008) compare to 10-input GA-DLNN and 4-input DLNN model (SD = 0.0351, 0.0718, respectively), indicating more stable 4-input GA-DLNN modelling.

thumbnail
Download:
Fig 11. Predictive capability of the models with 1000 simulations.

https://doi.org/10.1371/journal.pone.0243030.g011

thumbnail
Download:
Table 9. Summary of the 1000 simulations using R2 criteria.

https://doi.org/10.1371/journal.pone.0243030.t009

thumbnail
Download:
Table 10. Summary of the 1000 simulations using IA criteria.

https://doi.org/10.1371/journal.pone.0243030.t010

thumbnail
Download:
Table 11. Summary of the 1000 simulations using RMSE criteria.

https://doi.org/10.1371/journal.pone.0243030.t011

thumbnail
Download:
Table 12. Summary of the 1000 simulations using MAE criteria.

https://doi.org/10.1371/journal.pone.0243030.t012

Table 13 presents some research results on ML applications in foundation engineering. The results of this study as well as previous studies show that the expected foundation effectiveness of ML technique in foundation engineering with prediction results of foundation load is mostly reaching R2 from 0.8 to 0.9 on test data set. However, due to the use of different data sets, a comparison between these results is unwarranted. A project that uses different data sets is needed to give a generalized model to foundation engineering.

thumbnail
Download:
Table 13. Comparison with other studies.

https://doi.org/10.1371/journal.pone.0243030.t013

6. Conclusions

The main achievement of this study is to provide an efficient GA-DLNN hybrid model in predicting pile load capacity. The model has the ability to self-evolve to find the optimal model structure, where the optimal number of hidden layers can be treated as a variable and discovered during the model's evolution, besides to the other important parameters. In addition, an evolutionary model was developed to mitigate the number of input variables of the model, while ensuring the accuracy of the regression results.

The results showed that, on the training data set, all three models: 4 -input GA-DLNN, 10-input GA-DLNN and 4-input DLNN have good predict results, in which, the leading is the model GA-DLNN with 4 inputs. On the validation data set, the 4-input GA-DLNN model gave similar results to the 10-input GA-DLNN model and outperformed the 4-input DLNN model with satisfactory accuracy (R2 = 0.923, MAE = 75.927, RMSE = 95.118 kN, IA = 0.981 using 4-input GA-DLNN compared with R2 = 0.918, MAE = 75.838 kN, RMSE = 97.092 kN, IA = 0.98 using 10-input GA-DLNN and R2 = 0.858, MAE = 90.785, RMSE = 113.788 kN, IA = 0.967 kN using 4-input DLNN). Meanwhile, the time cost for the 4-input GA-DLNN model is much lower than the 10-input GA-DLNN hybrid model (the normalize time is respectively 0.7 and 1.0). On testing data, the predictability of the 4-input GA-DLNN model proved to be superior to the other two models. The forecast result of 1000 simulations shows that the average value of R2 is 0.882, 0.8, 0.777 respectively for 4-input GA-DLNN models, 10-input GA-DLNN and 4-input DLNN. In addition, the oscillation range (minimum, maximum) of R2 value of input model GA-DLNN 4 is smaller than the other 2 models, indicating the model's stability.

As research shows that the best results are obtained by GA-DLNN with the number of hidden layers from 2 to 4. The number of neurons in each hidden layer is completely different and is distributed complexly in the hidden layers. It suggests that a DLNN model with 2, 3, 4 hidden layers might be optimal for the problem related to predicting the bearing capacity of driven piles. However, it is recommended to select the number of neurons in each hidden layer by evolutionary methods to bring out high performance for the DLNN model. The results obtained from the evolution of the DLNN model by GA show that the activation function of hidden layers mainly choose one of two categories: relu or logistic and the Quasi-Newton optimal algorithm is most suitable for predicting bearing capacity of pile.

References

  1. 1. Drusa M., Gago F., Vlček J., Contribution to Estimating Bearing Capacity of Pile in Clayey Soils, Civil and Environmental Engineering. 12 (2016) 128–136. https://doi.org/10.1515/cee-2016-0018.
  2. 2. Shooshpasha I., Hasanzadeh A., Taghavi A., Prediction of the axial bearing capacity of piles by SPT-based and numerical design methods, International Journal of GEOMATE. 4 (2013) 560–564.
  3. 3. Birid K.C., Evaluation of Ultimate Pile Compression Capacity from Static Pile Load Test Results, in: Abu-Farsakh M., Alshibli K., Puppala A. (Eds.), Advances in Analysis and Design of Deep Foundations, Springer International Publishing, Cham, 2018: pp. 1–14. https://doi.org/10.1007/978-3-319-61642-1_1.
    • 4. Kozłowski W., Niemczynski D., Methods for Estimating the Load Bearing Capacity of Pile Foundation Using the Results of Penetration Tests—Case Study of Road Viaduct Foundation, Procedia Engineering. 161 (2016) 1001–1006. https://doi.org/10.1016/j.proeng.2016.08.839.
    • 5. Bond A.J., Schuppener B., Scarpelli G., Orr T.L.L., Dimova S., Nikolova B., et al, European Commission, Joint Research Centre, Institute for the Protection and the Security of the Citizen, Eurocode 7: geotechnical design worked examples., Publications Office, Luxembourg, 2013. http://dx.publications.europa.eu/10.2788/3398 (accessed December 12, 2019).
    • 6. Bouafia A., Derbala A., Assessment of SPT-based method of pile bearing capacity–analysis of a database, in: Proceedings of the International Workshop on Foundation Design Codes and Soil Investigation in View of International Harmonization and Performance-Based Design, 2002: pp. 369–374.
    • 7. Meyerhof G.G., Bearing Capacity and Settlement of Pile Foundations, Journal of the Geotechnical Engineering Division. 102 (1976) 197–228.
    • 8. Bazaraa A.R., Kurkur M.M., N-values used to predict settlements of piles in Egypt, in: Use of In Situ Tests in Geotechnical Engineering, ASCE, 1986: pp. 462–474.
    • 9. Robert Y., A few comments on pile design, Can. Geotech. J. 34 (1997) 560–567. https://doi.org/10.1139/t97-024.
    • 10. Shioi Y and Fukui J, Application of N-value to design of foundations in Japan, Proceeding of the 2nd ESOPT. (1982) 159–164.
    • 11. Shariatmadari N., ESLAMI A.A., KARIM P.F.M., Bearing capacity of driven piles in sands from SPT–applied to 60 case histories, Iranian Journal of Science and Technology Transaction B—Engineering. 32 (2008) 125–140.
    • 12. Lopes F.R and Laprovitera H, On the prediction of the bearing capacity of bored piles from dynamic penetration tests., Proceedings of Deep Foundations on Bored and Au-Ger Piles BAP’88, Van Impe (Ed). (1988) 537–540.
    • 13. Decourt L., Prediction of load-settlement relationships for foundations on the basis of the SPT, Ciclo de Conferencias Internationale, Leonardo Zeevaert, UNAM, Mexico. (1985) 85–104.
    • 14. Architectural Institute of Japan, (AIJ), Recommendations for Design of building foundation, Architectural Institute of Japan, Tokyo, 2004.
      • 15. Pham T.A., Ly H.-B., Tran V.Q., Giap L.V., Vu H.-L.T., Duong H.-A.T., Prediction of Pile Axial Bearing Capacity Using Artificial Neural Network and Random Forest, Applied Sciences. 10 (2020) 1871. https://doi.org/10.3390/app10051871.
      • 16. Pham B.T., Nguyen M.D., Dao D.V., Prakash I., Ly H.-B., Le T.-T., et al, Development of artificial intelligence models for the prediction of Compression Coefficient of soil: An application of Monte Carlo sensitivity analysis, Science of The Total Environment. 679 (2019) 172–184. https://doi.org/10.1016/j.scitotenv.2019.05.061 pmid:31082591
      • 17. Asteris P.G., Ashrafian A., Rezaie-Balf M., Prediction of the compressive strength of self-compacting concrete using surrogate models, 1. 24 (2019) 137–150.
      • 18. Asteris P.G., Moropoulou A., Skentou A.D., Apostolopoulou M., Mohebkhah A., Cavaleri L., et al, Stochastic Vulnerability Assessment of Masonry Structures: Concepts, Modeling and Restoration Aspects, Applied Sciences. 9 (2019) 243.
      • 19. Hajihassani M., Abdullah S.S., Asteris P.G., Armaghani D.J., A gene expression programming model for predicting tunnel convergence, Applied Sciences. 9 (2019) 4650.
      • 20. Huang L., Asteris P.G., Koopialipoor M., Armaghani D.J., Tahir M.M., Invasive Weed Optimization Technique-Based ANN to the Prediction of Rock Tensile Strength, Applied Sciences. 9 (2019) 5372.
      • 21. Le L.M., Ly H.-B., Pham B.T., Le V.M., Pham T.A., Nguyen D.-H., et al, Hybrid Artificial Intelligence Approaches for Predicting Buckling Damage of Steel Columns Under Axial Compression, Materials. 12 (2019) 1670. https://doi.org/10.3390/ma12101670 pmid:31121948
      • 22. Ly H.-B., Pham B.T., Dao D.V., Le V.M., Le L.M., Le T.-T., Improvement of ANFIS Model for Prediction of Compressive Strength of Manufactured Sand Concrete, Applied Sciences. 9 (2019) 3841. https://doi.org/10.3390/app9183841.
      • 23. Ly H.-B., Le L.M., Duong H.T., Nguyen T.C., Pham T.A., Le T.-T., et al, Hybrid Artificial Intelligence Approaches for Predicting Critical Buckling Load of Structural Members under Compression Considering the Influence of Initial Geometric Imperfections, Applied Sciences. 9 (2019) 2258. https://doi.org/10.3390/app9112258.
      • 24. Ly H.-B., Le T.-T., Le L.M., Tran V.Q., Le V.M., Vu H.-L.T., et al, Development of Hybrid Machine Learning Models for Predicting the Critical Buckling Load of I-Shaped Cellular Beams, Applied Sciences. 9 (2019) 5458. https://doi.org/10.3390/app9245458.
      • 25. Ly H.-B., Le L.M., Phi L.V., Phan V.-H., Tran V.Q., Pham B.T., et al, Development of an AI Model to Measure Traffic Air Pollution from Multisensor and Weather Data, Sensors. 19 (2019) 4941. https://doi.org/10.3390/s19224941 pmid:31766187
      • 26. Xu H., Zhou J., Asteris P. G., Jahed Armaghani D., Tahir M.M., Supervised Machine Learning Techniques to the Prediction of Tunnel Boring Machine Penetration Rate, Applied Sciences. 9 (2019) 3715. https://doi.org/10.3390/app9183715.
      • 27. Chen H., Asteris P.G., Jahed Armaghani D., Gordan B., Pham B.T., Assessing Dynamic Conditions of the Retaining Wall: Developing Two Hybrid Intelligent Models, Applied Sciences. 9 (2019) 1042. https://doi.org/10.3390/app9061042.
      • 28. Nguyen H.-L., Le T.-H., Pham C.-T., Le T.-T., Ho L.S., Le V.M., et al, Development of Hybrid Artificial Intelligence Approaches and a Support Vector Machine Algorithm for Predicting the Marshall Parameters of Stone Matrix Asphalt, Applied Sciences. 9 (2019) 3172. https://doi.org/10.3390/app9153172.
      • 29. Nguyen H.-L., Pham B.T., Son L.H., Thang N.T., Ly H.-B., Le T.-T., et al, Adaptive Network Based Fuzzy Inference System with Meta-Heuristic Optimizations for International Roughness Index Prediction, Applied Sciences. 9 (2019) 4715. https://doi.org/10.3390/app9214715.
      • 30. Asteris P.G., Nozhati S., Nikoo M., Cavaleri L., Nikoo M., Krill herd algorithm-based neural network in structural seismic reliability evaluation, Mechanics of Advanced Materials and Structures. 26 (2019) 1146–1153. https://doi.org/10.1080/15376494.2018.1430874.
      • 31. Asteris P.G., Armaghani D.J., Hatzigeorgiou G.D., Karayannis C.G., Pilakoutas K., Predicting the shear strength of reinforced concrete beams using Artificial Neural Networks, Computers and Concrete. 24 (2019) 469–488. https://doi.org/10.12989/cac.2019.24.5.469.
      • 32. Asteris P.G., Apostolopoulou M., Skentou A.D., Moropoulou A., Application of artificial neural networks for the prediction of the compressive strength of cement-based mortars, Computers and Concrete. 24 (2019) 329–345. https://doi.org/10.12989/cac.2019.24.4.329.
      • 33. Asteris P.G., Kolovos K.G., Self-compacting concrete strength prediction using surrogate models, Neural Comput & Applic. 31 (2019) 409–424. https://doi.org/10.1007/s00521-017-3007-7.
      • 34. Asteris P.G., Mokos V.G., Concrete compressive strength using artificial neural networks, Neural Comput & Applic. (2019). https://doi.org/10.1007/s00521-019-04663-2.
      • 35. Dao D.V., Ly H.-B., Trinh S.H., Le T.-T., Pham B.T., Artificial Intelligence Approaches for Prediction of Compressive Strength of Geopolymer Concrete, Materials. 12 (2019) 983. https://doi.org/10.3390/ma12060983.
      • 36. Dao D.V., Trinh S.H., Ly H.-B., Pham B.T., Prediction of Compressive Strength of Geopolymer Concrete Using Entirely Steel Slag Aggregates: Novel Hybrid Artificial Intelligence Approaches, Applied Sciences. 9 (2019) 1113. https://doi.org/10.3390/app9061113.
      • 37. Qi C., Ly H.-B., Chen Q., Le T.-T., Le V.M., Pham B.T., Flocculation-dewatering prediction of fine mineral tailings using a hybrid machine learning approach, Chemosphere. 244 (2020) 125450. https://doi.org/10.1016/j.chemosphere.2019.125450 pmid:31816548
      • 38. Goh A.T.C., Back-propagation neural networks for modeling complex systems, Artificial Intelligence in Engineering. 9 (1995) 143–151. https://doi.org/10.1016/0954-1810(94)00011-S
      • 39. Goh Anthony T. C., Kulhawy Fred H., Chua C. G., Bayesian Neural Network Analysis of Undrained Side Resistance of Drilled Shafts, Journal of Geotechnical and Geoenvironmental Engineering. 131 (2005) 84–93. https://doi.org/10.1061/(ASCE)1090-0241(2005)131:1(84)
      • 40. Shahin M.A., Jaksa M.B., Neural network prediction of pullout capacity of marquee ground anchors, Computers and Geotechnics. 32 (2005) 153–163. https://doi.org/10.1016/j.compgeo.2005.02.003.
      • 41. Shahin M.A., Load–settlement modeling of axially loaded steel driven piles using CPT-based recurrent neural networks, Soils and Foundations. 54 (2014) 515–522. https://doi.org/10.1016/j.sandf.2014.04.015.
      • 42. Shahin M.A., State-of-the-art review of some artificial intelligence applications in pile foundations, Geoscience Frontiers. 7 (2016) 33–44. https://doi.org/10.1016/j.gsf.2014.10.002.
      • 43. Shahin M.A., Intelligent computing for modeling axial capacity of pile foundations, Canadian Geotechnical Journal. 47 (2010) 230–243.
      • 44. Nawari N.O., Liang R., Nusairat J., Artificial intelligence techniques for the design and analysis of deep foundations, Electronic Journal of Geotechnical Engineering. 4 (1999) 1–21.
      • 45. Momeni E., Nazir R., Armaghani D.J., Maizir H., Application of Artificial Neural Network for Predicting Shaft and Tip Resistances of Concrete Piles, Earth Sciences Research Journal. 19 (2015) 85–93. https://doi.org/10.15446/esrj.v19n1.38712.
      • 46. Nhu V.-H., Hoang N.-D., Duong V.-B., Vu H.-D., Tien Bui D., A hybrid computational intelligence approach for predicting soil shear strength for urban housing construction: a case study at Vinhomes Imperia project, Hai Phong city (Vietnam), Engineering with Computers. 36 (2020) 603–616. https://doi.org/10.1007/s00366-019-00718-z.
      • 47. Pham B.T., Qi C., Ho L.S., Nguyen-Thoi T., Al-Ansari N., Nguyen M.D., et al A Novel Hybrid Soft Computing Model Using Random Forest and Particle Swarm Optimization for Estimation of Undrained Shear Strength of Soil, Sustainability. 12 (2020) 2218. https://doi.org/10.3390/su12062218.
      • 48. Momeni E., Nazir R., Armaghani D.J., Maizir H., Prediction of pile bearing capacity using a hybrid genetic algorithm-based ANN, Measurement. 57 (n.d.) 122–131.
      • 49. Hossain D., Capi G., Jindai M., Optimizing Deep Learning Parameters Using Genetic Algorithm for Object Recognition and Robot Grasping, 16 (2018) 6.
      • 50. Liang X., Nguyen D., Jiang S., Generalizability issues with deep learning models in medicine and their potential solutions: illustrated with Cone-Beam Computed Tomography (CBCT) to Computed Tomography (CT) image conversion, ArXiv:2004.07700 [Physics]. (2020). http://arxiv.org/abs/2004.07700 (accessed April 17, 2020).
      • 51. Sommers G.M., Andrade M.F.C., Zhang L., Wang H., Car R., Raman Spectrum and Polarizability of Liquid Water from Deep Neural Networks, ArXiv:2004.07369 [Cond-Mat, Physics:Physics]. (2020). http://arxiv.org/abs/2004.07369 (accessed April 17, 2020). pmid:32377657
      • 52. Rojas F., Maurin L., Dünner R., Pichara K., Classifying CMB time-ordered data through deep neural networks, Monthly Notices of the Royal Astronomical Society. (2020) staa1009. https://doi.org/10.1093/mnras/staa1009.
      • 53. Ezzat D., ell Hassanien A., Ella H.A., GSA-DenseNet121-COVID-19: a Hybrid Deep Learning Architecture for the Diagnosis of COVID-19 Disease based on Gravitational Search Optimization Algorithm, ArXiv:2004.05084 [Cs, Eess]. (2020). http://arxiv.org/abs/2004.05084 (accessed April 17, 2020).
      • 54. Bagińska M., Srokosz P.E., The Optimal ANN Model for Predicting Bearing Capacity of Shallow Foundations trained on Scarce Data, KSCE J Civ Eng. 23 (2019) 130–137. https://doi.org/10.1007/s12205-018-2636-4.
      • 55. Marto A., Hajihassani M., Momeni E., Bearing Capacity of Shallow Foundation’s Prediction through Hybrid Artificial Neural Networks, AMM. 567 (2014) 681–686. https://doi.org/10.4028/www.scientific.net/AMM.567.681.
      • 56. Momeni E., Armaghani D.J., Fatemi S.A., Nazir R., Prediction of bearing capacity of thin-walled foundation: a simulation approach, Engineering with Computers. 34 (2018) 319–327. https://doi.org/10.1007/s00366-017-0542-x.
      • 57. Bagińska M., Srokosz P.E., The Optimal ANN Model for Predicting Bearing Capacity of Shallow Foundations trained on Scarce Data, KSCE J Civ Eng. 23 (2019) 130–137. https://doi.org/10.1007/s12205-018-2636-4.
      • 58. Teh C. I., Wong K. S., Goh A. T. C., Jaritngam S., Prediction of Pile Capacity Using Neural Networks, Journal of Computing in Civil Engineering. 11 (1997) 129–138. https://doi.org/10.1061/(ASCE)0887-3801(1997)11:2(129)
      • 59. Pooya Nejad F., Jaksa M.B., Kakhi M., McCabe B.A., Prediction of pile settlement using artificial neural networks based on standard penetration test data, Computers and Geotechnics. 36 (2009) 1125–1133. https://doi.org/10.1016/j.compgeo.2009.04.003.
      • 60. Hastie T., Tibshirani R., Friedman J., The Elements of Statistical Learning–Data Mining, Inference, and Prediction, n.d.
      • 61. CFA Institute, CFA Program Curriculum 2020 Level II Volumes 1–6 Box Set | Wiley, Wiley, 2019. https://www.wiley.com/en-vn/CFA+Program+Curriculum+2020+Level+II+Volumes+1+6+Box+Set-p-9781946442956 (accessed July 7, 2020).
        • 62. Zemouri R., Omri N., Fnaiech F., Zerhouni N., Fnaiech N., A new growing pruning deep learning neural network algorithm (GP-DLNN), Neural Comput & Applic. (2019). https://doi.org/10.1007/s00521-019-04196-8.
        • 63. Lipták B.G., ed., Process Control Instrument Engineer, Elsevier, 1995. https://www.sciencedirect.com/book/9780750622554/process-control#book-info (accessed July 7, 2020).
          • 64. Van Der Malsburg C., Frank Rosenblatt: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms, in: Palm G., Aertsen A. (Eds.), Brain Theory, Springer, Berlin, Heidelberg, 1986: pp. 245–248. https://doi.org/10.1007/978-3-642-70911-1_20.
            • 65. Holland J.H., P. of P. and of E.E. and Holland C.S.J.H., S.L. in Holland H.R.M., Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence, MIT Press, 1992.
            • 66. A fast and elitist multiobjective genetic algorithm: NSGA-II—IEEE Journals & Magazine, (n.d.). https://ieeexplore.ieee.org/abstract/document/996017 (accessed April 25, 2020).
              • 67. Houck C.R., Joines J., Kay M.G., A genetic algorithm for function optimization: a Matlab implementation, Ncsu-Ie Tr. 95 (1995) 1–10.
              • 68. Liu L., Moayedi H., Rashid A.S.A., Rahman S.S.A., Nguyen H., Optimizing an ANN model with genetic algorithm (GA) predicting load-settlement behaviours of eco-friendly raft-pile foundation (ERP) system, Engineering with Computers. 36 (2020) 421–433.
              • 69. Hegazy T., Kassab M., Resource optimization using combined simulation and genetic algorithms, Journal of Construction Engineering and Management. 129 (2003) 698–705.
              • 70. Moayedi H., Raftari M., Sharifi A., Jusoh W.A.W., Rashid A.S.A., Optimization of ANFIS with GA and PSO estimating α ratio in driven piles, Engineering with Computers. 36 (2020) 227–238.
              • 71. Momeni E., Nazir R., Armaghani D.J., Maizir H., Prediction of pile bearing capacity using a hybrid genetic algorithm-based ANN, Measurement. 57 (2014) 122–131.
              • 72. Ardalan H., Eslami A., Nariman-Zadeh N., Shaft resistance of driven piles based on CPT and CPTu results using GMDH-type neural networks and genetic algorithms, in: The 12th International Conference of International Association for Computer Methods and Advances in Geomechanics (IACMAG), Citeseer, 2008: pp. 1850–1858.
              • 73. Luo Z., Hasanipanah M., Amnieh H.B., Brindhadevi K., Tahir M.M., GA-SVR: a novel hybrid data-driven model to simulate vertical load capacity of driven piles, Engineering with Computers. (2019) 1–9.
              • 74. Ardalan H., Eslami A., Nariman-Zadeh N., Piles shaft capacity from CPT and CPTu data by polynomial neural networks and genetic algorithms, Computers and Geotechnics. 36 (2009) 616–625.
              • 75. Zemouri R., Omri N., Fnaiech F., Zerhouni N., Fnaiech N., A new growing pruning deep learning neural network algorithm (GP-DLNN), Neural Comput & Applic. (2019). https://doi.org/10.1007/s00521-019-04196-8.
              • 76. Dimiduk D.M., Holm E.A., Niezgoda S.R., Perspectives on the Impact of Machine Learning, Deep Learning, and Artificial Intelligence on Materials, Processes, and Structures Engineering, Integr Mater Manuf Innov. 7 (2018) 157–172. https://doi.org/10.1007/s40192-018-0117-8.
              • 77. Abusamra H., A Comparative Study of Feature Selection and Classification Methods for Gene Expression Data of Glioma, Procedia Computer Science. 23 (2013) 5–14. https://doi.org/10.1016/j.procs.2013.10.003.
              • 78. Hopgood A.A., Intelligent Systems for Engineers and Scientists, CRC Press, 2012.
                • 79. Ting C.-K., On the Mean Convergence Time of Multi-parent Genetic Algorithms Without Selection, in: Capcarrère M.S., Freitas A.A., Bentley P.J., Johnson C.G., Timmis J. (Eds.), Advances in Artificial Life, Springer, Berlin, Heidelberg, 2005: pp. 403–412. https://doi.org/10.1007/11553090_41.
                  • 80. Chai T., Draxler R.R., Root mean square error (RMSE) or mean absolute error (MAE)?–Arguments against avoiding RMSE in the literature, Geoscientific Model Development. 7 (2014) 1247–1250.
                  • 81. Willmott C.J., Wicks D.E., An Empirical Method for the Spatial Interpolation of Monthly Precipitation within California, Physical Geography. 1 (1980) 59–73. https://doi.org/10.1080/02723646.1980.10642189.
                  • 82. Willmott C.J., On the Validation of Models, Physical Geography. 2 (1981) 184–194. https://doi.org/10.1080/02723646.1981.10642213.
                  • 83. Dao D.V., Trinh S.H., Ly H.-B., Pham B.T., Prediction of compressive strength of geopolymer concrete using entirely steel slag aggregates: Novel hybrid artificial intelligence approaches, Applied Sciences. 9 (2019) 1113.
                  • 84. Nguyen H.-L., Le T.-H., Pham C.-T., Le T.-T., Ho L.S., Le V.M., et al, Development of Hybrid Artificial Intelligence Approaches and a Support Vector Machine Algorithm for Predicting the Marshall Parameters of Stone Matrix Asphalt, Applied Sciences. 9 (2019) 3172.
                  • 85. Momeni E., Dowlatshahi M.B., Omidinasab F., Maizir H., Armaghani D.J., Gaussian Process Regression Technique to Estimate the Pile Bearing Capacity, Arab J Sci Eng. 45 (2020) 8255–8267. https://doi.org/10.1007/s13369-020-04683-4.
                  • 86. Kulkarni R. U., Dewaikar D. M., Indian Institute of Technology Bombay, Prediction of Interpreted Failure Loads of Rock-Socketed Piles in Mumbai Region using Hybrid Artificial Neural Networks with Genetic Algorithm, IJERT. V6 (2017) IJERTV6IS060196. https://doi.org/10.17577/IJERTV6IS060196.
                  • 87. Jahed Armaghani D., Shoib R.S.N.S.B.R., Faizi K., Rashid A.S.A., Developing a hybrid PSO–ANN model for estimating the ultimate bearing capacity of rock-socketed piles, Neural Comput & Applic. 28 (2017) 391–405. https://doi.org/10.1007/s00521-015-2072-z.