https://orcid.org/0000-0001-7701-2278
Figures
Abstract
This paper proposes a novel hybrid algorithm, named Multi-Strategy Hybrid Harris Hawks Tunicate Swarm Optimization Algorithm (MSHHOTSA). The primary objective of MSHHOTSA is to address the limitations of the tunicate swarm algorithm, which include slow optimization speed, low accuracy, and premature convergence when dealing with complex problems. Firstly, inspired by the idea of the neighborhood and thermal distribution map, the hyperbolic tangent domain is introduced to modify the position of new tunicate individuals, which can not only effectively enhance the convergence performance of the algorithm but also ensure that the data generated between the unknown parameters and the old parameters have a similar distribution. Secondly, the nonlinear convergence factor is constructed to replace the original random factor c1 to coordinate the algorithm’s local exploitation and global exploration performance, which effectively improves the ability of the algorithm to escape extreme values and fast convergence. Finally, the swarm update mechanism of the HHO algorithm is introduced into the position update of the TSA algorithm, which further balances the local exploitation and global exploration performance of the MSHHOTSA. The proposed algorithm was evaluated on eight standard benchmark functions, CEC2019 benchmark functions, four engineering design problems, and a PID parameter optimization problem. It was compared with seven recently proposed metaheuristic algorithms, including HHO and TSA. The results were analyzed and discussed using statistical indicators such as mean, standard deviation, Wilcoxon’s rank sum test, and average running time. Experimental results demonstrate that the improved algorithm (MSHHOTSA) exhibits higher local convergence, global exploration, robustness, and universality than BOA, GWO, MVO, HHO, TSA, ASO, and WOA algorithms under the same experimental conditions.
Citation: Liu G, Guo Z, Liu W, Cao B, Chai S, Wang C (2023) MSHHOTSA: A variant of tunicate swarm algorithm combining multi-strategy mechanism and hybrid Harris optimization. PLoS ONE 18(8): e0290117. https://doi.org/10.1371/journal.pone.0290117
Editor: Aytaç Altan, Zonguldak Bülent Ecevit University: Zonguldak Bulent Ecevit Universitesi, TURKEY
Received: May 9, 2023; Accepted: August 2, 2023; Published: August 11, 2023
Copyright: © 2023 Liu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: National Natural Science Foundation of China 51974144 Guangwei LIU National Natural Science Foundation of China Youth Fund Project 52204158 Senlin CHAI Basic Scientific Research Projects of Colleges and Universities in Liaoning Province LJKZ0340 Wei LIU Project supported by discipline innovation team of Liaoning Technical University LNTU20TD-01 LNTU20TD-07 Guangwei LIU Yancheng Institute of Technology High level Talent Research Initiation Project xjr2020039 Senlin CHAI The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
1. Introduction
With science and technology’s continuous development and progress, we face increasingly complex engineering problems characterized by non-convexity, multimodality, and high-dimensional variability [1, 2]. The complexity of these problems renders traditional optimization methods based on gradient descent ineffective [3]. However, solving these intricate engineering problems is crucial to advancing national development and promoting scientific and technological advancements. Therefore, it is imperative to conduct in-depth research and explore the development of novel optimization algorithms and techniques.
In recent years, many scholars have proposed a series of metaheuristic algorithms based on biological evolution, animal social behavior, and natural physical phenomena to address these complex engineering constraint problems. For example, Genetic Algorithm (GA) [4, 5], Ant Colony Optimization (ACO) [6], Artificial Rabbits Optimization (ARO) [7], Grey Wolf Optimizer (GWO) [8], Grasshopper Optimization Algorithm (GOA) [9], Multi-verse Optimizer (MVO) [10], Butterfly Optimization Algorithm (BOA) [11], Harris Hawks Optimization (HHO) [12], Atom search optimization (ASO) [13], Whale Optimization Algorithm (WOA) [14], among others.
These metaheuristic algorithms solve complex engineering constraints by simulating natural organisms’ population behavior and survival hunting strategies. They do not rely on the specific form and characteristics of the problem, making them applicable to various complex engineering problems. The strengths of these algorithms lie in their broad applicability and the fact that they do not require specific formalization or prior knowledge about the situation. As a result, they can achieve excellent optimization results for a wide range of practical complex engineering problems. For instance, scholars like Altan have applied various metaheuristic algorithms to address challenges in UAV path planning and tracking [15, 16], real-time detection of agricultural plant diseases [17], cryptocurrency forecasting [18], crude oil time series prediction [19, 20], and wind speed prediction [21]. Additionally, GA and its variants have been employed in production scheduling [22, 23], allocation optimization [24], search and localization tasks [25, 26], and neural network optimization [27–29]. Furthermore, other metaheuristic algorithms, such as ASO, GWO, WOA, HHO, and their variations, have also been widely applied to address complex optimization problems in fields such as battery modeling [30, 31], feature selection [1, 32–37] and path optimization [38–41].
Although these metaheuristic algorithms have been applied to solve complex engineering constraint problems, according to the No Free Lunch Theorem, no single optimization algorithm can be universally effective for solving all optimization problems [42]. Therefore, when dealing with complex engineering constraint problems, selecting an appropriate optimization algorithm is crucial. Scholars such as Kaur S have proposed a Tunicate Swarm Algorithm (TSA) [43], which simulates the hunting and population behavior of tunicate swarms and applies it to solve various engineering constraints. For example, in image segmentation, Houssein and other scholars combined TSA with the local escaping operator (LEO) to propose the TSA-LEO algorithm, which was successfully applied to image segmentation [44]. Awari and colleagues integrated deep learning methods with the TSA algorithm and successfully applied them to three-dimensional dental image segmentation and classification [45]. Akdağ improved tunicates’ updating strategy and collective behavior in engineering optimization, proposing the Modified Tunicate Swarm Algorithm (M-TSA), which achieved successful applications in multiple engineering optimization problems [46]. Similarly, Rizk-Allah and others introduced the Enhanced Tunicate Swarm Algorithm (ETSA) to solve large-scale nonlinear optimization problems [47]. Besides, the TSA algorithm and its various variants have also received extensive attention in economic scheduling [48], distribution network optimization [49, 50], disease prediction [51, 52], and other domains. The TSA algorithm and its variants have shown significant effectiveness in solving complex engineering problems, demonstrating their potential advantages and applications. These excellent improvement mechanisms can be mainly categorized into three types:
- (1) Population Diversity Enhancement Mechanism
For metaheuristic algorithms, the quality of optimization results is often closely related to population diversity. The richer the population diversity, the more likely the algorithm can escape from local optima and approach the global optimum through iterative optimization. Therefore, in the improvement mechanisms of the TSA algorithm, enhancing population diversity remains one of the main methods to improve its convergence and optimization performance. Among them, the typical approaches include chaotic initialization and reverse learning mechanisms. For example, Tent mapping [53, 54] and Halton sequence [55] have been used to enhance the population diversity of TSA with good optimization performance; meanwhile, Abhishek Sharma [56], Essam H. Houssein [57] and Jianzhou Wang [58] have applied the backward learning mechanism to TSA algorithm, which not only enhances the This mechanism not only enhances the population diversity but also improves the convergence performance of the TSA algorithm.
- (2) Swarm Behavior and Individual Position Update Mechanism
In TSA, tunicate individuals’ position updates and swarm behaviors’ selection play a crucial role in the algorithm’s global exploration and convergence speed. To address this, researchers have employed nonlinear parameter adjustment mechanisms and dynamic adaptive position update mechanisms to improve the optimization performance of TSA. For instance, In terms of nonlinear parameter correction, researchers have used nonlinear functions such as exponential functions [58], Levy flight functions [53, 54, 59], cosine functions [55] and simple polynomial functions [60] instead of linear functions in TSA, which significantly improve the convergence performance of TSA in search of the best. As for dynamic adaptive position updating, Rizk-Allah et al. effectively enhanced the convergence speed of the algorithm by introducing an ingestion parameter to dynamically adjust the search step of the tunicate individual [47]. ARABALI et al. proposed an adaptive TSA algorithm (ATSA) by changing the search between the candidate and optimal solutions of the tunicate swarm. They applied it successfully to expand the base optimization [61]. Besides, Lévy distribution [62], Cauchy distribution [62], Gaussian distribution [62], adaptive competitive window [63], adaptive distribution [64] and adaptive parameters [44] are also used for the dynamic adaptive update of the tunicate position.
- (3) Multi-Algorithm Fusion Mechanism
By integrating different metaheuristic algorithms, we can effectively leverage their respective strengths and mitigate their weaknesses, thereby improving the overall optimization performance of the fused algorithms. For example, HOUSSEIN et al. proposed a TSA-LEO algorithm by fusing TSA with a local escape operator (LEO) to enhance TSA’s convergence speed and local search performance. They applied it successfully to solve the image segmentation problem [44]. Chouhan et al. fused TSA with the GWO algorithm and successfully solved the multi-path routing protocol problem [65]. Doraiswami et al. fused TSA with the Jaya algorithm and used it for the GAN network, proposed Jaya-TSA based GAN prediction method, and used it successfully for patient prediction of COVID-19 [66]. In addition, the fusion of TSA with the BOA algorithm [67] and TSA with the FPA algorithm [68] can also effectively enhance the superior performance of each other, indicating that the combination of the respective search advantages of different algorithms can effectively balance the global exploration and local exploitation capabilities of the algorithms.
The above studies have strengths, as they have significantly improved and applied to the TSA algorithm in different periods and domains. These improvements mainly focus on population initialization, nonlinear convergence factor, and hybrid algorithms. Building on these improvement strategies, we propose a hybrid algorithm known as the Multi-Strategy Hybrid Harris Hawks Tunicate Swarm Optimization Algorithm (MSHHOTSA). Specifically, the main contributions of this paper are as follows:
- Inspired by neighborhood thinking and the principles of thermographic distribution, we developed a hyperbolic tangent domain and nonlinear fast convergence factors, which are used to update the population positions and behaviors in the TSA algorithm. These new update strategies help improve the algorithm’s convergence accuracy and better balance global exploration and local exploitation abilities.
- Inspired by hybrid algorithm mechanisms, we introduce the population behavior of the Harris Hawks Optimization (HHO) algorithm into the TSA algorithm to enhance the population diversity of TSA. By introducing new behavioral strategies, the algorithm can better explore the search space and thus have a higher chance of finding global optima.
- We integrate the hyperbolic tangent domain, nonlinear fast convergence factor, and hybrid mechanisms to propose the Multi-Strategy Hybrid Harris Hawks Tunicate Swarm Optimization Algorithm (MSHHOTSA). By synergistically utilizing the advantages of different strategies, we further improve the algorithm’s optimization performance and robustness.
- The MSHHOTSA algorithm is applied to 18 benchmark functions and five engineering optimization problems with constraints. Experimental results demonstrate that our algorithm exhibits significant performance when solving these problems.
- We conduct an in-depth analysis of the shortcomings of the MSHHOTSA algorithm, providing a reference for improving or proposing new metaheuristic algorithms.
The main structure of this article is as follows: In Section 2, the standard Tunicate Swarm Optimization algorithm is introduced, including its principles and basic process. In Section 3, the proposed MSHHOTSA algorithm is described. Specifically, Subsection 3.1.1 introduces the construction process of the hyperbolic tangent domain, and Subsection 3.1.2 describes the construction process of the nonlinear fast convergence factor. Section 3.2 discusses the hybrid approach of the Harris Hawks Optimization (HHO) algorithm and the Tunicate Swarm Optimization (TSA) algorithm. Furthermore, Section 3.4 analyzes the complexity of the proposed MSHHOTSA algorithm. In Section 4, through multiple sets of experiments, the advantages and disadvantages of the MSHHOTSA algorithm are thoroughly researched and discussed. In Section 5, we apply the MSHHOTSA algorithm to solve five complex engineering optimization problems. Finally, Section 6 summarizes the current work and outlines potential future research directions.
2. Tunicate swarm algorithm (TSA)
The tunicate swarm algorithm is a metaheuristic algorithm proposed by Kaur S et al. [43], inspired by the swarm foraging behavior of tunicate animals in the ocean, which simulates the jet propulsion and swarm behavior of tunicate animals in the foraging process. The algorithm focuses on finding the optimal solution in the solution space by the following four conditions.
- (1) Avoid conflicts between tunicate individuals
In order to avoid conflicts among tunicate individuals, the individual position of the new tunicate is calculated using , that is,
(1)
(2)
(3)
(4)
Where
is the position of the new tunicate individual;
is the gravitational force;
is the social force between tunicate individuals;
is the deep-sea current advection; Pmin = 1 and Pmax = 4 represent the initial velocity and auxiliary velocity of the tunicate individual for social interaction, respectively; variables c1, c2 and c3 are random numbers between [0,1].
- (2) Move to the optimal neighbor
After avoiding the search conflict among tunicate individuals, the tunicate individuals in the tunicate population all move to the optimal neighbor, and this behavior can be expressed as:
(5)
Where
denotes the distance between the food source and the tunicate individual,
is the location of the food source,
is the current location of the tunicate individual, x is the number of current iterations, rand∈[0,1].
- (3) Converge to the position of the optimal tunicate individual
When the above conditions are satisfied, each tunicate individual eventually approaches the optimal position, and the process is described as:
(6)
Where
represents the updated tunicate individual position.
- (4) Swarm Behavior of Tunicates
The tunicate swarm algorithm first saves the first two optimal solutions, and then updates the remaining tunicate individual positions according to the best tunicate individual positions, that is:
(7)
In summary, the specific flow of the TSA algorithm can be obtained as shown in Fig 1.
3. The MSHHOTSA algorithm
In the Tunicate Swarm Algorithm (TSA), jet propulsion behavior primarily serves to approximate the optimal value in the solution space rapidly. In contrast, swarm behavior aims to ensure quick convergence of the algorithm and enhance its global exploration capability. To enhance TSA’s optimization performance in the solution space, this paper proposes two improvements: updating tunicate individuals’ position parameters and updating their swarm behavior.
3.1 Update the position parameters of the tunicate individual
3.1.1 Hyperbolic tangent domain modification parameters.
From Eq (6), it is evident that the position of the new tunicate animal (parameter ) generated by the TSA algorithm during jet propulsion behavior determines the location of the following tunicate individual. The algorithm can be considered to have converged to the optimal solution in the solution space when there is no significant change in the position of consecutive tunicate individuals. In conjunction with Eq (1), parameter
primarily wanders randomly within a space defined by three random numbers. A larger magnitude of
indicates that the current tunicate individual is farther from the current optimal tunicate, increasing the probability of finding a better individual and enhancing TSA’s global exploration performance. Conversely, as
, the current tunicate individual approaches the current optimal tunicate, accelerating the discovery of a better individual and increasing TSA’s local exploitation performance.
Therefore, to improve the superior performance of TSA, we drew inspiration from the neighborhood and heat map distribution concepts. The aim is to increase the value of the parameter while biasing the distribution of
towards 0. This approach enhances the algorithm’s global exploration capability while accelerating its convergence speed. In this study, we introduced the hyperbolic tangent function to construct a hyperbolic tangent
row domain based on the hyperbolic tangent function (see Fig 2 for details).
In Fig 2, the blue-green region represents the random traversal space of the original parameter , referred to as the original
row domain. The light red region represents the perturbation space added by the hyperbolic tangent function, known as the hyperbolic tangent domain. The random traversal space of the modified parameter
is the combination of the hyperbolic tangent domain and the original
row domain, forming the hyperbolic tangent
row domain. The mathematical model of the hyperbolic tangent
row domain constructed based on Fig 2 is expressed as follows:
(8)
where, in order to ensure that the perturbation of the hyperbolic tangent function to the parameter
remains within the unit circle, let
(9)
where Thd(1) = 0.5, and x is the number of current iterations, r is a random number between [0,1], tanh(x) is a hyperbolic tangent function, and the equation is:
(10)
To sum up, according to Eq 8–Eq 10, the numerical distribution images of the original row domain and the hyperbolic tangent
row domain are respectively generated under 1000 iterations, as shown in Figs 3 and 4.
From the comparison between Figs 3 and 4, significant changes in the data distribution of parameter can be observed with and without the hyperbolic tangent domain perturbation. Firstly, the data distribution of parameter
transformed from a spiky truncated tail to a rounded trailing bottom. This shift indicates that the interval range (i.e., random wandering range) of parameter
expanded and became more concentrated around the 0 intervals after the perturbation. As a result, the tunicate individuals were not only encouraged to explore better values in a larger space (due to the increased interval range) but also were able to approach the optimal neighbors more rapidly (due to the data concentration around the 0 intervals). Secondly, despite the changes in the parameter data distribution after introducing perturbation, the overall distribution still exhibited similarity, ensuring the uniformity of data information effectively.
In summary, the modified hyperbolic tangent row domain not only effectively preserves the similarity in data distribution with the original
row domain but also allows for adjusting the random walking space. This adjustment effectively balances the algorithm’s global exploration and local exploitation capabilities.
3.1.2 Nonlinear convergence factor update mechanism for tunicate swarm behavior.
In TSA, it is observed from the population behavior of the tunicate organisms (Eq (7)) that the location of the best tunicate individual is influenced by its place and the location of the previous tunicate individual. The algorithm reaches the extreme value when the site of the last tunicate individual is the same as the best tunicate location. Therefore, in Eq (7), the random parameter c1 plays a crucial role in determining whether the algorithm can escape local optimal solutions and reach global optimal solutions. However, the randomness of the parameter c1 during the continuous iterations of the algorithm (see Fig 5) significantly impacts the algorithm’s convergence, leading to an imbalance between global exploration and local exploitation. To enhance the TSA search performance more effectively, this paper introduces a deterministic nonlinear convergence factor to replace the random parameter c1 in Eq (7) (Eq (3) remains unchanged). The modified Eq (7) is expressed as:
(11)
where, the equation of the introduced nonlinear convergence factor is:
(12)
Where x represents the current number of iterations, and xmax is the maximum number of iterations. In Eq (12), sine and cosine functions control the algorithm’s fluctuation during iterations, crucially contributing to the algorithm’s global exploration performance. The negative logarithm function ensures a systematic decrease in the algorithm as iterations progress, which is pivotal in enhancing the algorithm’s local exploitation performance. To ensure that the convergence factor and the interval range of the random factor c1 are identical, w(x) is normalized. The corresponding function expression and graph are illustrated in Eq (13) and Fig 6, respectively.
So, Eq (11) can be redefined as:
(14)
After the introduction of the nonlinear fast convergence factor, the TSA iterative process can be divided into three stages: the pre-iterative stage, the mid-iterative stage, and the post-iterative stage by analyzing Eq (14) and Fig 6.
3.1.2.1 Pre-iterative stage: Accelerate the convergence speed of the algorithm. At this time, the nonlinear convergence factor ω(x) rapidly approaches 0, and the also rapidly approaches
, that is, the algorithm rapidly approaches the current optimal solution in the solution space.
3.1.2.2 Mid-iterative stage: Enhance the ability of the algorithm to escape the local extremum. The relationship between and
becomes more and more distant as ω(x) changes from fast approaching 0 to slowly increasing. This process represents the process by which the algorithm jumps out of the local extremum to try to find if there is a better value in the solution space.
3.1.2.3 Post-iterative stage: Improve the convergence speed of the algorithm. At this time, ω(x) changes from gradually increasing to slowly decreasing, then gradually approximates
. This process represents the process of the algorithm approaching the optimal solution again after jumping out of the local extremes.
In summary, introducing the deterministic nonlinear convergence factor instead of the random factor addresses the uncertainty impact of randomness on the algorithm’s convergence. It also achieves a more effective balance between global exploration and local exploitation capabilities to a certain extent.
3.2 Tunicate swarm algorithm based on harris hawks optimization
In Section 3.1, we introduce the hyperbolic tangent domain and the nonlinear fast convergence factor to modify the jet propulsion and swarm behavior of TSA, respectively. These modifications somewhat improve TSA’s global exploration and local exploitation abilities. However, upon considering the overall iterative process of the algorithm, we observe that these two improvement mechanisms mainly promote the local exploitation performance of the algorithm. To better balance the algorithm’s global exploration and local exploitation capabilities, we introduce the Harris Hawks Optimization to enhance TSA’s superior performance.
Harris hawks optimization is a meta-heuristic algorithm that simulates the collaborative behavior of a swarm of harris hawks during hunting. The process of solving complex problems using this algorithm can be divided into two stages: exploration and exploitation.
- (1) Exploration stage (|E|≥1)
When |E|≥1, the Harris hawk randomly inhabits in the solution space and waits for an opportunity to observe the prey. Under the perching strategy with equal probability 0.5, the mathematical model of the Harris hawk hunting behavior is:
(15)
Where
is the position of the prey rabbit at the x-th iteration;
is the center position of the Harris hawk flock at the x-th iteration;
is the random position of the Harris hawk at the x-th iteration; r and q are random numbers between [0,1], and lb and ub are the upper and lower bounds for solving the problem; E is the prey escape energy, and its equation is:
(16)
Where x is the current number of iterations; xmax is the maximum number of iterations of the algorithm; E0 is a random number between [–1,1], indicating the initialized energy value.
- (2) Exploitation stage (|E|<1)
When |E|<1, HHO implements four strategies of ‘soft encirclement’, ‘hard encirclement’, ‘fast dive soft encirclement’ and ‘fast dive hard encirclemen’ through random numbers to realize the Predation of prey rabbit.
- 1) Soft encirclement
When |E|≥0.5 and the random number is greater than or equal to 0.5, the Harris hawk executes the soft encirclement strategy, and its mathematical model is:
(17)
Where
,
; J is a random number between [0,2], indicating the jumping ability of prey rabbits.
- 2) Hard encirclement
When |E|<0.5 and the random number is greater than or equal to 0.5, Harris hawk executes a hard encirclement strategy, whose mathematical model is:
(18)
Where
.
- 3) Fast dive soft encirclement
When |E|≥0.5 and the random number is less than 0.5, that is, Harris Hawk raid failed, the algorithm executes random walk ; that is, to perform a fast dive soft encirclement strategy whose mathematical model is expressed as:
(19)
(20)
Where
; J is a random number between [0,2];
is a random vector; D is the problem dimension; LF is the Levy flight function.
- 4) Fast dive hard encirclement
When |E|<0.5 and the random number is less than 0.5, the Harris hawk performs a fast dive hard encirclement strategy whose mathematical model is expressed as:
(21)
Where
; J is a random number between [0,2].
To enhance the tunicate individual’s ability to escape local optima while maintaining improved convergence performance, the TSA algorithm incorporates the HHO algorithm. After the TSA algorithm obtains the optimal tunicate position through the improved strategy in Section 3.1, the HHO algorithm is introduced to further update the tunicate position, resulting in a better individual place. With the fusion of HHO and TSA algorithms, the MSHHOTSA performs a hybrid search optimization process that consists of two stages: exploration and exploitation.
- During the exploration stage, i.e., when |E|≥1, the TSA algorithm updates the optimal tunicate position. This stage primarily facilitates the optimization process of the TSA algorithm itself.
- In the exploitation stage, i.e., when |E|<1, the HHO algorithm updates the optimal tunicate position. Within this stage, the four strategies of the HHO algorithm are mainly employed to enhance the process of the current tunicate individual approaching the optimal tunicate individual.
In summary, the flowchart for the MSHHOTSA algorithm is presented in Fig 7.
3.3 Pseudo-code of the MSHHOTSA algorithm
Algorithm 1: Multi-Strategy Hybrid Harris Hawks Tunicate Swarm Optimization Algorithm (MSHHOTSA)
Input: Population size: N, Search space dimension: d, Maximum number of iterations: xmax
, lb, ub, Pmin, Pmax, c1,c2,c3,r = rand()
Output:
1: Initializing population
2: Generate hyperbolic tangent domain function values according to Eq (9) and Eq (10)
3: Generate the nonlinear convergence factor function values according to Eq (12) and Eq (13)
4: Calculate the fitness of each tunicate individual and get the current optimal tunicate individual
5: WHILE (x < xmax+1)
6: FOR1
7: FOR2
8: Using Eq (8) and Eq (16) to calculate the parameters and E
9: IF1 (|E|≥1)
10: IF2 (c3≥0.5)
11: Using Eq (6)-1 to calculate the position of the tunicate individual
12: ELSE
13: Using Eq (6)-2 to calculate the position of the tunicate individual
14: END IF2
15: Using Eq (14) to calculate the new tunicate individual position (TSA)
16: ELSEIF1 (|E|≥0.5 and r≥0.5)
17: Using Eq (17) to calculate the new tunicate individual position (HHO)
18: ELSEIF1 (|E|≥0.5 and r<0.5)
19: Using Eq (19) and Eq (20) to calculate the new tunic individual position (HHO)
20: ELSEIF1 (|E|<0.5 and r≥0.5)
21: Using Eq (18) to calculate the new tunicate individual position (HHO)
22: ELSEIF1 (|E|<0.5 and r<0.5)
23: Using Eq (21) to calculate the new tunicate individual position (HHO)
24: END IF1
25: END FOR2
26: Checking and fix the boundaries
27: Calculate the fitness value of each tunicate individual
28: Determine who is the better captive individual generated by TSA and HHO algorithms
29: Updating the optimal tunicate
30: END FOR1
31: x = x+1
32: END WHILE.
3.4 Computational complexity
This subsection primarily analyzes the time complexity and space complexity of the proposed MSHHOTSA algorithm in this paper.
3.4.1 Time complexity.
Similar to other population-based metaheuristic algorithms, the MSHHOTSA algorithm’s population initialization has a time complexity of O(N×d). Including the hyperbolic tangent domain and the non-linear convergence factor in MSHHOTSA necessitates a separate calculation of their function values before each iteration. Consequently, the time complexity for computing the fitness function of each individual in the population becomes . Where N represents the population size, d represents the search space dimension, and xmax represents the maximum number of iterations.
In conclusion, the total time complexity of MSHHOTSA algorithm is .
4. Experimental results and discussion
To assess the superior optimization performance of the proposed hybrid algorithm (MSHHOTSA) in solving complex functions, we conduct simulations and comparisons with seven other meta-heuristic algorithms (BOA, GWO, MVO, HHO, TSA, ASO, and WOA) using eight standard benchmark functions and the CEC2019 benchmark functions, while maintaining consistent basic parameters for each algorithm.
4.1 Experiments setup
- (1) Algorithm experimental environment
Operating system: 64-bit Windows 11
CPU: 12th Gen Intel(R) Core(TM) i5-12500H 2.50 GHz Memory: 8G
- (2) Parameter settings
In order to ensure the objective fairness of MSHHOTSA and other algorithms in comparative experiments, the basic parameters of each algorithm are set as shown in Table 1.
- (3) Benchmark functions
To demonstrate the superior performance of MSHHOTSA in solving complex functions, we conduct simulation experiments using 18 benchmark functions. The details of these benchmark functions can be found in Tables 2 and 3. Table 2 presents eight standard benchmark functions, while Table 3 lists the CEC2019 benchmark functions.
4.2 Result analysis of 8 benchmark functions
To evaluate the superior convergence and global search performance of MSHHOTSA, we selected four unimodal functions and four multimodal functions, subjecting them to the same conditions for analyzing the algorithm’s local exploitation and global exploration capabilities. The optimization results of the eight metaheuristics for the eight benchmark functions are presented in Table 4.
From Table 4, it is evident that under the same constraints:
- Considering the overall optimization results of the algorithm on eight benchmark functions, MSHHOTSA exhibits a more minor mean and standard deviation in most cases. This indicates that the improved algorithm demonstrates better convergence and optimization performance than other algorithms.
- Judging from the optimization results of the algorithm for unimodal functions (F1~F4): Compared to the other seven metaheuristic algorithms, MSHHOTSA achieves the best performance metrics (most minor mean and standard deviation) on three unimodal benchmark functions (F1, F2, and F4). Additionally, for the mean metric on F3, MSHHOTSA ranks fourth. However, there is no significant difference compared to the top-ranking algorithm, and MSHHOTSA exhibits better stability with a minor standard deviation. This indicates that MSHHOTSA has superior performance and stability. The experimental results of MSHHOTSA on the unimodal functions indicate its superior performance in local development.
- Judging from the optimization results of the algorithm for multimodal functions (F5~F8): It is evident that except for F8, where the optimization results of MSHHOTSA are not the best. The outcomes of the three functions (F5~F7) are significantly superior to those achieved by the other seven comparison algorithms. While the optimization result of the improved algorithm on F8 is only ranked 4th, an analysis of the optimization results of TSA, HHO, and MSAHHOTSA algorithms reveals that MSHHOTSA falls between HHO and TSA. This suggests that the performance adjustment using HHO optimization is effective for TSA. Consequently, considering the overall performance indicators of the four multimodal functions, MSHHOTSA demonstrates higher global exploration capabilities than the comparison algorithms.
To vividly compare and analyze the superiority of MSHHOTSA over the seven meta-heuristic algorithms, we selected two unimodal and two multimodal functions to plot the optimal convergence curves of each algorithm under 1000 iterations, as depicted in Fig 8. The results from Fig 8 indicate that MSHHOTSA exhibits a faster convergence speed and higher convergence accuracy compared to the five comparison algorithms in the optimization iteration process for both unimodal and multimodal functions. This optimization iteration curve verifies the improved algorithm’s superior optimization performance in solving complex functions.
4.3 Result analysis of CEC2019 benchmark functions
To further validate MSHHOTSA’s superior generalization performance in tackling complex functions, we conducted a comparative analysis of the optimized results using the CEC2019 benchmark functions with the same constraints. Table 5 shows the optimization results of each algorithm on CEC2019 benchmark functions.
From Table 5, under the same experimental conditions:
For MSHHOTSA, as a hybrid algorithm, its performance in terms of mean and standard deviation indicators is significantly superior to that of the HHO and TSA algorithms. This suggests that the hybrid algorithm effectively combines the advantages of HHO and TSA algorithms, leading to an overall performance enhancement.
Regarding the mean value indicators, MSHHOTSA demonstrates optimal performance on cec01, cec03, cec09, and cec10, ranking 3rd on cec02 and 4th on the remaining five benchmark functions. Similarly, concerning standard deviation indicators, the ranking of the MSHHOTSA algorithm on CEC2019 benchmark functions could be further improved. This indicates that no single algorithm can address all optimization problems. Therefore, when dealing with different optimization problems, one should consider the specific requirements and conduct comparative experiments to select a more suitable algorithm for solving them.
In conclusion, although the performance of the MSHHOTSA algorithm may require enhancement on certain benchmark functions, considering the overall ranking based on average value indicators, the MSHHOTSA algorithm still exhibits superior performance. This scalability implies that the algorithm has broader potential for application and can achieve excellent results in handling various optimization problems.
Fig 9 shows the convergence curves of eight algorithms on CEC2019 benchmark functions aimed at analyzing and exploring the convergence performance of the MSHHOTSA algorithm and other algorithms.
From Fig 9, under the same experimental conditions:
The MSHHOTSA algorithm achieved the best convergence accuracy on cec01, cec03, cec09, and cec10. The ASO algorithm performed best on cec02, cec05, and cec06. The GWO algorithm performed best on cec07 and cec08.
However, despite achieving the best convergence accuracy on specific functions, the MSHHOTSA algorithm does not exhibit the fastest overall convergence speed. This can be attributed to two main factors: (1) the MSHHOTSA algorithm is a hybrid of HHO and TSA algorithms, and it tends to emphasize global exploration in the early stages of the iteration, leading to slower algorithm convergence speed. (2) The complexity analysis in Subsection 3.4.1 reveals that the MSHHOTSA algorithm has a relatively higher time complexity than specific individual metaheuristic algorithms, leading to a slower convergence speed.
From Fig 9, it can also be observed that the performance of the MSHHOTSA algorithm shows minimal changes after 100 iterations. This phenomenon can be attributed to the following reasons: (1) The algorithm has already converged to the global optimum, leading to stable performance, as evident in the case of the cec01 function. (2) The global exploration capability of the algorithm is limited, causing it to get trapped in local optima. As a result, no larger step sizes facilitate escaping from the current local optima, as observed in cec02, cec06, and cec08. (3) The inherent complexity of the problem requires a more significant number of iterations for extensive global search in the solution space and gradual approximation towards the global optimum, as seen in cec03, cec05, cec09, and cec10.
In addition, Fig 9 illustrates that the optimization performance of the MSHHOTSA algorithm before the 100th iteration is suboptimal. This can be attributed to the following reasons:
- The initial population is not well-distributed. The effectiveness of any optimization algorithm, including MSHHOTSA, to a large extent, depends on the initial distribution of the population. When the initial population of MSHHOTSA is not well-distributed, the algorithm may become trapped in local optima and struggle to escape, thereby limiting its global search capability during the early iterations. Consequently, suboptimal performance is observed before the 100th iteration.
- The hybrid algorithm emphasizes more on global exploration in the early stages. MSHHOTSA combines different search strategies, so it tends to explore globally during the initial iterations to search for more potential solutions in the search space. However, this extensive global exploration hinders the algorithm from rapidly converging to the optimal solution.
- The hyperbolic tangent domain restricts the step size change of the algorithm, and the nonlinear fast convergence factor drives the algorithm to converge quickly. The hyperbolic tangent domain is used to correct the individual tunicate position and imposes a rule restriction on the step size change of the algorithm. This restriction causes the MSHHOTSA algorithm to move slowly in the search space. At the same time, the nonlinear fast convergence factor decreases rapidly, and the driving algorithm tends to develop locally, eventually leading to poor optimization performance of the MSHHOTSA algorithm in the early stage.
In the later stages of iteration, the nonlinear fast convergence factor shows the nonlinear increase and decrease fluctuations. Meanwhile, the hybrid algorithm and hyperbolic tangent domain continuously update new populations, improving the diversity of the population. Therefore, through cooperation and competition among the three improvement strategies, the MSHHOTSA algorithm can adjust its behavior at different stages, thus enhancing its overall optimization performance.
4.4 Result analysis of the algorithm running time
In assessing the algorithm’s performance, it demonstrates improved accuracy and faster convergence in the curve. These outcomes signify superior optimization performance within numerical theory when addressing the problem. However, it is essential to note that as any algorithm’s complexity increases, its optimization performance may also be somewhat enhanced. Therefore, it is significant to investigate the algorithm’s specific running time when tackling complex problems to evaluate its practical applicability effectively.
To verify whether MSHHOTSA exhibits a faster runtime and better optimization performance, the runtimes of each algorithm were recorded while solving 18 benchmark functions in 30 experiments. The corresponding average runtimes of the algorithms are illustrated in Fig 10. Specifically, Fig 10(A) represents the average running time of each algorithm on the eight benchmark functions. At the same time, Fig 10(B) displays the average running time of each algorithm on the CEC2019 benchmark functions.
Fig 10(A) shows that when solving the F1 benchmark function, all eight metaheuristic algorithms exhibit the shortest runtime when solving other benchmark functions. Additionally, the ASO algorithm performs the worst among these eight algorithms, while the WOA algorithm demonstrates the best performance. Notably, our proposed MSHHOTSA algorithm ranks third in runtime among the eight algorithms. Similarly, when considering the CEC2019 benchmark functions, the ASO algorithm still performs poorly, and the WOA algorithm remains the best. Our proposed MSHHOTSA algorithm ranks fifth in runtime among the eight algorithms.
From the above results, it can be observed that the MSHHOTSA algorithm does not show significant differences in runtime when solving the 18 benchmark functions. This can be attributed to the integration of the three improvement strategies. Despite improving the algorithm’s accuracy, these strategies contribute to its increased computational complexity, resulting in longer runtime. Nevertheless, the superior performance of MSHHOTSA over other algorithms on certain benchmark functions may be influenced by the computer’s operating conditions and random numbers. It is worth noting that, compared to the ASO algorithm, the MSHHOTSA algorithm exhibits faster runtime.
4.5 Result analysis of the Wilcoxon’s rank sum test
The mean and standard deviation obtained by solving the benchmark function through 30 independent experiments can confirm the improved algorithm’s overall better optimization performance. However, it cannot determine the significance of the running results for each algorithm. To comprehensively showcase the superior performance of MSHHOTSA, Wilcoxon’s rank sum test is conducted at a 5% significance level from a statistical perspective [69, 70], and the p-value is calculated. The test results are presented in Table 6, where MSHHOTSA is compared with other algorithms. The symbols “+”, “-”, and “=” indicate that the improved algorithm performs better than, worse than, or equivalently to the comparison algorithm, respectively. “N/A” denotes “not applicable”, signifying no significant performance difference is observed between the two algorithms.
Table 6 shows that MSHHOTSA has more “+” occurrences than other metaheuristic algorithms, indicating statistically significant differences between MSHHOTSA and all competing algorithms. Furthermore, MSHHOTSA performs better on benchmark functions marked with “+”. Conversely, there are more “=” when comparing MSHHOTSA with the BOA algorithm, suggesting no statistically significant difference between the two algorithms on benchmark functions marked with “=“. In particular, on the cec09 benchmark function, MSHHOTSA exhibits “-” when compared to the MVO algorithm, indicating inferior performance on cec09 compared to MVO. However, considering the overall performance, MSHHOTSA consistently displays better results. Hence, from a statistical standpoint, the MSHHOTSA algorithm demonstrates better statistical significance than other algorithms, highlighting its superior optimization convergence and robustness.
4.6 Discussion
Based on the experimental results from Sections 4.2 to 4.5, we can conclude that, overall, the MSHHOTSA algorithm demonstrates better optimization performance in solving eight standard benchmark functions and CEC2019 benchmark functions. This is reflected in smaller average values, standard deviations, and higher overall ranking indicators. It indicates that the MSHHOTSA algorithm performs well in solving multiple optimization problems, and its advantages are consistently demonstrated. Furthermore, smaller Wilcoxon rank sum test p-values also validate the superior statistical performance of MSHHOTSA.
However, it is worth noting that when we analyze the performance of the MSHHOTSA algorithm separately for each benchmark function, we find that the algorithm does not consistently achieve the best performance on every benchmark function. Below, we will provide a detailed analysis of the main reasons leading to the suboptimal performance of the MSHHOTSA algorithm on certain benchmark functions. In future research, readers can use these shortcomings to improve the algorithm’s performance.
- Adding the hyperbolic tangent domain and the nonlinear fast convergence factor has increased algorithm complexity, decreasing the algorithm’s convergence speed. While these three new improvement strategies enable the MSHHOTSA algorithm to achieve better convergence accuracy on certain benchmark functions, they also come at the cost of increased algorithm complexity, leading to a decrease in the convergence speed of MSHHOTSA.
- The two TSA and HHO algorithms are mixed, making the hybrid algorithm more inclined to global exploration. The MSHHOTSA algorithm introduces the population update mechanism of the HHO algorithm into the TSA algorithm, which increases the diversity of the new population and promotes the algorithm to explore further solutions, but also limits the local mining performance of MSHHOTSA.
- The nonlinear fast convergence factor prevents the algorithm from quickly converging towards local exploitation in the later iteration stages. As observed from Fig 6, our proposed nonlinear fast convergence factor exhibits fluctuations in the middle and later stages of algorithm iteration. This behavior causes the algorithm to continue jumping around the global optimal solution even after finding it, leading to a suboptimal convergence speed of MSHHOTSA in the later stages.
- The combined effect of the hyperbolic tangent domain and the nonlinear fast-convergence factor makes it challenging for MSHHOTSA to escape local optima in the early stages of iteration. Introducing the hyperbolic tangent domain restricts the step size change of the MSHHOTSA algorithm, leading to slow movement in the search space. Simultaneously, the rapid decrease of our proposed nonlinear fast-convergence factor drives the algorithm towards local exploitation, ultimately causing MSHHOTSA to struggle in escaping local optima in the early stages of iteration.
Although the proposed MSHHOTSA algorithm still has many deficiencies, the coin has two sides, and scientific research is no exception. For the MSHHOTSA algorithm, if we unthinkingly pursue the excellent performance of the experimental results, we can also choose multiple sets of benchmark functions for experiments and finally select functions with good optimization results and put them in the paper’s experimental results. However, it is unfair and unscientific to select functions with good optimization results unthinkingly and put them in the experimental results. This also enlightens us that when researching algorithms, we should not only focus on the shortcomings of the algorithm but also discover the shining points of the algorithm. Whether it is the advantages or disadvantages of the algorithm, as long as we conduct a thorough analysis and discussion, we can slowly eliminate its shortcomings in the following research and promote the spiral performance of the algorithm we propose.
In conclusion, although the MSHHOTSA algorithm still has certain limitations when solving specific problems, it successfully addresses certain targeted issues. This indicates that our proposed three improvement strategies possess unique merits in enhancing algorithm performance. Thus, when refining other metaheuristic algorithms, these strategies can serve as valuable references for improvement.
Furthermore, when solving real-world optimization problems, conducting experiments with multiple comparative algorithms is essential. Doing so allows us to select the most suitable parameters and identify the algorithm that yields the best results for the given problem. This comprehensive approach will contribute to achieving optimal solutions in practical optimization scenarios.
5. MSHHOTSA for engineering optimization problems
Engineering optimization problems are objective optimization models commonly used in scientific and engineering applications to address real-world engineering challenges. Due to their nonlinear and strongly constrained characteristics, finding effective solutions becomes crucial in evaluating algorithm performance in practical scenarios. To assess the feasibility and applicability of the MSHHOTSA algorithm in solving engineering optimization problems, we consider three optimization problems [3, 8, 71, 72]: the tension/compression spring design problem, the pressure vessel design problem, the gear train design problem, the speed reducer design problem, and the parameters optimization of the proportional-integral-derivative (PID) controller. The algorithm’s performance is thoroughly investigated in these cases. Each algorithm is tested with a population size of 30, a maximum of 1000 iterations, and each set of experiments is conducted independently 30 times.
5.1 Tension/Compression spring design problem
The optimization objective of the extension/compression spring design problem is to minimize the spring mass [8, 71]. The topology of the problem is shown in Fig 11. In this problem, the depreciation of the spring mass, i.e., the optimization objective of the problem, is constrained by the minimum deviation, shear stress, impact frequency, outer diameter limit, and three decision variables: the average coil diameter D, the wire diameter d, and the number of active coils P.
Let ,
is the mass of the spring, then the mathematical model of the extension/compression spring design problem can be described as follows.
(22)
(23)
Where x1∈[0.05,2], x2∈[0.25,1.3], x3∈[2,15].
Table 7 and Fig 12 show the best-finding results of the six meta-heuristic algorithms for the extension/compression spring design problem under 30 independent experiments and the convergence curves of the finding for each algorithm in solving the problem, respectively.
From Table 7, the optimal solution of MSHHOTSA for the same constraints is with the optimal value of
, which shows that MSHHOTSA is the best solution for reducing the mass of the extension/compression spring compared to the other compared algorithms. It is also clear from the analysis in Fig 12 that MSHHOTSA has a better optimization performance and a faster convergence rate when solving the tension/compression spring design problem.
5.2 Pressure vessel design problem
The optimization objective of the pressure vessel design problem is to minimize the total cost of fabricating the pressure vessel (materials, shaping, and welding) [8, 71]. The structural topology of the problem is shown in Fig 13. In this problem, the minimization of the fabrication cost, i.e., the optimization objective of the problem, is jointly influenced by four decision variables: the length of the interface of the cylindrical section L, the radius of entry R, the thickness of the shell Ts, and the thickness of the head Th.
Let ,
is the total cost of making the pressure vessel, then the mathematical model of the pressure vessel design problem is described as:
(24)
(25)
Where x1∈[0,99], x2∈[0,99], x3∈[10,200], x4∈[10,200].
Table 8 and Fig 14 show the best-finding results of the six metaheuristic algorithms for the pressure vessel design problem under 30 independent experiments and the convergence curves of the finding for each algorithm in solving the problem, respectively.
As shown in Table 8, under the same conditions, the MSHHOTSA achieves a smaller pressure vessel design production cost than the other five compared algorithms; also, the convergence curve in Fig 14 shows that the improved algorithm has a faster convergence speed and the ability to escape local extremes in solving pressure vessel design problems, which again shows the superior performance of MSHHOTSA in solving engineering problems. This again shows the superior performance of MSHHOTSA in solving engineering problems.
5.3 Gear train design problem
The optimization objective of the gear train design problem is to minimize the gear transmission ratio. The corresponding topological diagram for this problem is shown in Fig 15 [8]. In this context, Ta, Tb, Td, and Tf represent the number of teeth on four distinct gears, serving as the four significant decision variables that determine the gear transmission ratio. The gear ratio is given as Tb/Ta⋅Td/Tf.
Let ,
represents the optimal performance of the transmission ratio. Then the mathematical model of the gear train design problem is described as:
(26)
Where x1∈[12,60], x2∈[12,60], x3∈[12,60], x4∈[12,60].
Table 9 presents the optimization results of the gear train design problem using six metaheuristic algorithms, including MSHHOTSA. According to the table, both MSHHOTSA and HHO have achieved the optimal gear transmission ratio with an objective function value of . However, the optimal design parameters obtained by these two algorithms differ. MSHHOTSA identifies the optimal design parameter as
, whereas HHO identifies
. This discrepancy implies that various gear combinations can lead to the best gear transmission ratio. Consequently, in practical engineering problems, it becomes essential not only to consider optimizing the transmission ratio but also to select an appropriate gear combination based on the actual cost of each gear.
5.4 Speed reducer design problem
The primary optimization objective of the speed reducer design problem is the minimization of the total weight of the speed reducer. The corresponding topological diagram depicting the system’s configuration is presented in Fig 16 [72]. In this particular problem, seven essential decision variables play a crucial role in determining the overall weight of the speed reducer. These variables encompass the gear face width, denoted as b, the gear module, represented by m, the number of teeth on the pinion gear, denoted as p, the length of the first shaft between bearings, designated as l1, the length of the second shaft between bearings, denoted as l2, the diameter of the first shaft, specified as d1, and the diameter of the second shaft, identified as d2. Collectively, these variables are succinctly represented as the vector . Moreover, the function
signifies the total weight of the speed reducer, thereby encapsulating the overall essence of the design optimization. The mathematical model that governs the speed reducer design problem can be explicitly expressed through Eqs (27) and (28).
(27)
(28)
Where x1∈[2.6,3.6], x2∈[0.7,0.8], x3∈[17,28], x4∈[7.3,8.3]. x5∈[7.8,8.3], x6∈[2.9,3.9], x7∈[5.0,5.5].
Table 10 presents the optimal solutions obtained through the utilization of six metaheuristic algorithms, which include MSHHOTSA, to address the speed reducer design problem. As per the data showcased in Table 10, within the confines of the same experimental conditions, the MSHHOTSA algorithm has successfully attained the optimal design solution, leading to the minimization of the total weight of the speed reducer. The associated optimal design parameters are denoted as , and the corresponding optimal objective function value stands at
. This significant achievement points towards the MSHHOTSA algorithm’s remarkable optimization capability when it comes to addressing the speed reducer design problem, underscoring its superior effectiveness in identifying the optimal solution.
5.5 Parameters optimization of proportion integral derivative controller
In general, a PID controller consists of three main units: the proportional unit (P), the integral unit (I), and the differential unit (D). Its primary objective is to devise a control strategy based on the deviation between the actual value of the controlled object and the desired value. Subsequently, the controller stabilizes the closed-loop control system through parameter optimization, thereby achieving the ultimate control objective [3, 15]. Fig 17 illustrates the execution principle of the PID controller.
In the figure, rin(t) is the system input signal, yout(t) is the system output signal, and e(t) is the system error. From Fig 16, the transfer function of the PID controller is expressed as:
(29)
Where Kp is the proportion factor, Ki is the integration factor, Kd is the derivative factor, and e(t) is the systematic error.
To verify the optimization performance of MSHHOTSA for PID parameters, the second-order delay system in the literature [3] was used as a simulation example and numerical experiments were conducted.
(30)
where G(s) is the transfer function and s represents the continuous system. Then the objective function is expressed as:
(31)
where e(t)<0 represents the error between the system input and output; u(t) represents the system output signal, ω3|e(t)| is the overshoot item; ω1, ω2, ω3 is the weight value, the range is between [0, 1], and ω3>>ω1.
To optimize the PID controller, we set the initial population size of the algorithm to 30, and the maximum number of iterations is 500. The input signal is a unit step signal, and the sampling time is 0.001s. Additionally, the search range for the PID parameters Kp, Ki, and Kd is defined as [0,50]. With these settings, we obtained the parameter optimization results for each algorithm, as illustrated in Figs 18 and 19.
From the iterative convergence curves of the six algorithms, it is evident that MSHHOTSA exhibits faster convergence compared to the other five comparative algorithms. This observation signifies that MSHHOTSA demonstrates superior convergence performance in finding the best solution. Additionally, the step response signal output curves in Fig 18 show that MSHHOTSA has smaller overshoot and adjustment time when compared to the comparison algorithms. This further supports the conclusion that MSHHOTSA outperforms the comparison algorithms in terms of system stability.
5.6 Discussion
In this section, we conducted tests on five practical engineering applications to evaluate the optimization performance of the MSHHOTSA algorithm and obtained experimental results. These experimental results demonstrate that MSHHOTSA achieved the best optimization for all five practical engineering applications under the same experimental conditions. This further validates the stronger practicality and superiority of MSHHOTSA in addressing real-world engineering optimization problems, showcasing its robustness.
The experimental results strongly support the successful application of the MSHHOTSA algorithm in practical engineering scenarios. However, it was observed during the experiments that excellent initial values remain crucial in ensuring the rapid convergence of the MSHHOTSA algorithm. For specific engineering optimization problems, MSHHOTSA tends to gradually approach the optimal solution from the boundary conditions, resulting in slower convergence speed in the early iterations. Different combinations of parameters in various metaheuristic algorithms may lead to the same optimal results when solving real-world engineering problems.
Therefore, when using the MSHHOTSA algorithm to solve engineering optimization problems, it is beneficial to employ some simple methods to obtain initial values for the problem. This approach can effectively improve the convergence performance of the MSHHOTSA algorithm. Additionally, when different parameter combinations yield the same optimal results in practical engineering applications, it is essential to introduce additional constraints based on the specific problem to select the most suitable algorithm.
In conclusion, despite limitations, the MSHHOTSA algorithm’s outstanding performance in solving the five engineering optimization problems offers valuable insights for enhancing and optimizing other metaheuristic algorithms. In practical applications, we can leverage the strengths of the MSHHOTSA algorithm and combine them with other improvement measures to further enhance its performance and applicability.
6. Conclusion and future works
This paper proposes a novel hybrid algorithm called “Multi-Strategy Tunicate Swarm Algorithm with Hybrid Harris Optimization” (MSHHOTSA). The inspiration for this method comes from observing the positional movements of tunicate swarms and Harris hawks during their cooperative hunting in nature. Also, we drew inspiration from the neighborhood and heat map distribution concepts. In this study, we employed various improvement strategies. These strategies involved hyperbolic tangent domain modification for individual positions within the tunicate swarm, updating the non-linear convergence factor to influence the collective behavior of the swarm, and integrating a hybrid Harris Hawks optimization algorithm to update the population’s positions. To evaluate the optimization performance of MSHHOTSA, we used eight standard benchmark functions and the CEC2019 benchmark functions and compared it against seven well-known metaheuristic benchmark functions. Additionally, we tested the applicability of MSHHOTSA on five real-world engineering problems and conducted comprehensive evaluations by comparing its performance against five other metaheuristic algorithms.
MSHHOTSA exhibits superior optimization performance when solving benchmark functions under the same experimental conditions, as indicated by smaller means, standard deviations, and higher overall rankings. Moreover, the convergence curves of MSHHOTSA for 18 benchmark functions further validate its ability to escape local optima and display improved convergence performance during the iterative process. The algorithm’s runtime results also confirm the faster convergence speed of MSHHOTSA. The statistical significance of MSHHOTSA has been verified through the Wilcoxon rank-sum test. Finally, the application results on five real-world engineering problems demonstrate MSHHOTSA’s superior convergence accuracy and global optimization ability. Compared to other experimental algorithms in this paper, MSHHOTSA showcases higher competitiveness.
In the future, we intend to develop specific single-objective optimization frameworks using the improved algorithm and utilize them to address challenges in feature selection and image segmentation. Moreover, we will strive to introduce novel multi-objective optimization algorithms based on the enhanced algorithm to tackle complex multi-objective optimization problems. These investigations will significantly broaden the application scope of our algorithm across various domains while also elevating its overall effectiveness and performance.
References
- 1. Liu W, Guo Z, Jiang F, Liu G, Wang D, Ni Z. Improved WOA and its application in feature selection. PLOS ONE. 2022;17: e0267041. pmid:35588402
- 2.
Zhiqing GUO. Research on Feature Selection Method Based on Improved Whale Optimization Algorithm. Master’s degree, Liaoning Technical University. 2022. https://doi.org/10.27210/d.cnki.glnju.2022.000421
- 3. Liu W, Guo Z, Jiang F, Liu G, Jin B, Wang D. Improved grey wolf optimizer based on cooperative attack strategy and its PID parameter optimization. Journal of Frontiers of Computer Science and Technology. 2023;17: 620–634.
- 4. Whitley D. A genetic algorithm tutorial. Statistics and computing. 1994;4: 65–85.
- 5. Katoch S, Chauhan SS, Kumar V. A review on genetic algorithm: past, present, and future. Multimedia tools and applications. 2021;80: 8091–8126. pmid:33162782
- 6. Dorigo M, Birattari M, Stutzle T. Ant colony optimization. IEEE computational intelligence magazine. 2006;1: 28–39.
- 7. Wang L, Cao Q, Zhang Z, Mirjalili S, Zhao W. Artificial rabbits optimization: A new bio-inspired meta-heuristic algorithm for solving engineering optimization problems. Engineering Applications of Artificial Intelligence. 2022;114: 105082.
- 8. Mirjalili S, Mirjalili SM, Lewis A. Grey Wolf Optimizer. Advances in Engineering Software. 2014;69: 46–61.
- 9. Saremi S, Mirjalili S, Lewis A. Grasshopper optimisation algorithm: theory and application. Advances in engineering software. 2017;105: 30–47.
- 10. Mirjalili S, Mirjalili SM, Hatamlou A. Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Computing and Applications. 2016;27: 495–513.
- 11. Arora S, Singh S. Butterfly optimization algorithm: a novel approach for global optimization. Soft Computing. 2019;23: 715–734.
- 12. Heidari AA, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H. Harris hawks optimization: Algorithm and applications. Future generation computer systems. 2019;97: 849–872.
- 13. Zhao W, Wang L, Zhang Z. Atom search optimization and its application to solve a hydrogeologic parameter estimation problem. Knowledge-Based Systems. 2019;163: 283–304.
- 14. Mirjalili S, Lewis A. The whale optimization algorithm. Advances in engineering software. 2016;95: 51–67.
- 15.
Altan A. Performance of metaheuristic optimization algorithms based on swarm intelligence in attitude and altitude control of unmanned aerial vehicle for path following. 2020 4th international symposium on multidisciplinary studies and innovative technologies (ISMSIT). IEEE; 2020. pp. 1–6.
- 16. Belge E, Altan A, Hacıoğlu R. Metaheuristic Optimization-Based Path Planning and Tracking of Quadcopter for Payload Hold-Release Mission. Electronics. 2022;11: 1208.
- 17. Yağ İ, Altan A. Artificial intelligence-based robust hybrid algorithm design and implementation for real-time detection of plant diseases in agricultural environments. Biology. 2022;11: 1732. pmid:36552243
- 18. Altan A, Karasu S, Bekiros S. Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques. Chaos, Solitons & Fractals. 2019;126: 325–336.
- 19. Karasu S, Altan A. Crude oil time series prediction model based on LSTM network with chaotic Henry gas solubility optimization. Energy. 2022;242: 122964.
- 20. Karasu S, Altan A, Bekiros S, Ahmad W. A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series. Energy. 2020;212: 118750.
- 21. Altan A, Karasu S, Zio E. A new hybrid model for wind speed forecasting combining long short-term memory neural network, decomposition methods and grey wolf optimizer. Applied Soft Computing. 2021;100: 106996.
- 22. Neumann A, Hajji A, Rekik M, Pellerin R. Genetic algorithms for planning and scheduling engineer-to-order production: a systematic review. International Journal of Production Research. 2023;0: 1–30.
- 23.
Kumar R, Memoria M, Chandel A. Performance analysis of proposed mutation operator of genetic algorithm under scheduling problem. 2020 International Conference on Intelligent Engineering and Management (ICIEM). IEEE; 2020. pp. 193–197.
- 24. Abdullah G, Hassan ZAH. Using of Genetic Algorithm to Evaluate Reliability Allocation and Optimization of Complex Network. IOP Conf Ser: Mater Sci Eng. 2020;928: 042033.
- 25. Xiaobo Y, Bin L, Shihai W. A Test Restoration Method based on Genetic Algorithm for effective fault localization in multiple-fault programs. Journal of Systems and Software. 2021;172: 110861.
- 26. Cui X, Yang J, Li J, Wu C. Improved genetic algorithm to optimize the Wi-Fi indoor positioning based on artificial neural network. IEEE Access. 2020;8: 74914–74921.
- 27. Jiang Q, Huang R, Huang Y, Chen S, He Y, Lan L, et al. Application of BP neural network based on genetic algorithm optimization in evaluation of power grid investment risk. IEEE Access. 2019;7: 154827–154835.
- 28.
Ayon SI. Neural network based software defect prediction using genetic algorithm and particle swarm optimization. 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT). IEEE; 2019. pp. 1–4.
- 29.
Tormozov VS, Zolkin AL, Vasilenko KA. Optimization of neural network parameters based on a genetic algorithm for prediction of time series. 2020 International Multi-Conference on Industrial Engineering and Modern Technologies (FarEastCon). IEEE; 2020. pp. 1–4.
- 30. Agwa AM, El-Fergany AA, Sarhan GM. Steady-state modeling of fuel cells based on atom search optimizer. Energies. 2019;12: 1884.
- 31. Mossa MA, Kamel OM, Sultan HM, Diab AAZ. Parameter estimation of PEMFC model based on Harris Hawks’ optimization and atom search optimization algorithms. Neural Computing and Applications. 2021;33: 5555–5570.
- 32. Too J, Abdullah AR. Chaotic atom search optimization for feature selection. Arabian Journal for Science and Engineering. 2020;45: 6063–6079.
- 33. Mafarja M, Aljarah I, Faris H, Hammouri AI, Al-Zoubi AM, Mirjalili S. Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Systems with Applications. 2019;117: 267–286.
- 34.
Nayar N, Ahuja S, Jain S. Swarm Intelligence for Feature Selection: A Review of Literature and Reflection on Future Challenges. In: Kolhe ML, Trivedi MC, Tiwari S, Singh VK, editors. Advances in Data and Information Sciences. Singapore: Springer; 2019. pp. 211–221. https://doi.org/10.1007/978-981-13-0277-0_18
- 35. Emary E, Zawbaa HM, Hassanien AE. Binary grey wolf optimization approaches for feature selection. Neurocomputing. 2016;172: 371–381.
- 36. Al-Tashi Q, Rais H, Jadid Abdulkadir S, Mirjalili S, Alhussian H. A Review of Grey Wolf Optimizer-Based Feature Selection Methods for Classification. 2020. pp. 273–286.
- 37. Mafarja M, Mirjalili S. Whale optimization approaches for wrapper feature selection. Applied Soft Computing. 2018;62: 441–453.
- 38. Sun P, Liu H, Zhang Y, Tu L, Meng Q. An intensify atom search optimization for engineering design problems. Applied Mathematical Modelling. 2021;89: 837–859.
- 39. Li Y, Wang H, Fan J, Geng Y. A novel Q-learning algorithm based on improved whale optimization algorithm for path planning. PLOS ONE. 2022;17: e0279438. pmid:36574399
- 40. Zhang S, Zhou Y, Li Z, Pan W. Grey wolf optimizer for unmanned combat aerial vehicle path planning. Advances in Engineering Software. 2016;99: 121–136.
- 41.
Tsai P-W, Nguyen T-T, Dao T-K. Robot Path Planning Optimization Based on Multiobjective Grey Wolf Optimizer. In: Pan J-S, Lin JC-W, Wang C-H, Jiang XH, editors. Genetic and Evolutionary Computing. Cham: Springer International Publishing; 2017. pp. 166–173. https://doi.org/10.1007/978-3-319-48490-7_20
- 42. Wolpert DH, Macready WG. No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation. 1997;1: 67–82.
- 43. Kaur S, Awasthi LK, Sangal AL, Dhiman G. Tunicate Swarm Algorithm: A new bio-inspired based metaheuristic paradigm for global optimization. Engineering Applications of Artificial Intelligence. 2020;90: 103541.
- 44. Houssein EH, Helmy BE-D, Elngar AA, Abdelminaam DS, Shaban H. An Improved Tunicate Swarm Algorithm for Global Optimization and Image Segmentation. IEEE Access. 2021;9: 56066–56092.
- 45. Awari H, Subramani N, Janagaraj A, Balasubramaniapillai Thanammal G, Thangarasu J, Kohar R. Three-dimensional dental image segmentation and classification using deep learning with tunicate swarm algorithm. Expert Systems. n/a: e13198.
- 46. Akdağ O. A Modified Tunicate Swarm Algorithm for Engineering Optimization Problems. Arab J Sci Eng. 2023 [cited 24 Jul 2023].
- 47. Rizk-Allah RM, Saleh O, Hagag EA, Mousa AAA. Enhanced Tunicate Swarm Algorithm for Solving Large-Scale Nonlinear Optimization Problems. Int J Comput Intell Syst. 2021;14: 189.
- 48. Rizk-Allah RM, Hagag EA, El-Fergany AA. Chaos-enhanced multi-objective tunicate swarm algorithm for economic-emission load dispatch problem. Soft Comput. 2023;27: 5721–5739.
- 49. El-Sehiemy RA. A novel single/multi-objective frameworks for techno-economic operation in power systems using tunicate swarm optimization technique. J Ambient Intell Human Comput. 2022;13: 1073–1091.
- 50. Fetouh T, Elsayed AM. Optimal Control and Operation of Fully Automated Distribution Networks Using Improved Tunicate Swarm Intelligent Algorithm. IEEE Access. 2020;8: 129689–129708.
- 51. S. K, Sudha LR, Navaneetha Krishnan M. Water cycle tunicate swarm algorithm based deep residual network for virus detection with gene expression data. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2023;0: 1–11.
- 52. Wankhede J, Sambandam P, Kumar M. Effective prediction of heart disease using hybrid ensemble deep learning and tunicate swarm algorithm. J Biomol Struct Dyn. 2022;40: 13334–13345. pmid:34661512
- 53. Li L-L, Liu Z-F, Tseng M-L, Zheng S-J, Lim MK. Improved tunicate swarm algorithm: Solving the dynamic economic emission dispatch problems. Applied Soft Computing. 2021;108: 107504.
- 54. Cui Y, Shi R, Dong J. CLTSA: A Novel Tunicate Swarm Algorithm Based on Chaotic-Lévy Flight Strategy for Solving Optimization Problems. Mathematics. 2022;10: 3405.
- 55. Zhang Y, He Q, Yang L, Liu C. An Improved Tunicate Swarm Algorithm for Solving the MultiObjective Optimisation Problem of Airport Gate Assignments. Applied Sciences. 2022;12: 8203.
- 56. Sharma A, Sharma A, Dasgotra A, Jately V, Ram M, Rajput S, et al. Opposition-based tunicate swarm algorithm for parameter optimization of solar cells. IEEE Access. 2021;9: 125590–125602.
- 57.
Houssein EH, Saber E, Ali AA, Wazery YM. Opposition-based learning tunicate swarm algorithm for biomedical classification. 2021 17th International Computer Engineering Conference (ICENCO). IEEE; 2021. pp. 1–6.
- 58. Wang J, Wang S, Li Z. Wind speed deterministic forecasting and probabilistic interval forecasting approach based on deep learning, modified tunicate swarm algorithm, and quantile regression. Renewable Energy. 2021;179: 1246–1261.
- 59.
Jui JJ, Ahmad MA, Rashid MIM. Levy Tunicate Swarm Algorithm for Solving Numerical and Real-World Optimization Problems. Proceedings of the 6th International Conference on Electrical, Control and Computer Engineering: InECCE2021, Kuantan, Pahang, Malaysia, 23rd August. Springer; 2022. pp. 417–427.
- 60.
Rizk-Allah RM, Saleh O, Hagag EA, Hassanien AE. Modified Tunicate Swarm Algorithm for Nonlinear Optimization Problems. Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2021. Springer; 2022. pp. 366–381.
- 61. Arabali A, Khajehzadeh M, Keawsawasvong S, Mohammed AH, Khan B. An adaptive tunicate swarm algorithm for optimization of shallow foundation. IEEE Access. 2022;10: 39204–39219.
- 62. Gharehchopogh FS. An improved tunicate swarm algorithm with best-random mutation strategy for global optimization problems. Journal of Bionic Engineering. 2022;19: 1177–1202.
- 63. Sudha MN, Balamurugan V, Lai W-C, Divakarachari PB. Sustainable Multipath Routing for Improving Cross-Layer Performance in MANET Using an Energy Centric Tunicate Swarm Algorithm. Sustainability. 2022;14: 13925.
- 64. Abdolinejhad F, Khayati GR, Raiszadeh R, Yaghoobi NS, Khorasani SMJ. An improved optimization model for predicting Pb recovery efficiency from residual of liberator cells: a hybrid of support vector regression and modified tunicate swarm algorithm. Journal of Material Cycles and Waste Management. 2021;23: 1855–1872.
- 65. Chouhan N, Jain SC. Tunicate swarm Grey Wolf optimization for multi-path routing protocol in IoT assisted WSN networks. Journal of Ambient Intelligence and Humanized Computing. 2020; 1–17.
- 66. Doraiswami PR, Sarveshwaran V, Swamidason ITJ, Sorna SCD. Jaya‐tunicate swarm algorithm based generative adversarial network for COVID‐19 prediction with chest computed tomography images. Concurrency and Computation: Practice and Experience. 2022;34: e7211. pmid:35945987
- 67. Daniel J, Francis SFV, Velliangiri S. Cluster head selection in wireless sensor network using tunicate swarm butterfly optimization algorithm. Wireless Networks. 2021;27: 5245–5262.
- 68.
Yu C, Huang H, Wei X. Tunicate Swarm Algorithm Based Difference Variation Flower Pollination Algorithm. International Conference on Intelligent Computing. Springer; 2022. pp. 80–96.
- 69. de Barros RSM, Hidalgo JIG, de Lima Cabral DR. Wilcoxon rank sum test drift detector. Neurocomputing. 2018;275: 1954–1963.
- 70.
Wilcoxon F. Individual Comparisons by Ranking Methods. In: Kotz S, Johnson NL, editors. Breakthroughs in Statistics: Methodology and Distribution. New York, NY: Springer; 1992. pp. 196–202. https://doi.org/10.1007/978-1-4612-4380-9_16
- 71. Coello CAC. Use of a self-adaptive penalty approach for engineering optimization problems. Computers in Industry. 2000;41: 113–127.
- 72. Zhao W, Wang L, Zhang Z. Artificial ecosystem-based optimization: a novel nature-inspired meta-heuristic algorithm. Neural Comput & Applic. 2020;32: 9383–9425.