Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Hybrid accelerated iterative scheme based on the Picard–Ishikawa approach for systems of nonlinear equations

  • Abubakar Sani Halilu,

    Roles Methodology, Writing – original draft

    Affiliations Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Campus Besut, Terengganu, Malaysia, Department of Mathematics, Sule Lamido University Kafin Hausa, Kafin Hausa, Nigeria

  • Hatem E. Semary,

    Roles Funding acquisition, Resources

    Affiliation Department of Mathematics and Statistics, Faculty of Science, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia

  • Mohamad Afendee Mohamed ,

    Roles Formal analysis, Investigation, Supervision

    mafendee@unisza.edu.my

    Affiliation Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Campus Besut, Terengganu, Malaysia

  • Asmaa S. Al-Moisheer,

    Roles Funding acquisition, Writing – review & editing

    Affiliation Department of Mathematics and Statistics, Faculty of Science, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia

  • Kabiru Ahmed,

    Roles Conceptualization, Data curation

    Affiliation Department of Mathematics, Federal University, Dutse, Nigeria

  • Sulaiman M. Ibrahim,

    Roles Validation, Visualization, Writing – review & editing

    Affiliation College of Applied and Health Sciences, A’Sharqiyah University, Ibra, Sultanate of Oman

  • Mohammed Yusuf Waziri,

    Roles Investigation, Supervision

    Affiliation Department of Mathematical Sciences, Bayero University, Kano, Nigeria

  • Arunava Majumder

    Roles Conceptualization, Supervision, Visualization

    Affiliation Department of Mathematics, College of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu, India

Abstract

Systems of nonlinear equations arise in numerous scientific, engineering, and optimization applications, where efficient and reliable numerical methods are required to obtain accurate solutions. Hybridization techniques have recently attracted considerable attention because of their ability to improve the convergence behavior of iterative schemes. Motivated by this development, this paper proposes a novel hybrid accelerated iterative method for solving systems of nonlinear equations by integrating the Picard–Ishikawa process with an accelerated derivative-free framework. The proposed approach employs a diagonal approximation of the Jacobian matrix through an acceleration parameter, thereby reducing computational cost while maintaining numerical accuracy. The novelty of the method lies in combining the three-step Picard–Ishikawa process with an accelerated scheme to enhance convergence performance and robustness. Under standard assumptions, the global convergence of the proposed method is established. Extensive numerical experiments on a collection of benchmark problems demonstrate that the proposed method outperforms several existing approaches in terms of iteration count, computational time, and robustness. These results confirm the effectiveness and suitability of the proposed scheme for solving large-scale systems of nonlinear equations arising in practical applications.

1. Introduction

The application of numerical optimization plays an important role in real life. In technology, it is used for making a design and control system [1]. In finance and economics, portfolio selection, risk management, and supply chain logistics rely heavily on these techniques [2]. In health care, its applications include treatment planning in radiation therapy, drug discovery, and medical imaging. It also has applications in energy management, such as optimal power flow in smart grids and the placement of renewable energy systems. Furthermore, in everyday technologies, it is applied in navigation systems, scheduling, and personalized recommendation engines. These real-life applications display the importance of numerical optimization.

Systems of nonlinear equations are one of the basic components of numerical optimization that play a crucial role in a wide range of disciplines, including science and engineering. These equations can model complex phenomena such as fluid dynamics, population, and growth. Given the difficulty in finding exact solutions, researchers often opt for efficient iterative approaches for their approximate solutions that quickly converge accurately, allowing scientists to analyse and predict behaviours in various systems effectively [35]. A system of nonlinear equations can be represented as follows:

(1)

where is a nonlinear mapping.

The global optimization problem can be derived from (1) [6]. Let be a merit function defined by:

(2)

In this context, the problem of solving the nonlinear Equations (1) is analogous to the following global optimization problem:

(3)

Investigators employ several iterative approaches to problem (1), like Newton’s method [7], quasi-Newton methods [8,9], conjugate gradient methods [10,11], accelerated methods [1214], double direction methods [1518], and double step length methods [1922].

Newton’s approach is notable for its appealing characteristics, including simplicity of implementation and rapid convergence. However, the Jacobian matrix can be computed and stored at each iteration. These approaches use the recursive formula to construct a sequence of points:

(4)

where is the step length, is the search direction, and the current and the previous iterations are and , respectively. Below is the search direction of Newton’s approach:

where is the Jacobian of at . One of the main limitations of Newton’s method is its reliance on the Jacobian matrix and its inverse, which must be computed at each iteration. However, the Jacobian may not always be available in closed form or can be expensive and imprecise to evaluate, making the direct application of Newton’s method infeasible in such cases. The calculation of the Jacobian at each iteration makes Newton’s method less applicable for large-scale problems, as they necessitate notable matrix storage, which can be costly in numerical experiments. To address these issues, matrix-free methods have been proposed. For instance, the accelerated gradient method [23] is one of the matrix-free methods for finding the minimizer in (3). The presented method approximated the Hessian matrix via , where, I is an identity matrix, and are the acceleration parameter and the Hessian matrix of , respectively.The rationale of any accelerated method is to develop an effective acceleration parameter. Moreover, in [23], the proposed was derived using the second-order Taylor expansion. Petrovi and Stanimirovi [24] made significant contributions to the field of unconstrained optimisation. Their innovative approach uses an acceleration parameter to create an approximation of the Hessian matrix. The approach in [24] is the extension of the gradient method in [23] by adding the second correction defined as in (4) to it. Here is the second search direction. The numerical experiments presented in [24] outperformed the one in [23]. In another development, Petrovi [25] introduced a novel double-step length approach by replacing the second correction in [24] with , where is the second step length.

Motivated by the accelerated methods presented for solving (3), several investigators have incorporated this idea to address problem (1) by approximating the Jacobian through . Employing the first-order Taylor expansion, the acceleration parameter was derived. Building on this idea, Halilu and Waziri [15] invented an accelerated scheme for addressing (1). Thereafter, a modified version of the method [15] was developed in [16]. By assuming that the Jacobian is positive definite and bounded, their study establishes that the proposed method exhibits global convergence. Abdullahi et al. [10] improved the basic methodology from [15] by a conjugate gradient approach for symmetric nonlinear equations. The line search method by Li and Fukushima [6] was employed to achieve global convergence. This innovation represents a significant improvement in the efficiency and applicability for addressing (1). Authors in [18] present another accelerated method for solving (1). The proposed acceleration demonstrates the efficacy of the proposed method in proving global convergence. The extensive numerical results contribute to the ongoing development of robust techniques for solving (1) in an accelerated derivative-free way.

On the other hand, hybrid schemes play a vital role in enhancing the convergence of some iterative methods. As a result, to improve the convergence characteristics and overall numerical efficiency of the accelerated methods, Petrovi et al. [26] studied a hybrid approach that integrates it with the Picard-mann hybrid process presented by Khan in [27]. This idea combines the qualities of both schemes, leading to the performance in solving various unconstrained optimisation problems. The work presented in [26] enhanced the performance of the numerical method of the approach in [24] via the correction parameter. Waziri et al. [12] developed a hybrid method for solving (1) by combining [27] and [19], resulting in the effective acceleration parameter. This advancement demonstrates the benefits of combining multiple schemes to improve overall efficiency in hybrid systems. Following that, Waziri et al. [14] also enhanced the scheme in [15] and produced the correction and accelerated parameters. Motivated by the hybrid method in [12], Liu et al. [28] presented a hybrid acceleration method for solving (1) using hybrid process introduced in [27]. In conclusion, the hybrid approaches demonstrate improved accuracy in obtaining solutions, thereby enhancing the overall effectiveness of the method.

Despite the significant progress achieved by the accelerated and hybrid methods reported in [12,14,22,28], several challenges remain. Most existing approaches are based on the Picard–Mann hybrid process or other two-step schemes, which may not fully exploit the potential advantages of multi-step iterative processes [27]. Furthermore, although these methods have demonstrated satisfactory convergence properties, there is still a need for more efficient derivative-free algorithms with improved robustness and faster convergence for large-scale nonlinear systems. Compared with the existing approaches, the proposed method incorporates the Picard–Ishikawa process [29], a three-step iterative scheme that is known to possess stronger convergence characteristics than the Picard–Mann process. By combining this process with an accelerated Jacobian approximation strategy, the proposed method achieves enhanced numerical performance while maintaining low computational cost. The numerical results presented in this study demonstrate that the proposed scheme consistently performs better than several existing accelerated methods, highlighting its effectiveness and practical relevance.

Many practical problems arising in engineering, applied sciences, and multiphase systems can be formulated as systems of nonlinear equations. Examples include fluid flow models [3036], heat transfer processes [37], motion control [11,38], and optimisation problems involving coupled physical phenomena [39]. These applications often generate large-scale nonlinear systems for which classical methods may suffer from slow convergence, high computational cost, or difficulties associated with Jacobian evaluations. By reducing computational effort and improving solution accuracy, the proposed method can contribute indirectly to cost reduction, improved resource utilization, and enhanced decision-making in sectors that rely on mathematical modeling and optimization. Although several accelerated and hybrid iterative methods have been proposed in the literature, there remains a need for more efficient derivative-free approaches that combine strong convergence properties with reduced computational complexity. In particular, limited attention has been given to incorporating the Picard–Ishikawa hybrid process into accelerated schemes for solving systems of nonlinear equations. Motivated by this gap, the present study develops a new hybrid accelerated iterative framework that improves convergence performance and numerical efficiency while avoiding direct Jacobian computations. Inspired by concepts introduced in [26,28], we aim to enhance the efficiency and precision of discovering solutions to Problem (1) by hybridising our scheme with the Picard–Ishikawa iterative scheme. These findings not only highlight the potential of the hybrid approach to optimise numerical algorithms but also pave the way for further advancements in this area of study.

The novelty of this work lies in the development of a new Hybrid Accelerated Picard–Ishikawa iterative method for solving systems of nonlinear equations. Unlike existing accelerated methods that primarily employ the Picard–Mann hybrid process or conventional acceleration techniques, the proposed approach integrates the three-step Picard–Ishikawa process with an acceleration framework to improve convergence performance. The main novel contributions of the manuscript are:

  • The incorporation of the Picard–Ishikawa hybrid process into an accelerated iterative framework for solving systems of nonlinear equations, which has received limited attention in the existing literature.
  • The derivation of a new acceleration parameter that provides an efficient approximation of the Jacobian matrix, leading to a derivative–free implementation and reducing computational cost.
  • The introduction of a correction parameter derived from the Picard–Ishikawa process, which enhances the quality of the iterative sequence and improves convergence behavior.
  • The establishment of global convergence of the proposed algorithm under mild assumptions.
  • Comprehensive numerical experiments demonstrating that the proposed HAPI method consistently outperforms some existing methods, in terms of iteration count, function evaluations, CPU time, and overall robustness.

Therefore, the originality of the study lies not only in proposing a new hybrid accelerated scheme but also in showing that the Picard–Ishikawa-based framework can provide superior numerical performance compared with existing accelerated and hybrid methods for solving large-scale nonlinear systems.

The remainder of this paper is organized as follows. In the next section, the derivation of the proposed approach is presented. A convergence analysis of the suggested algorithm is given in Section 3. The details of the numerical experiments are provided in Section 4. The article is concluded in Section 5. In this paper, all vectors are column vectors and we refer to as the n-dimensional real space, with the notation representing the Euclidean norm.

2. Motivation and the derivation of the proposed method

In this section, we apply the Picard-Ishikawa hybrid model to an accelerated scheme for solving (1). Let be normed (real) space and let be a nonempty convex set. Consider a mapping .

The sequence defines the iterative procedure provided by Picard [40] as

The sequence defines the iterative procedure provided by Mann [41] as

where

The sequences and defines the iterative procedure provided by Ishikawa [42] as

where and are sequences in (0,1).

In [27], Khan hybridised the Picard and Mann iterative methods and presented the Picard-Mann hybrid process with the sequences and defined by

(5)

where . The presented hybrid process in (12) converges more quickly than all of the Ishikawa, Picard, and Mann, processes. Inspired by the Picard–Mann process, several optimisation schemes have been hybridised with it, yielding improved results compared to the classical methods. For instance, by applying the hybridisation rule described in [27], Petrovi [26] enhanced both the global convergence and the numerical performance of the accelerated method in [24] for solving (3). Similarly, Waziri et al. [12] developed a hybrid technique for solving (1) by incorporating the approaches in [27] and [19]. Numerical experiments displayed that the hybrid method in [12] achieves more rapid convergence than the current method reported in [19]. For further studies in hybridising optimisation techniques with the Picard–Mann process, the reader may refer to [13,14,43,44].

Okeke [29] merged the Picard and Ishikawa procedures to establish the Picard–Ishikawa hybrid approach, which incorporates the simplicity of the Picard process with the ability of the Ishikawa technique. These process is given by

(6)

where and are sequences in (0,1). The hybrid process in (6) converges to the solution faster than the Picard, Mann, Ishikawa, and Picard–Mann approaches [29].

Since the Picard–Ishikawa hybrid process exhibits a faster convergence rate than the Picard–Mann hybrid process, we are motivated to develop an accelerated, globally convergent method for solving (1), based on the Picard–Ishikawa hybrid approach.

To begin with, let us define the mapping T as follows:

(7)

By analysing (6) and (7), we can easily deduce the relations that follow:

(8)(9)(10)

In this study, and are regarded as correction parameters that are presented to modify the iteration process and enhance the convergence behaviour of the proposed algorithm.

Lemma 2.1. Suppose the hybrid accelerated approach be generated by the four term iterative process in (8), (9) and (10), then the proposed iterative scheme is given by

(11)

Proof By substituting (10) into (9) and (9) into (8), we obtain

Therefore, Lemma (2.1) is proved.

Weighted least-squares update for the acceleration parameter

Given and . If , then . Consider the regularised weight matrix

(12)

where I is an identity matrix.

Proposition 2.2. Let , , and . Then has satisfied the following conditions:

  1. (i) is symmetry
  2. (ii) is positive definite.

Proof (Symmetry) Being that and , it follows that

Hence the result follows.

(Positive definiteness). For any nonzero vector ,

Clearly , and since and for , we have

Hence the result follows.

To obtain the acceleration parameter , the following weighted least squares problem can be formulated:

Define

(13)

Differentiating (13) with respect to and setting the result to zero yields

(14)

By substituting (12) into (14), we obtain

After a little algebraic simplification,

Therefore, the acceleration parameter yields

(15)

From (11), the proposed search direction is expressed as:

(16)

The general scheme can be stated as follows:

Remark 2.3. We make the following observations:

  1. (i) The sign of the proposed acceleration parameter in (15) corresponds the sign of . Specifically whenever .
  2. (ii) Since , the denominator in (15) is strictly positive when ; therefore, the minimiser is unique. In addition, , hence is strictly convex in .
  3. (iii) We specify the correction parameters and for all k > 0, thereby assuring consistency in the analysis and allowing effective modification of the proposed iterative process.

Algorithm 1: Hybrid Accelerated Scheme Based on the Picard–Ishikawa (HAPI)

Input: Given s0, , , , and set k=0.

1: Compute

2: If then stop; otherwise, continue to 3.

3: Determine the search direction .

4: Establish , with, and denotes the smallest nonnegative integer m such that

   (17)

 Suppose that is a positive sequence such that

   (18)

5: Compute .

6: Determine .

7: Consider k=k+1 and go to 2.

Lemma 2.4. Suppose that the hybrid accelerated approach is generated by the Picard–Mann hybrid process in (5). Then, the iterative scheme can be expressed as

(19)

Proof The proof follows the same argument as that of Lemma 2.1. Hence, we obtain (19).

Remark 2.5. From (19), it follows that the search direction of the hybrid accelerated scheme based on the Picard–Mann process (HAPM) is given by

Following a similar approach to Remark 2.3, we choose the correction parameter as a constant, that is, for all . Therefore, by replacing the search direction in Step 3 of Algorithm 1 (HAPI) with , we obtain Algorithm 2 (HAPM).

3. Convergence analysis

The global convergence of the proposed Algorithm 1 (HAPI) is established in this section. We begin by defining the level set.

(20)

Assumption 3.1. The following assumptions have been stated:

  1. There exists such that .
  2. The function is continuously differentiable in some neighborhood say Q of containing .
  3. The Jacobian of is bounded on Q, i.e., there exist a constant H > 0 such that (21)
  4. The Jacobian of is positive definite on Q, i.e., there exist a constant h > 0 such that (22)

Consequently, we have

Remark 3.2. We make the following remark:

Assumption 3.1 implies that

(23)(24)

Assumption 3.3. is a good approximation to , i.e.,

(25)

where, is a small quantity.

Lemma 3.4. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true. Then is a sufficient descent direction for at , i.e.,

(26)

Proof From (2), (16), and (25), we have

Applying the Cauchy-Schwarz inequality, we have,

Since , taking , Lemma 3.4 is true.

From Lemma 3.4, we conclude that, is true for all k.

Lemma 3.5. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true. Then .

Proof From Lemma 3.4, we have . Furthermore, for all k,

This means that .

Lemma 3.6. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true. Then there exists a constant h > 0 such that for all k,

(27)

Proof From mean-value theorem and (22),

Where , .

Proposition 3.7. From (15), (24), and (27), we obtain the following cases:

This implies that

(28)

Consequently,

(29)

Lemma 3.8. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true. Then for all k, we have

(30)

and

(31)

Proof From (17) for all k > 0

By summing the above inequality, we have

Based on the level set and the fact that the sequence meets the criterion in (18), it follows that the series converges. This leads to the conclusion in (30). By applying the same reasoning as above, but now considering on the left side, we arrive at (31).

Lemma 3.9. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true. Then there exists a constant M1 > 0 such that for all k > 0,

(32)

Proof From Remark 2.3 (iii), the level set, (16), (24), and (29), we have

Taking , we have (32).

Lemma 3.10. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true. Then there exists a constant B1 > 0 such that for all k > 0,

(33)

Proof From (24), we obtain

(34)

Combining (27) and (34) gives

(35)

Now, From the the definition of in (15) and applying (35), it follows that

From Lemma 3.8, we know that . Hence, there exists a positive constant m3 such that for all k.

Therefore,

Setting

we obtain (33).

Corollary 3.11. From Lemma 3.10, and fact that for all k, we have

(36)

In addition, from (28) there exists h > 0 with for all k, then

Theorem 3.12. Let be produced by the HAPI algorithm, supposing Assumption 3.3 is true, then

(37)

Proof From (30), either

(38)

or

If (38) holds, then from (16) we have,

(39)

From (39), and Cauchy-Schwarz inequality, we obtain

(40)

Also, (40) and (36) gives

As a result,

Hence, (37) holds.

On the other hand, if (38) does not hold, then there exists a constant such that

(41)

Since is continuously differentiable and , we can use the first-order Taylor expansion to derive results as follows:

(42)

From (17),

(43)

From (42) and (43), and using (26), the following inequality can be established.

(44)

Dividing (44) through by , we can easily derive the following results:

Therefore, from (38), (41), one can readily derive the following conclusion.

Therefore, we have (37). The proof is complete.

Remark 4. By employing the search direction defined in (5), the convergence analysis of the HAPM algorithm can be established in a manner analogous to that of the HAPI algorithm. Consequently, the corresponding convergence results hold for the HAPM algorithm.

4. Numerical experiments

This section provides an overview of the results acquired from numerical experiments on a system of nonlinear equations. The objective of these experiments is to evaluate the performance and effectiveness of the proposed method in solving (1). The efficiency of the proposed approach is compared with two recent algorithms from [28], specifically ALG1 and ALG2.

The computer codes employed in this study were developed using MATLAB version 9.4.0 (R2020a) and executed on a personal computer that features a 1.80 GHz CPU processor and 8 GB of RAM. All four algorithms employed the same line search method, as detailed in (17), to ensure a fair and consistent performance comparison. Throughout the numerical experiments, the parameters for ALG1 and ALG2 were adopted from the settings reported in [28]. The parameter settings used for the HAPI and HAPM algorithms are reported in Table 1. The program execution terminates if the total number of iterations exceeds 1000 or if . The symbol ’–’ denotes a failure when the number of iterations exceeds 1000 without discovering a point of that meets the established stopping criterion. To provide the comprehensive numerical experiments conducted with the three methods, we applied these techniques to eight benchmark test problems, using various initial points and dimensions ranging from 1000 to 100,000. The initial points used in the experiment are: , , , , , and .

thumbnail
Table 1. Summary of benchmark problems and experimental settings.

https://doi.org/10.1371/journal.pone.0355734.t001

The benchmark problems and the corresponding experimental settings used to evaluate the performance of the algorithms are summarized in Table 1. Detailed definitions of the test problems are provided below.

Problem 1 [28]

, i=1,2,...,n.

Problem 2 [15]

, i=1,2,...,n.

Problem 3 [28]

, .

Problem 4 [21]

, .

with and . (In our experiment, we take c = 0.1).

Problem 5 [17]

,

,

, .

Problem 6 [12]

.

Problem 7 [12]

,

Problem 8 [19]

,

,

Table 1 provides a summary of the benchmark problems and the parameter settings employed throughout the numerical experiments.

The numerical comparisons reported in Tables 26 were conducted using the benchmark problems and parameter settings summarized in Table 1. Tables 25 display the performance of the HAP1 method against the ALG1 and ALG2 methods for problems 1–8. The evaluation criteria include the number of iterations, function evaluations, CPU time, and the residual norm . For all problems, the HAPI method consistently achieves convergence with fewer iterations and function evaluations than the ALG1 and ALG2 methods. As the problem size increases, the advantages of the HAPI methods become more apparent, particularly in cases where the ALG1 and ALG2 methods have failed, as illustrated in Table 3. Additionally, the CPU time supports this observation: HAPI generally requires less computational effort, whereas the competing methods demonstrate significantly longer execution times, especially in large-scale scenarios. All three methods achieve similar residual norms that stay within acceptable tolerances regarding solution accuracy. However, the HAPI approach displays better accuracy and efficiency than the compared methods. Therefore, approximating the Jacobian along with the acceleration parameter significantly reduces the computational burden of the proposed method. Overall, the results in Tables 25 demonstrate that the hybrid accelerated method is not only faster but also more robust for large-scale nonlinear systems. Its outstanding performance using three metrics, i.e., number of iterations, function evaluations, and CPU time, validates its usefulness compared to existing approaches.

thumbnail
Table 2. Numerical experiments for problems 1 & 2 with respect to HAPI, ALG1 & ALG2 methods.

https://doi.org/10.1371/journal.pone.0355734.t002

thumbnail
Table 3. Numerical experiments for problems 3 & 4 with respect to HAPI, ALG1 & ALG2 methods.

https://doi.org/10.1371/journal.pone.0355734.t003

thumbnail
Table 4. Numerical experiments for problems 5 & 6 with respect to HAPI, ALG1 & ALG2 methods.

https://doi.org/10.1371/journal.pone.0355734.t004

thumbnail
Table 5. Numerical experiments for problems 7 & 8 with respect to HAPI, ALG1 & ALG2 methods.

https://doi.org/10.1371/journal.pone.0355734.t005

thumbnail
Table 6. Numerical experiments on the HAPI and HAPM algorithms for problems 1 to 8.

https://doi.org/10.1371/journal.pone.0355734.t006

Figs 13 present the performance of the three methods using the profile of Dolan and Mor [45], with respect to the number of iterations required to solve the test problems. The horizontal axis displays the performance ratio , and the vertical axis gives the fraction of problems for which each method converges within a factor of the best iteration count, function evaluation, and CPU time (in seconds). The figures show that HAPI consistently outperforms the other two methods. As increases, the curve for the proposed method stays consistently above the curves for the ALG1 and ALG2 approaches. This means that the HAPI method successfully solves the largest fraction of problems using the fewest iterations, function evaluations, and CPU time, demonstrating its superior robustness across the test set. In particular, HAPI converges more quickly to the solution than the other methods, ensuring its overall dependability and competitiveness. The results indeed indicate that incorporating the hybridisation process and the Jacobian approximation with an acceleration parameter yields a method that not only converges faster but is also more stable compared to the existing approaches.

thumbnail
Fig 1. Performance profile based on the number of iterations within a factor of the best time.

https://doi.org/10.1371/journal.pone.0355734.g001

thumbnail
Fig 2. Performance profile based on the function evaluation within a factor of the best time.

https://doi.org/10.1371/journal.pone.0355734.g002

thumbnail
Fig 3. Performance profile with respect to CPU time (in seconds) within a factor of the best time.

https://doi.org/10.1371/journal.pone.0355734.g003

Table 6 presents the numerical results of the HAPI and HAPM algorithms for Problems 1–8 using different initial points and a fixed dimension n = 100,000. The comparison is carried out in terms of the number of iterations, function evaluations, computational time, and residual norms. The results show that both methods converged successfully for all test problems with satisfactory accuracy. However, the HAPI algorithm generally required fewer iterations, fewer function evaluations, and less CPU time than HAPM. This demonstrates the efficiency of the acceleration strategy incorporated in HAPI. Furthermore, the residual norms obtained by HAPI are comparable to those of HAPM, indicating that the improved computational performance is achieved without loss of accuracy. Overall, the results confirm that HAPI is more efficient and robust than HAPM for the considered test problems.

Fig 4 and Fig 5 present the performance of the three methods using the profile of Dolan and Mor [45], with respect to the number of iterations, function evaluations, and CPU time. The performance profile shows that HAPI performs better than HAPM on most test problems. The HAPI curve rises rapidly indicating that it solves almost all problems with the best or near-best performance. In contrast, HAPM requires larger performance ratios before solving the same fraction of problems, showing lower efficiency and robustness. Since the HAPI curve lies above and to the left of the HAPM curve, HAPI is considered the superior algorithm according to the Dolan and Mor criterion.

thumbnail
Fig 4. Performance profile based on the number of iterations within a factor of the best time.

https://doi.org/10.1371/journal.pone.0355734.g004

thumbnail
Fig 5. Performance profile based on the function evaluation within a factor of the best time.

https://doi.org/10.1371/journal.pone.0355734.g005

5. Conclusion

This paper presents an accelerated approach for solving systems of nonlinear equations. The proposed method combines the Picard–Ishikawa process with an acceleration scheme and introduces a correction parameter to reduce computational cost while maintaining high accuracy. Furthermore, the acceleration parameter was derived to approximate the Jacobian matrix effectively. Under mild assumptions, the theoretical analysis established the global convergence of the proposed method. Extensive numerical experiments were carried out on several benchmark problems to evaluate the efficiency and robustness of the proposed scheme. The numerical results presented in Tables 26 and Fig 1Fig 6 demonstrate that the proposed HAPI method consistently outperforms the existing ALG1, ALG2, and HAPM methods in terms of iteration count, function evaluations, and CPU time while preserving high numerical accuracy. In particular, the Dolan and Mor performance profiles confirm the superiority and robustness of the HAPI method, as it solves most test problems with the best or near-best performance.

thumbnail
Fig 6. Performance profile with respect to CPU time (in seconds) within a factor of the best time.

https://doi.org/10.1371/journal.pone.0355734.g006

The main contribution of this work lies in the development of a robust hybrid accelerated iterative framework based on the Picard–Ishikawa process for efficiently solving large-scale nonlinear systems. The proposed approach improves convergence behavior and computational efficiency while avoiding direct Jacobian evaluations.

Although the proposed method has demonstrated promising numerical performance on a variety of benchmark problems, the current study is limited to systems of nonlinear equations that satisfy the assumptions required for the convergence analysis. Therefore, its performance on more challenging classes of problems, such as highly ill-conditioned or large-scale real-world applications, requires further investigation. Overall, the obtained results validate the effectiveness and applicability of the proposed accelerated scheme for solving nonlinear systems of equations arising in scientific and engineering applications. Future research will focus on exploring alternative acceleration strategies and hybrid iterative processes to further improve convergence behavior and computational efficiency. In addition, future studies will investigate the applicability of the proposed method to practical problems arising in motion control and related engineering design, and other real-world optimization applications will be investigated.

References

  1. 1. Rayas-Sanchez JE. Power in simplicity with ASM: tracing the aggressive space mapping algorithm over two decades of development and engineering applications. IEEE Microwave. 2016;17(4):64–76.
  2. 2. Phelim PB. A Monte Carlo approach. J Financ Econ. 1977;4(3):323–38.
  3. 3. Sambas A, Miroslav M, Vaidyanathan S, Ovilla-Martínez B, Tlelo-Cuautle E, El-Latif AAA, et al. A new hyperjerk system with a half line equilibrium: multistability, period doubling reversals, antimonotonocity, electronic circuit, FPGA design, and an application to image encryption. IEEE Access. 2024;12:9177–94.
  4. 4. Sambas A, Vaidyanathan S, Mamat M, WS MS, Prastio RP. Design, analysis of the Genesio-Tesi chaotic system and its electronic experimental implementation. Int J Control Theory Appl. 2024;9(1):141–9.
  5. 5. Sambas A, Vaidyanathan S, Tlelo-Cuautle E, Abd-El-Atty B, El-Latif AAA, Guillen-Fernandez O, et al. A 3-D multi-stable system with a peanut-shaped equilibrium curve: circuit design, FPGA realization, and an application to image encryption. IEEE Access. 2020;8:137116–32.
  6. 6. Li D, Fukushima M. A globally and superlinearly convergent Gauss--Newton-based BFGS method for symmetric nonlinear equations. SIAM J Numer Anal. 1999;37(1):152–72.
  7. 7. Dennis JE, Schnabel RB. Numerical Methods for Unconstrained Optimization and NonLinear Equations. Englewood Cliffs: Prentice Hall; 1983.
  8. 8. Waziri MY, Leong WJ, Hassan MA. Jacobian-free diagonal Newton’s method for solving nonlinear systems with singular Jacobian. Malays J Math Sci. 2011;5:241–55.
  9. 9. Yuan G, Lu X. A new backtracking inexact BFGS method for symmetric nonlinear equations. Comput Math Appl. 2008;55(1):116–29.
  10. 10. Abdullahi H, Halilu AS, Waziri MY. A modified conjugate gradient method via a double direction approach for solving large-scale symmetric nonlinear systems. J Numerical Math Stochastics. 2018;10:32–44.
  11. 11. Halilu AS, Majumder A, Waziri MY, Ahmed K, Awwal AM. Motion control of the two joint planar robotic manipulators through accelerated Dai–Liao method for solving system of nonlinear equations. Eng Comput. 2021;39(5):1802–40.
  12. 12. Waziri MY, Muhammad HU, Halilu AS, Ahmed K. Modified matrix-free methods for solving system of nonlinear equations. Optimization. 2020;70(11):2321–40.
  13. 13. Waziri MY, Muhammad HU, Halilu AS, Ahmed K. A family of hybrid derivative-free methods via acceleration parameter for solving system of nonlinear equations. Filomat. 2023;37(5):1461–78.
  14. 14. Waziri MY, Muhammad HU, Halilu AS, Ahmed K, Murtala S. Hybrid derivative-free methods for solving system of nonlinear equations. RAIRO-Oper Res. 2024;58(1):989–1003.
  15. 15. Halilu AS, Waziri MY. An improved derivative-free method via double direction approach for solving systems of nonlinear equations. J Ramanujan Math Soc. 2018;33:75–89.
  16. 16. Kiri AI, Waziri MY, Halilu AS. Modification of the double direction approach for solving systems of nonlinear equations with application to Chandrasekhar’s integral equation. Iran J Numer Anal Optimiz. 2020;12(2):426–48.
  17. 17. Halilu AS, Waziri MY. A transformed double step length method for solving large-scale systems of nonlinear equations. Journal of Numerical Mathematics and Stochastics. 2017;9:20–32.
  18. 18. Halilu AS, Waziri MY. Solving systems of nonlinear equations using improved double direction method. J Niger Math Soc. 2020;32(2):287–301.
  19. 19. Sani Halilu A, Abdullahi H, Yusuf Waziri M. En enhanced matrix-free method via double step length approach for solving systems of nonlinear equations. Int J Appl Math Res. 2017;6(4):147–56.
  20. 20. Halilu AS, Yusuf Waziri M, Balarabe Musa Y. Inexact double step length method for solving systems of nonlinear equations. Stat Optim Inf Comput. 2020;8(1):165–74.
  21. 21. Halilu AS, Majumder A, Waziri MY, Abdullahi H. Double direction and step length method for solving system of nonlinear equations. Eur J Mol Clin Med. 2020;7(7):3899–913.
  22. 22. Halilu AS, Waziri MY, Abdullahi A, Majumder A. On the hybridization of the double step length method for solving system of nonlinear equations. Malays J Math Sci. 2022;16(2):329–49.
  23. 23. Stanimirović PS, Miladinović MB. Accelerated gradient descent methods with line search. Numer Algor. 2009;54(4):503–20.
  24. 24. Petrovi MJ, Stanimirovi PS. Accelerated double direction method for solving unconstrained optimization problems. Math Probl Eng. 2014;2014:1–8.
  25. 25. Petrovi MJ. An accelerated double step size model in unconstrained optimization. Appl Math Comput. 2015;250:309–19.
  26. 26. Petrovi MJ, Stanimirovi PS, Kontrec N, Mladenovi J. Hybrid modification of accelerated double direction method. Math Probl Eng. 2018;:1–8.
  27. 27. Khan SH. A Picard-Mann hybrid iterative process. Fixed Point Theory Appl. 2013;2013(1).
  28. 28. Liu JK, Zhang N, Tang B, Xiong J, Feng YM. An accelerated derivative-free method for solving large-scale nonlinear non-monotone equations. Optimization. 2025;75(6):1447–70.
  29. 29. Okeke GA. Convergence analysis of the Picard–Ishikawa hybrid iterative process with applications. Afr Mat. 2019;30(5–6):817–35.
  30. 30. Maatki C, Bilal M, Ahmad N, Ahmad F, Alshammari BM, Kriaa K, et al. Numerical study of three-dimensional unsteady viscous fluid flow across parallel rotating discs with an upward fluctuation and thermal radiation. J Radiat Res Appl Sci. 2025;18(2):101577.
  31. 31. Shi Q-H, Khan MN, Abbas N, Khan MI, Alzahrani F. Heat and mass transfer analysis in the MHD flow of radiative Maxwell nanofluid with non-uniform heat source/sink. Waves Random Complex Media. 2021;34(4):3450–73.
  32. 32. Abbas N, Shatanawi W. Theoretical survey of time-dependent micropolar nanofluid flow over a linear curved stretching surface. Symmetry. 2022;14(8):1629.
  33. 33. Abbas N, Ali M, Shatanawi W, Mustafa Z. Thermodynamic properties of Second-grade micropolar nanofluid flow past an exponential curved Riga stretching surface with Cattaneo–Christov double diffusion. Alexandria Eng J. 2023;81:101–17.
  34. 34. Abbas S, Nazar M. Fractional analysis of unsteady magnetohydrodynamics Jeffrey flow over an infinite vertical plate in the presence of Hall current. Math Methods in App Sciences. 2024;48(1):253–72.
  35. 35. Abbas S, Gilani SFF, Nazar M, Fatima M, Ahmad M, Nisa ZU. Bio-convection flow of fractionalized second grade fluid through a vertical channel with Fourier’s and Fick’s laws. Mod Phys Lett B. 2023;37(23).
  36. 36. Abbas S, Saidani T, Ramzan M, Saleem S, Adnan Othman N, Abduvalieva D, et al. Impact of thermal radiation on fractional viscoelastic nanofluid flow with joint heat mass transfer using a neural network based approach. J Radiat Res Appl Sci. 2025;18(3):101640.
  37. 37. Syed NH, Khan NA, Ahmad N, Khan M, Ahmad F, Humayun F, et al. A CFD analysis to investigate the effect of inserts on the overall heat transfer coefficient in a concentric tube heat exchanger. Eng Technol Appl Sci Res. 2024;14(6):18077–85.
  38. 38. Halilu AS. An accelerated double-step-length iterative method for nonlinear systems of equations with applications to motion control. Open J Math Sci. 2026;10:755–75.
  39. 39. Ahmad F, Ahmad N, Al-Khazaal AAZ. Machine learning-assisted prediction and optimization of exergy efficiency and destruction of cumene plant under uncertainty. Eng Technol Appl Sci Res. 2024;14(1):12892–9.
  40. 40. Picard E. Memoire sur la theorie des equations aux derivees partielles et la meth-ode des approximations successives. J de Mathématiques Pures et Appliquées. 1890;6:145–210.
  41. 41. Mann WR. Mean value methods in iterations. Proc Am Math Soc. 1953;4(2):506–10.
  42. 42. Ishikawa S. Fixed points by a new iteration method. Proc Amer Math Soc. 1974;44(1):147–50.
  43. 43. Petrovi MJ. Rule applied on accelerated double step size optimization scheme. Appl Math Comput. 2019;33(3):655–65.
  44. 44. Petrovi MJ, Rako V, Kontrec N. Rule applied on accelerated double step size optimization scheme. Numer Algorithms. 2018;79(3):769–86.
  45. 45. Dolan ED, Moré JJ. Benchmarking optimization software with performance profiles. Math Programm. 2002;91(2):201–13.