Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Distributed dynamic event-triggered algorithm for optimization problem with time delay

Abstract

This paper focuses on studying the optimization problem of multi-agent systems (MAS) under undirected graph. To reduce the communication frequency among agents, a zero-gradient-sum (ZGS) algorithm based on dynamic event-triggered (DET) mechanism is investigated. The event-triggered condition of each agent only uses its own state information and the neighbor’s state information at the previous triggering instants, without requiring continuous state information from the neighbor. In addition, the designed algorithm allows for the sampling period to be arbitrarily large. The Lyapunov method is utilized to derive the sufficient conditions that incorporate time delay and parameters. As the event is only checked at the periodic moment, zeno behavior can be directly excluded. Finally, numerical simulations demonstrate the effectiveness of the theoretical results.

1 Introduction

In this paper, a MAS that contains n agents is considered. The objective is to solve the optimization problems given below, where each agent i, i = 1, …, n, has a cost function gi. (1) where and x* denotes the global optimal value. Many distributed optimization (DO) tasks in industry and economy can be transformed into Problem (1), such as sensor scheduling [1, 2], robot fleeting [35], smart grid [6, 7], etc. Thus problem (1) gained extensive research.

In recent years, numerous DO algorithms have been proposed, with the majority of them being based on a discrete iterative form. However, discrete-time optimization algorithms are no longer sufficient for solving problems such as signal processing, parameter estimation, and filter design. In such cases, continuous-time optimization algorithms provide the necessary means. Furthermore, the existing convex optimization theory and Lyapunov stability theory offer powerful tools for the design and convergence analysis of continuous-time algorithms. A DO algorithm based on adaptive mechanism was proposed in [8] to address the issue of unknown network connectivity. By introducing a dynamic coupling gain, the algorithm achieves global asymptotic convergence. A scaled integration protocol that employs projection output feedback was presented in [9] to address distributed convex optimization problems with general constraints. A Newton-Raphson consistency algorithm was proposed in [10] to solve the unconstrained DO problem. Under appropriate assumptions, the algorithm can achieve exponential convergence by using second-order information. Among the numerous optimization algorithms, the ZGS algorithm has garnered significant attention from scholars due to its efficient performance in handling optimization problems. A continuous-time ZGS was proposed in [11] to solve the optimisation problem under undirected graphs, and a lower bound on the rate of convergence associated with the network structure was given. A distributed ZGS algorithm was proposed in [12] to solve optimization problems in time-varying networks. This is the further extension of the work in [11].

However, the aforementioned work requires agents to communicate continuously with their neighbors, which will cause a large burden in in practical applications. The ET controllers were first proposed in [13] to address the MAS consistency problem. The ET mechanism involves designing an error-based trigger condition that requires communication between agents when the condition is satisfied. When the condition is not satisfied, communication between agents is not required. An ET subgradient optimization algorithm based on communication network edges was presented in [14], and the exponential convergence rate of the algorithm was given. A ZGS algorithm that utilizes the ET mechanism was introduced in [15] to ensure the system state converges to the optimal solution. However, the aforementioned ET policy is a static ET policy, meaning that its trigger threshold is only related to the state of the agent. As the agents’ states gradually converge, the trigger conditions become easily satisfied, leading to unnecessary communication. Therefore, a more reasonable trigger condition needs to be designed. A recursive convex optimization algorithm based on DET mechanism was proposed in [16] to schedule the information transfer between sensor networks. A DET controller was proposed in [17] to adjust the data transmission between sensors. The use of the DET mechanism allows the trigger condition to change with the agent state, thus further reducing the frequency of communication.

As time delay is inevitable in real systems, there has been extensive research on time-delayed ET strategies [1821]. Motivated by the work in [15], we propose a distributed dynamic event-triggered zero gradient sum (DET-ZGS) algorithm. Compared to most papers that use the ET mechanism [2225], adopting the DET mechanism can avoid continuous triggering caused when the agent state approaches the optimal value. Considering that it takes some time to conduct the DET judgment, using the previous value to construct the DET condition is more realistic. Moreover, the developed algorithm accommodates an arbitrarily large sampling period. Furthermore, we consider communication time delay and derive explicit necessary conditions by using the Lyapunov method. Finally, Numerical simulations further illustrate the effectiveness of the proposed algorithm.

The overall structure of this paper is arranged as follows. The basic graph theory and knowledge of convex functions are provided in Section 2. The DET-ZGS condition is introduced in Section 3, and the necessary conditions for convergence are given. The simulation results for the two examples are provided in Section 4. Section 5 offers a summary of this paper.

2 Preliminaries and problem formulation

2.1 Graph theory

and represent the set of real numbers and a vector set respectively. A graph is employed to model a communication network with n nodes. The graph consists of a vertex set and an edge set . If there exists a path between any two nodes, then is connected. Define as the weighted adjacency matrix of , ; . denotes the degree matrix, where . The Laplace matrix is equal to the degree matrix minus the adjacency matrix, i.e. . When the graph is an undirected graph, its Laplacian matrix is a symmetric matrix.

2.2 Convex function

If there exists some positive constant which makes the following inequality hold, then the cost function can be called strongly convex [11]. (2) (3) (4) where ϕi is a positive constant, ∇gi and ∇2gi are the gradient and the Hessian matrix respectively.

Lemma 1 Suppose the graph is strongly connected and balanced, for any , the following property holds. (5) where α2 is the smallest positive eigenvalue on and βn is the largest eigenvalue on .

3 The distributed DET-ZGS algorithm and main results

3.1 The distributed DET-ZGS algorithm with time delay

In this paper, we adopt a periodic sampling method to obtain the state of the agent, where the sampling period is defined as h. This means that we sample the state of the agent at intervals of h. Specifically, we use xi(t) to represent the state of the agent at time t, and this state changes dynamically over time. Firstly, the states of the neighbors and the agent’s own state at the previous triggering time are sent to the controller to obtain the agent’s current state. Simultaneously, an event detector is installed on each agent, which only checks if the triggering condition is met at the sampling time. Subsequently, the agent’s state from the previous sampling time is sent to a constructed trigger for evaluation. When the preset triggering condition is satisfied, the agent’s state at the triggering time is obtained. Finally, the obtained local state is used to update the control actions of both the agent itself and its neighbors. In practice, when the value at the sampling point exactly meets the DET condition, we have . Due to the existence of time delay in practical transmission, this section considers satisfying a delay of τ ∈ (0, h). In addition, for t ∈ [ςh + τ, (ς + 1)h + τ), ς = 0, 1, 2, …, we define and deviation variable . The main structure of the algorithm is designed as follows: (6) (7)

Then the DET condition is designed as follows: (8) where (9) and (10) where di is the degree of the agent i, γ is a positive constant. εi, μi, ωi are self-designable parameters. The deviation variable .

Remark 1 Considering that it takes some time to make ET judgments on agent states. When designing the DET condition (8), we use the agent state qi(ςhh) at the previous sampling moment, which is more logical. In addition, the agent state is taken into account when designing DET conditions, which makes the frequency of triggering not increase when the agent state is close to the optimal value. In the design of DET conditions, different parameters εi, μi, ωi can be set for each agent according to different needs to ensure that it can make the most accurate response in a specific situation. For the convenience of analysis, this paper chooses to set the same εi, μi, ωi for each agent in order to study its behavior and response ability more clearly.

3.2 Main results and analysis

Theorem 1. Assume that the communication graph is balanced. If the following stability conditions are valid, the proposed algorithm (6) based on DET conditions (8) enables to address problem (1), i.e. limt→∞xi(t) = x*. (11) (12) (13) where ϕmin = min{ϕ1, …, ϕn}.

Proof: For t ∈ [ςh + τ, (ς+ 1) h + τ), define a Lyapunov function (14)

Let and .

According to the property of convex function (2) yield (15)

According to (8) and (10) have (16) Furthermore, we obtain (17)

Based on (12), we get . Then, ξi(ςh) > 0. Furthermore, it follows (18)

Therefore, one obtains (19)

Due to (15) and (19), we can derive . Then we derive and yields (20)

Furthermore, one has that (21)

Due to the following properties of undirected graphs . (22)

Furthermore, due to , one has that (23) where , .

Based on (6) yield (24) where and , , , Δ(t) = [δ1(t), δ2(t), …, δn(t)]T, i = 1, 2, …, n.

Substituting Eqs (24) into (23) yields (25)

As the inequality (4), there exists (26)

Furthermore, , , where ϕmin = min{ϕ1,…,ϕn}.

Note that (27)

Based on Lemma 1 yield (28)

By utilizing Lemma 1 and Young inequality, one has (29)

Then, we have (30)

Based on (10), we get (31)

Then, we obtain (32)

Add and subtract to right equation, one obtain (33)

Take the integration of yields (34) for t ∈ [ςh + τ, (ς + 1) h + τ).

Since the Lyapunov function is positive definite, it follows that (35)

By accumulating from ς = 1 to ς yield (36) while (37) we have (38)

Then, we can obtain, (39)

Given that qi(ςh) ≥ 0 and , Eq (39) implies that: (40)

Utilizing the definition of qi(ςh) and the Laplace matrix properties, it is established that the ultimate state of each agent is equivalent to a common constant value, i.e. (41)

The second order derivative of the cost function has (42) where 1 = [1 …, 1]n.

Then, we have (43)

Combining (41) and (43) yields (44) Theorem 1 is proved.

Corollary 1 When the time delay is not considered and the following stability conditions hold, the proposed algorithm can effectively address problem (1) for any and t > 0. (45) (46) (47) where ϕmin = min{ϕ1, …, ϕn}, . Due to the exclusion of time delay, the proof process is comparatively simpler than that of Theorem 1.

Proof: We adopt the identical Lyapunov function as presented in Theorem 1, (48) where ,

According to the proof above, we can get .

Based on (6) and (7) yield (49)

Since t ∈ [ςh, ςh + h), we obtain (50) where , , i = 1, 2, …, n and .

Then, we obtain (51)

Then, one obtains (52)

Based on (34), we can have (53)

Through the iterative operation of (53), we can derive (54) Then we use the iterative method that is similar to Theorem 1 and finally get the result of Corollary 1.

Remark 2 λn is a global information required by each agent. The following inequality gives the bound on λn. Then, the bounds for h and γ can be obtained from Eq (45). (55) Thus, condition (45) can be changed as: (56)

3.3 The distributed DET-ZGS algorithm with arbitrary sampling period

According to the above analysis, the sampling period significantly affects the performance of the algorithm. When the period interval is selected to be large, it cannot be guaranteed that the algorithm will find the global optimal value. This subsection handles the sampling period on the basis of algorithm (6) and proposes a distributed DET-ZGS algorithm where the sampling period can be designed arbitrarily.

The algorithm is designed as: (57) (58)

The DET condition changes as (59) (60) (61)

Theorem 2 Suppose the undirected graph is connected. For and t > 0, when condition (62)–(64) is satisfied, the system state converges to the optimal solution x* under the effect of algorithm (57) and the DET condition (59). (62) (63) (64)

Proof: For t ∈ [ςh + τ, (ς + 1) h + τ), define a Lyapunov function (65) where and .

Then we have (66)

According to (28) and (29), we obtain (67)

From (61), it follows that (68) Combine (67) and (68) yields (69)

From Eq (34), it follows that (70)

Then iterate to obtain (71)

Then use the previous similar analysis to complete the proof of Theorem 2.

Remark 3 The stability conditions derived from Theorem 2 reveal that when the sampling period h is chosen to be small, τ and h can be eliminated due to 0 < τ < h; When the sampling period h takes a large value, the term can be ignored. From the perspective of simulation experiments, longer sampling periods require more time steps, but still lead to optimal solutions. However, in [26], excessively large sampling periods make it difficult to satisfy the stability conditions, resulting in the algorithm’s failure to converge and find the optimal solution. Therefore, the algorithm proposed in this paper allows the sampling period to be arbitrarily large, which is of great significance.

4 Simulation result

In this section, a MAS comprising 4 agents is examined. The communication topology among these agents is both strongly connected and undirected, as depicted in Fig 1. Notably, each agent features a unique cost function, which is defined as follows:

thumbnail
Fig 1. The communication topology of 4 agents, where there lacks communication between agent 2 and 4, agent 1 and 3, and the rest are undirected communication.

https://doi.org/10.1371/journal.pone.0299535.g001

It is clear that the minimum local objective function is obtained when xi is equal to i, respectively. However, this is not the global optimal solution x*. Thus we need to employ the proposed algorithm to find x*. We set the important parameters for the simulation at first. Set ϕmin = 16, γ = 0.1 and ωi = 1, ξi(0) = 5, μi = 0.2, εi = 0.2, xi(0) = i, i = 1, 2, 3, 4.

First, the effect of the sampling period is not considered, i.e., set h = 1s and τ = 0.2s, the process of agents gradually reaching consensus is shown in Fig 2. Each agent gradually agrees from the local optimal solution and finds the global optimal solution x* = 2.86. This proves that the algorithm in this paper has good performance and that it is feasible to construct the DET condition using the previous moment state values. The state evolution of the control input ui is shown in Fig 3. It can see that ui is updated only at the interval of the ET of the agent or its neighbors and converges to 0 after reaching consensus.

thumbnail
Fig 2. The state of agent using (6) with h = 1s, τ = 0.2s.

https://doi.org/10.1371/journal.pone.0299535.g002

thumbnail
Fig 3. The evolution of ui(t) with h = 1s, τ = 0.2s.

ui(t) is updated when the agent or its neighbors reach the ET condition and converges to 0 after consensus is reached between agents.

https://doi.org/10.1371/journal.pone.0299535.g003

When the effect of sampling period is considered, the agents’ state are exhibited in Fig 4(a). A comparison with Fig 2 reveals that the agents require less time to attain the optimal value. It is evident that the algorithm (57) outperforms algorithm (6) after the effect of sampling period is removed. The ET interval for each agent is shown in Fig 5(a). Compared to continuous communication, using an ET scheme can significantly reduce the frequency of communication. To further analyze the effect of sampling period, different sampling periods are chosen with constant time delay. When setting h = 2s, τ = 0.2s, the agents’ state are shown in Fig 4(b). Compared with Fig 4(a), it takes longer to reach the optimal solution. Then the ET interval for each agent is shown in Fig 5(b). The ET frequency is reduced after selecting a larger h. In fact, this is quite normal. Because a larger h will weaken the feedback gain and reduce the number of control updates in a fixed finite time interval. Thus, a balance must be made between the speed of convergence and the frequency of communication.

thumbnail
Fig 4.

(a)The state of agent using (57) with h = 1s, τ = 0.2s. (b) The state of agent using (57) with h = 2s, τ = 0.2s.

https://doi.org/10.1371/journal.pone.0299535.g004

thumbnail
Fig 5.

(a)The event triggered moment with h = 1s, τ = 0.2s. (b) The event triggered moment with h = 2s, τ = 0.2s.

https://doi.org/10.1371/journal.pone.0299535.g005

5 Conclusions

This paper proposes a distributed DET-ZGS algorithm to solve the optimization problem under undirected graphs. The DET condition includes a variable related to the agent state at the previous moment, which allows to avoid continuous communication when the agent state is close to the optimal value. By integrating sampling method and DET mechanism, the zeno behavior can be eliminated. Furthermore, the proposed algorithm design accounts for the impact of the sampling period, which can be arbitrarily large. For systems with time delay, the sufficient conditions are presented to ensure that the MAS obtains an optimal solution. Future work will expand the algorithm to directed and switched topologies.

References

  1. 1. Xie J.; Huang S.; Wei D.; Zhang Z. Scheduling of Multisensor for UAV Cluster Based on Harris Hawks Optimization With an Adaptive Golden Sine Search Mechanism. IEEE Sensors Journal. 2022;22(10):9621–9635.
  2. 2. Maheswararajah S.; Halgamuge S. K.; Premaratne M. Sensor Scheduling for Target Tracking by Suboptimal Algorithms. IEEE Transactions on Vehicular Technology. 2009;58(3):1467–1479.
  3. 3. Derenick J. C.; Spletzer J. R. Convex Optimization Strategies for Coordinating Large-Scale Robot Formations. IEEE Transactions on Robotics. 2007;23(6):1252–1259.
  4. 4. Wang X.; Liu W.; Wu Q.; Li S. A Modular Optimal Formation Control Scheme of Multiagent Systems With Application to Multiple Mobile Robots. IEEE Transactions on Industrial Electronics. 2022;69(9):9331–9341.
  5. 5. Cheng Y.; Ugrinovskii V. Event-triggered leader-following tracking control for multivariable multi-agent systems. Automatica. 2016;70:204–210.
  6. 6. Li H.; Wang Z.; Chen G.; Dong Z. Distributed robust algorithm for economic dispatch in smart grids over general unbalanced directed networks. IEEE Transactions on Industrial Informatics. 2019;16(7):4322–4332.
  7. 7. Jiang Y.; Sauerteig P.; Houska B.; Worthmann K. Distributed Optimization Using ALADIN for MPC in Smart Grids. IEEE Transactions on Control Systems Technology. 2021;29(5):2142–2152.
  8. 8. Li Z.; Ding Z.; Sun J.; Li Z. Distributed Adaptive Convex Optimization on Directed Graphs via Continuous-Time Algorithms. IEEE Transactions on Automatic Control. 2018;63(5):1434–1441.
  9. 9. Yang S.; Liu Q.; Wang J. A Multi-Agent System With a Proportional-Integral Protocol for Distributed Constrained Optimization. IEEE Transactions on Automatic Control. 2017;62(7):3461–3467.
  10. 10. Varagnolo D.; Zanella F.; Cenedese A. Newton-Raphson Consensus for Distributed Convex Optimization. IEEE Transactions on Automatic Control. 2016;61(4):994–1009.
  11. 11. Lu J.; Tang C. Zero-Gradient-Sum Algorithms for Distributed Convex Optimization: The Continuous-Time Case. IEEE Transactions on Automatic Control. 2012;57(9):2348–2354.
  12. 12. Liu J.; Chen W.; Dai H. Distributed zero-gradient-sum (ZGS) consensus optimisation over networks with time-varying topologies. International Journal of Systems Science. 2017;48(9):1836–1843.
  13. 13. Dimarogonas D.; Frazzoli E.; Johansson K. Distributed event-triggered control for multi-agent systems. IEEE Transactions on automatic control. 2011;57(5):1291–1297.
  14. 14. Kajiyama Y.; Hayashi N.; Takai S. Distributed Subgradient Method With Edge-Based Event-Triggered Communication. IEEE Transactions on Automatic Control. 2018;63(7):2248–2255.
  15. 15. Liu J.; Chen W.; Dai H. Event-triggered zero-gradient-sum distributed convex optimisation over networks with time-varying topologies. International Journal of Control. 2019;92(12):2829–2841.
  16. 16. Ge X.; Han Q.; Wang Z. A dynamic event-triggered transmission scheme for distributed set-membership estimation over wireless sensor networks. IEEE transactions on cybernetics. 2017;49(1):171–183.
  17. 17. Zhang J.; Fridman E. Dynamic event-triggered control of networked stochastic systems with scheduling protocols. IEEE Transactions on Automatic Control. 2021;66(12):6139–6147.
  18. 18. Wang J.; Luo X.; Yan J. Event-triggered consensus control for second-order multi-agent system subject to saturation and time delay. Journal of the Franklin Institute. 2021;358(9):4895–4916.
  19. 19. Wang A.; Zhao Y. Event-triggered consensus control for leader-following multi-agent systems with time-varying delays. Journal of the Franklin Institute. 2016;353(17):4754–4771.
  20. 20. Liu K.; Ji Z. Consensus of multi-agent systems with time delay based on periodic sample and event hybrid control. Neurocomputing. 2017;270:11–17.
  21. 21. Hu H.; Huang S.; Wu H. Finite-time event-triggered control for switched affine systems with time-varying delay under state-dependent switching. International Journal of Systems Science. 2022;53(6):1317–1333.
  22. 22. Wei M.; Zhang Y.; Zhang B. Dual-channel event-triggered control for positive nonlinear systems. International Journal of Systems Science. 2022;53(15):3351–3363.
  23. 23. Tang Z.; Li C. Distributed event-triggered containment control for discrete-time multi-agent systems. International Journal of Control, Automation and Systems. 2018;16(6):2727–2732.
  24. 24. Liu J.; Chen W.; Dai H. Sampled-data based distributed convex optimization with event-triggered communication. International Journal of Control, Automation and Systems. 2016;14(6):1421–1429.
  25. 25. Chen W.; Ren W. Event-triggered zero-gradient-sum distributed consensus optimization over directed networks. Automatica. 2016;65:90–97.
  26. 26. Zhao Z. Sample-based Dynamic Event-triggered Algorithm for Optimization Problem of Multi-agent Systems. International Journal of Control, Automation and Systems. 2022;20(8):2492–2502.