In this paper, a fast smooth second-order sliding mode control is presented for a class of stochastic systems with enumerable Ornstein-Uhlenbeck colored noises. The finite-time mean-square practical stability and finite-time mean-square practical reachability are first introduced. Instead of treating the noise as bounded disturbance, the stochastic control techniques are incorporated into the design of the controller. The finite-time convergence of the prescribed sliding variable dynamics system is proved by using stochastic Lyapunov-like techniques. Then the proposed sliding mode controller is applied to a second-order nonlinear stochastic system. Simulation results are presented comparing with smooth second-order sliding mode control to validate the analysis.
Citation: Yang P, Fang Y, Wu Y, Liu Y, Zhang D (2017) Fast smooth second-order sliding mode control for systems with additive colored noises. PLoS ONE 12(5): e0178455. https://doi.org/10.1371/journal.pone.0178455
Editor: Yilun Shang, Tongji University, CHINA
Received: February 22, 2017; Accepted: May 12, 2017; Published: May 31, 2017
Copyright: © 2017 Yang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work has been supported by the Major Program of the National Natural Science Foundation of China (No. 61627901). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Sliding mode control (SMC) is well known for its robustness to system parameter variations and external disturbances[1,2]. SMC has extensive applications in practice, such as robots, aircrafts, DC and AC motors, power systems, process control and so on. Recently, using SMC strategy to the nonlinear stochastic systems modeled by the Itô stochastic differential equations with multiplicative noise has been gaining much investigation, see [3–6] and references therein.
The existing research findings applying SMC to the stochastic systems always treat the stochastic noise as bounded uncertainties. These methods need to know the upper bound of the noise and they are comparatively more conservative control strategy, which ensure the robustness at the cost of losing control accuracy. Some literatures derived SMC for the stochastic systems described in Itô’s form applying stability in probability, which was proved to be unstable under the second moment stability concept. By comparison, mean-square stability is more practical for engineering application. Wu et al. designed SMC guaranteeing the mean-square exponential stability for the continuous-time switched stochastic systems with multiplicative noise. However, the control signal in  switches frequently and the results cannot be extended to stochastic systems with additive noise.
One disadvantage of classical SMC is that the sliding variable cannot converge to the sliding surface in finite time. Finite-time convergence has been widely investigated in the control systems. Shang discussed the finite-time state consensus problems for multi-agent systems[9,10], and further investigated the finite-time cluster average consensus in bidirectional networks and the fixed-time group consensus problem for a leader-follower network[11,12]. It is urgent to deduce finite-time convergence sliding mode method for stochastic systems.
In addition, traditional SMC has restrictions such as the relative degree constraint and the high frequency control switching that may easily cause chattering effect. Rahmani designed an adaptive neural network to approximate the system uncertainties and unknown disturbances to reduce chattering phenomena, and proposed controllers combining adaptive neural network with sliding mode control methods[14,15]. Ref. designed a fractional order PID controller to a bio-inspired robot manipulator using bat algorithm. Higher-order sliding mode control (HOSM) also mitigates the problems associated with SMC[17–21]. In the past decades, HOSM has found a variety of application in the robust control of uncertain systems[22,23]. But HOSM for the stochastic systems is remaining poorly investigated.
Aiming at the defects of the above mentioned research, a smooth control law for a class of nonlinear stochastic systems with Ornstein-Uhlenbeck colored noise is developed in this paper. By using stochastic Lyapunov-like techniques, a sufficient condition of finite-time convergence is derived under the mean-square practical stability concept. Finally, some experimental results are presented to validate the proposed controller.
Materials and methods
Let α > 0 and σ = const., the following Itô stochastic differential equation (1) is called Langevin equation, where ζ(t) is a standard scalar Gaussian white noise. The solution η(t) (t ≥ 0) is called Ornstein-Uhlenbeck process, which is a colored noise.
Consider single-input single-output (SISO) dynamics with denumerable Ornstein-Uhlenbeck colored noises (2) where hi are constants; f(t), g(t) are given sufficiently smooth function and g(x) ≠ 0; d(t) presents unmodeled dynamics, parametric uncertainties and external disturbances, which is assumed to be sufficiently smooth; are mutually independent Ornstein-Uhlenbeck colored noises with parameters αi and . s can be interpreted as dynamics of the sliding variable s ∈ R1 calculated along the system trajectory and s = 0 expresses sliding manifold; u ∈ R1 is the control input. In order to prevent the chattering and exploit the benefits of a sliding mode controller in a real-life system, a smooth control, which can provide a finite time convergence , is urgently needed.
Stochastic fast smooth second-order sliding mode control
Problem formulation and definitions.
Obviously, system (2) is a stochastic nonlinear system with additive noise, meaning that the system does not have any equilibrium point. This system is unstable under the concept of stability in the sense of Lyapunov, but may also exhibit interesting behavior similar to a conventional stable system near equilibrium[25,26]. That is to say, the desired state is mathematically unstable, but the system may oscillate sufficiently near this state so that the performance is considered acceptable. Motivated by this fact, practical stability is proposed by LaSalle and Lefschetz and was developed by Martynyuk, Lakshmikantham and Leela et al[29,30].
As a natural extension of the traditional concepts of practical stability, mean-square stability, and finite-time reachability, we shall introduce the concepts of finite-time mean-square practical stability and finite-time mean-square practical reachability. These concepts are concerned with bringing the system trajectory into a bounded neighborhood of a given point or manifold.
Consider the following stochastic dynamical system (3) where f ∈ C[R+ × Rn,Rn], h ∈ C[R+ × Rn,Rn]; η is 1-dimensional stochastic process. Denote x(t) = x(t,t0,x0) as the solution of (3) under the initial condition (t0,x0). Let s = s(t,x) = 0 be the chosen sliding manifold of the system.
Definition 1 (FTMSP): The solution x(t) of system (3) is said to be
(S1) mean-square practically stable with respect to (λ,A), if given a pair of positive numbers (λ,A) with A > λ > 0 such that ‖x0‖ < λ implies E‖x‖2 < A,t ≥ t0 for some t0 ∈ R+;
(S2) mean-square uniformly practically stable with respect to (λ,A), if (S1) holds for all t0 ∈R+;
(S3) finite-time mean-square practically stable with respect to (λ,ε), if for every ε, there exist T and λ such that ‖x0‖ ≤ λ implies E‖x‖2 < ε,t ≥ t0 + T for some t0 ∈R+;
(S4) finite-time mean-square uniformly practically stable with respect to (λ,ε), if (S3) holds for all t0 ∈R+;
(S5) finite-time mean-square strongly practically stable with respect to (λ,ε), if (S1) and (S3) hold simultaneously;
(S6) finite-time mean-square strongly uniformly practically stable with respect to (λ,ε), if (S2) and (S4) hold simultaneously.
Definition 2 (FTMSR): The sliding manifold s=0 is said to be
(R1) finite-time mean-square practically reached, if given a pair of positive numbers (λ,ε), λ = λ1 + λ2 and ε = ε1 + ε2, there exists a finite setting time T = T(t0,ε), such that implies E‖s(x,t)‖2 ≤ ε,∀t > t0 + T for some t0 ∈R+;
(R2) finite-time mean-square uniformly practically reached, if (R1) holds for all t0 ∈R+;
(R3) second-order finite-time mean-square practically reached, if given a pair of positive numbers (λ,ε), λ = λ1 + λ2 and ε = ε1 + ε2, there exists a finite setting time T = T(t0,ε), such that implies for some t0 ∈R+;
(R4) second-order finite-time mean-square uniformly practically reached, if (R3) holds for all t0 ∈R+;
Stochastic fast smooth second-order sliding mode control.
Consider system Eq (5), the dynamics of the sliding variable is designed as the following form: (6) where μ1 = s; m and ki are positive constants and m > 2; ηi are Ornstein-Uhlenbeck colored noises expressed in (4).
Let μ = [μ1, μ2, η1, η2, ⋯, η1]T, the following Itô stochastic differential equation can be got by combining (5) and (6) together: (7) then a stochastic system with respect to the state vector μ can be represented as (8) where (9)
Let the sliding variable dynamics be of the form (6) and in accordance with the sliding variable system (5), the SFS-SOSM controller is selected as (10) where is the estimation of uncertain function by means of high-order sliding-mode observer presented in .
Hereafter, FTMSP and FTMSR are employed to analyze the reachability of the sliding manifold.
Finite time convergence analysis.
Based on the definition proposed above, we give the following theorem:
Theorem 1: Consider the stochastic nonlinear system (6) with respect to the sliding variable s, let (11) where m > 2, αi > 0 (i = 1,2,⋯,l), kj > 0 (j = 1,⋯,5). Constructing the following matrix (12) and assuming that
(i) and the following inequality holds (13) where σi are the parameter of the colored noise mentioned in (4).
Then the prescribed sliding variable dynamics system (6) is finite-time mean-square practically stable, and the proposed control (10) is an SFS-SOSM control. The sliding manifold s = 0 can be second-order mean-square practically reached in finite time.
Proof: According to the definition given before, we want to prove that for the prescribed sliding variable dynamics system (6), if given positive numbers (λ,ε), λ = λ1 + λ2 and ε = ε1+ ε2, there exists a finite setting time T = T(t0,ε), such that implies
To prove this, aiming at the augmented system (8), we define the Lyapunov-like functional as (15) Since V(μ) is continuous but not differentiable, a nonsmooth version of Lyapunov’s theory is required, which shows that one can just consider the points where V(μ) is differentiable[28,29]. This argument is valid in all the proofs of this paper.
The substitution ξ = [|μ1|,|μ2|,|η1|,|η2|,⋯,|η1|]T brings the proposed functional (15) to a quadratic form (16) where Λ is given in (12). It is obvious that Λ is positive definite since αi > 0 (i = 1,2,⋯,l), kj > 0 (j = 1,⋯,5). Note that V(μ) is positive definite and unbounded, the following inequalities can be obtained based on Rayleigh-Ritz Theorem (17) where is the Euclidean norm of ξ, λmin(Λ) and λmax(Λ) are minimal and maximal eigenvalues of Λ.
We denote the infinitesimal generator by ℒ. Appling infinitesimal generator along with system (8), we have (18) Let ℒV1 can be expanded and the following inequality holds (19)
Substitute(23), (24) into (18) to get (25) According to Itô’s formula, it follows that (26) Since ηi are mutually independent, utilizing E[η2 (t)] ≤ σ2/2α and Rao inequality to obtain: (27) Then inequality (26) can be further represented as (28) where (29) It is obvious that γ1,γ2 > 0.
Since the solution of the differential equation (30) is given by (31) it follows from the comparison principle that EV(t) ≤ φ(t) when EV(t0) ≤ φ0. From (31) we can claim that the following inequality holds.(32)
For convenient, we denote and synthesize the results we have got in (17), (32), (33), the following inequality can be deduced (34) Let (35) Taking the derivative of H(t) and using condition (ii), the following inequality holds (36) meaning that H(t) is monotonically decreasing with respect to time t, and the theoretical lower bound Hmin is (37) By condition (ii), we have , define T as the time taken to achieve , then the expression of T can be deduced by (38)
Solving (38) results in (39) By Definition 1, we can claim that the augmented system (8) is finite-time mean-square uniformly practically stable with respect to . Now we must deduce the bounds of to investigate the reachability of the sliding manifold.
It is easy to see that can be achieved within the time interval T, as for , the following inequality can be obtained with reference to (6): (40)
From the whole proving process, we notice that the parameter can be interpreted as the control precision index, so we can reasonably assume that is much less than 1 to meet the needs of engineering practice, and note that m > 2, we have (45) So the following inequalities hold (46) Let , by Definition 2, we can claim that the sliding manifold s = 0 is second-order finite-time mean-square practically reachable with respect to (λ,ε). So the proof is completed.
The control approach block-diagram of proposed SFS-SOSM method is shown in Fig 1.
The design process of the controller is: first, the sliding variable dynamics , where x represent the system states, is obtained according to the expected system properties; Then the control law u is got by combining and the prescribed s-dynamics Eq(6); So the smooth control law u can steer the system state reach the desired value in finite time.
Remark 2: The proposed control law (10) is a SFS-SOSM control, which is smooth and can provides a finite time convergence .
Remark 3: ε can be treated as the convergence precision. It can be seen from condition (i) that ε depends on the parameters of the colored noise and the designed parameters of the controller.
In this section, a second-order nonlinear stochastic system is taken into consideration to illustrate the necessity and effectiveness of the proposed control law.
Consider the following second-order SISO nonlinear stochastic system with colored noise (47) where and ζ is a zero-mean scalar Gaussian process with covariance 1. The initial state is (x1,x2) = (2,5).
In order to achieve finite time convergence, the following auxiliary integral sliding variable (48) is introduced. This sliding surface can guarantee a finite-time convergence of the system state due to its nonlinear switching manifold characteristic.
The prescribed compensated s-dynamics providing finite-time mean-square convergence are selected in a format (6). In accordance with (10) the smooth control input is selected to be (49) where the parameters are taken as m = 3, k1 = 20, k2 = 20, k3 = 1, k4 = 6, k5 = 6.
The effectiveness of the SFS-SOSM control is investigated by comparing the SFS-SOSM control with the smooth second-order sliding mode (SSOSM) control, which is designed to deal with deterministic systems. The SSOSM control is taken as  (50) where the parameters are taken as m = 3, α1 = 20, α2 = 6. In (49) and (50), is the estimation of uncertain function d(t) by means of observer presented in .
It is obvious that both of the controllers can steer the system state from the initial position to the sliding surface, and then the sliding mode with state trajectories in this surface starts and thereafter remains on it. At the same time, the chattering of the sliding mode is eliminated in view of these figures.
From the partial enlargements of the Figs 2 and 3, we can see that the SFS-SOSM controller can steer the system trajectory closer to the sliding surface comparing with the SSOSM controller. This result demonstrates that the SFS-SOSM method can significantly improve the control precision, since the stochastic control techniques are employed to handle the noise. By contrast, the SSOSM controller adopts a more conservative control strategy, treating the stochastic noise as bounded uncertainties, which ensures the robustness at the cost of losing accuracy.
The trajectory tracking error is shown in Figs 4 and 5. It is obvious that the error convergence rate of SFS-SOSM is faster than SSOSM. The overshoot of SSOSM controller is larger than SFS-SOSM, which demonstrate that the SSOSM control is more conservative since it overestimates the bound of uncertainties.
The control signal of the SFS-SOSM controller and the SSOSM controller are presented in Figs 6 and 7. It is evident that neither of the controllers has high frequency switching benefited from the smooth controller design, but the overshoot of SSOSM controller is greater than SFS-SOSM.
Figs 8 and 9 show the simulated results of the sliding variable s and its derivative under the SFS-SOSM control. From these figures, we can see that the proposed smooth control law can stabilize the sliding variable and its derivative at a sufficiently small neighborhood of zero in finite time, which means that the proposed control achieves the second-order sliding modes.
In this paper, a SFS-SOSM controller for stochastic system with additive Ornstein-Uhlenbeck colored noise has been proposed. The time to achieve second-order reachability to the sliding manifold from initial system states has been proved to be finite. The new proposed sliding mode controller has the following advantages: first, it can eliminate the chattering associated with traditional sliding mode; second, it has no high frequency switching needed to be smooth at the price of losing robustness; third, it can achieve higher control accuracy since the stochastic technique is employed to design the controller instead of treating the noise as bounded uncertainty. Simulation results are presented to validate the analysis.
Future work includes optimizing the controller parameters to achieve better control performance and applying the proposed control to the practice engineering problems. We will also consider designing a more perfect disturbance observer to replace observer presented in  to improve the control precision.
S1 Table. The Simulation Data of SFS-SOSM Control.
This work has been supported by the Major Program of the National Natural Science Foundation of China (No. 61627901).
- Conceptualization: PY YF YW.
- Data curation: YF YW.
- Formal analysis: PY YL DZ.
- Funding acquisition: YF.
- Investigation: PY YL DZ.
- Methodology: YF YW.
- Project administration: YF.
- Resources: YF YW.
- Software: PY YL DZ.
- Supervision: YF YW.
- Validation: PY YL.
- Visualization: PY YL.
- Writing – original draft: PY YL DZ.
- Writing – review & editing: PY YF YW YL DZ.
- 1. Utkin VI. Sliding modes in control optimization. Berlin, Heidelberg: Springer. 1992
- 2. Slotine JE, Li W. Applied non-linear control. Englewood Cliffs, NJ: Prentice-Hall. 1991
- 3. Niu Y, Daniel WCH, Wang X. Robust H∞ control for nonlinear stochastic systems: a sliding-mode approach. IEEE Transactions on Automatic Control, 2008, 53(7): 1695–1701
- 4. Florchinger P. Lyapunov-like techniques for stochastic stability. SIAM Journal on Control and Optimization, 1995, 33: 1151–1169
- 5. Deng H, Krstic M. Output-feedback stochastic nonlinear stabilization. IEEE Transactions on Automatic Control, 1999, 44(2): 328–333
- 6. Pan Z, Basar T. Backstepping controller design for nonlinear stochastic systems under a risk-sensitive const. SIAM Journal on Control and Optimization, 1999, 33: 957–995
- 7. Khasminskii R. Stochastic stability of differential equations (2nd Edition). Berlin, Heidelberg: Springer. 2012
- 8. Wu L, Zheng W, Gao H. Dissipativity-based sliding mode control of switched stochastic systems. IEEE Transactions on Automatic Control, 2013, 58(3): 785–791
- 9. Shang Y. Finite-time consensus for multi-agent systems with fixed topologies, International Journal of Systems Science, 2012, 43(3): 499–506
- 10. Shang Y. Finite-time weighted average consensus and generalized consensus over a subset, IEEE Access, 2016, 4: 2615–2620
- 11. Shang Y. Finite-time cluster average consensus for networks via distributed iterations, International Journal of Control, Automation and Systems, 2017: 1–6
- 12. Shang Y, Ye Y. Leader-follower fixed-time group consensus control of multiagent systems under directed topology, Complexity, 2017
- 13. Shtessel YB, Edwards C, Fridman L, Levant A. Sliding mode control and observation. Berlin, Heidelberg: Springer. 2014
- 14. Rahmani M, Ghanbari A, Ettefagh MM. Robust adaptive control of a bio-inspired robot manipulator using bat algorithm, Expert Systems with Applications, 2016, 56(C): 164–176
- 15. Rahmani M, Ghanbari A, Ettefagh MM. A novel adaptive neural network integral sliding-mode control of a biped robot using bat algorithm, Journal of Vibration and Control, 2016: 1–16
- 16. Rahmani M, Ghanbari A, Ettefagh MM. Hybrid neural network fraction integral terminal sliding mode control of an Inchworm robot manipulator, Mechanical Systems and Signal Processing, 2016, 80: 117–136
- 17. Bartolini G, Ferrara A, Giacomini L, Usai A. Properties of a combined adaptive/second-order sliding mode control algorithm for some classes of uncertain nonlinear systems. IEEE Transactions on Automatic Control, 2000, 45(7): 1334–1341
- 18. Levant A, Robust exact differentiation via sliding mode technique. Automatica, 1998, 34(3): 379–384
- 19. Levant A, Sliding order and sliding accuracy in sliding mode control, International Journal of Control, 1993, 58(6): 1246–1263
- 20. Levant A, Higher order sliding modes, differentiation and output-feedback control, International Journal of Control, 2003, 76(9/10): 924–941
- 21. Shtessel YB, Shkolnikov IA, Brown M. An asymptotic second-order smooth sliding mode control. Asian Journal of Control, 2003, 4(5), 498–504
- 22. Shtessel YB, Shkolnikov IA, Levant A. Smooth second-order sliding modes: missile guidance application. Automatica, 2007, 43(8): 1470–1476
- 23. Shtessel YB, Shkolnikov IA. Integrated guidance and control of advanced interceptors using second order sliding modes. 42nd IEEE Conference on Decision and Control (vol. 5), Maui, Hawaii, 2003: 4587–4592
- 24. Arnold L. Stochastic differential equations: theory and applications. New York: John Wiley and Sons, 1974
- 25. Xu X, Zhai G, He S. Stabilizability and practical stabilizability of continuous-time switched systems: a unified view. Proceedings of 2007 American Control Conference, New York, July 11–13, 2007: 663–668
- 26. Kuiava R, Ramos RA, Pota HR, Alberto LFC. Practical stability of switched systems without a common equilibria and governed by a time-dependent switching signal. European Journal of Control, 2013, 19: 206–213
- 27. Song X, Li S, Li A. Practical stability of nonlinear differential equation with initial time difference. Applied Mathematics and Computation, 2008, 203: 157–162
- 28. La Salle J, Lefschetz S. Stability by Liapunov's direct method with applications. New York: Academic Press, 1961
- 29. Lakshmikantham V, Leela S, Martynyuk AA. Practical stability of non-linear systems. Singapore: World Scientific, 1990
- 30. Lakshmikantham V, Zhang Y. Strict practical stability of delay differential equation. Applied Mathematics and Computation, 2001, 122: 341–351.
- 31. Rao CR. Linear statistical inference and its applications (2nd edition), New Jersey: John Wiley & Sons, 1973
- 32. Khalil HK. Nonlinear Systems (3rd Edition). New Jersey: Prentice-Hall, Upsaddle River, 2002.