Stability has been regarded by many as a fascinating and difficult problem of human culture. Stability problems are present in all our lives. The act of standing is an example of maintaining stability that we learn to control at a very early age. Stability of physical systems and of social systems, such as economies and ecosystems, are frequently discussed on the news. Stability is present everywhere and is a fundamental subject that permeates engineering and the sciences.
Stability is a very broad subject, and the concept of stability can be formulated in a variety of ways depending on the intended use of stability analysis and design. As such, at least 50 different terms for stability concepts appear in the literature. An important subject closely related to stability is the stability region (i.e. region of attraction or domain of attraction) of nonlinear dynamical systems, the main subject of this book.
Many nonlinear physical and engineering systems are designed to be operated at an equilibrium state (i.e. equilibrium point). A first and foremost requirement for successful operation of these systems is to maintain stability of this equilibrium state. Stability requires robustness of the equilibrium point to small perturbations, i.e. the system state returns to the equilibrium state after small perturbations. Since most physical and engineering systems are not globally stable, equilibrium states can only be restored under a limited amount (or size) of perturbation. Intuitively, one can state that a system sustaining a larger size of perturbation is “more” stable or “more” robust than another system. We will see that this “degree” of stability is related to the concept of the stability region of nonlinear dynamical systems, which will be thoroughly explained and explored in this book.
1.1 Degree of stability
In order to illustrate the concept of stability and the “degree” of stability or “robustness” of stability, we consider two solid bodies of different size lying on the ground as shown in Figure 1.1. Their respective positions are stable. The stable position of the solid A is recovered after a small perturbation is applied to the solid, as indicated in Figure 1.2. However, if the perturbation is large enough, then the body will reach another equilibrium position, as seen in Figure 1.3, and will not return to the original (stable) equilibrium point. This system possesses multiple equilibrium states, some of which are stable but not globally stable. If one needs to determine which solid has a more “stable” equilibrium position, then it is obvious that solid B is “more stable” than solid A. More precisely, the “amount” of disturbance (i.e. perturbation) needed to push solid B away from its stable position is much larger than the amount of disturbance that is needed to push solid A away from its stable position. This “degree of stability” is related to the concept of stability region. It is clear that the stable position of solid B has a larger stability region than the stable position of solid A.
Solids A and B have the same weight and volume. The point GC indicates the center of gravity of the solid. Their positions are both stable but the stability of the position of solid B is more robust to perturbations than that of solid A. The stability region of B is larger than the stability region of A.
The solid is in a stable position. A small perturbation F is applied to the solid. After the removal of that perturbation, the solid returns to its original stable position.
The solid is in a stable position. A sufficiently large perturbation F is applied to the solid to make the solid settle down into another stable position, showing that the stable positions of this system are not globally stable.
Generally speaking, the concepts of both stability and asymptotic stability are local and do not provide information regarding how robust the system is with respect to disturbance and/or model uncertainty. The concept of stability region, on the other hand, is a global one and gives a complete picture of “the degree of stability” with respect to noise or perturbations or model uncertainty. More specifically, knowledge of the stability region provides, for a given initial condition or a specified amount of perturbation, information on whether or not the system will settle down to a desirable steady state condition.
1.2 Stability regions
We consider the following (autonomous) nonlinear dynamical system
(1.1)It is natural to assume the function (i.e. the vector field) f: Rn → Rn satisfies a sufficient condition for the existence and uniqueness of the solution. The solution of (1.1) starting at x0 at time t = 0 will be denoted ϕ(t,x0), or x(t) when it is clear from the context.
For an asymptotic stable equilibrium point
, there exists a number δ<0 such that ||x0 –
|| < δ implies ϕ(t, x0) →
as t → ∞. In other words, there exists a neighborhood of the equilibrium point such that every solution starting in this neighborhood is attracted to the equilibrium point as time tends to infinity. If δ can be chosen arbitrarily large, then every trajectory is attracted to
and
is called a global asymptotically stable equilibrium point. There are many physical systems containing asymptotically stable equilibrium points but not globally stable equilibrium points. A useful concept for these kinds of systems is that of the stability region (also called the region of attraction or domain of attraction). The stability region of a stable equilibrium point xs is the set of all points x such that
(1.2)In words, the stability region of xs is the set of all initial conditions x whose trajectories tend to xs as time tends to infinity. We will denote the stability region of xs by A(xs), and its closure by Ā(xs), respectively; hence
(1.3)When it is clear from the context, we write A for A(xs). From a topological point of view, the stability region A(xs) is an open, invariant and connected set. The boundary of the stability region A(xs) is called the stability boundary (also called the separatrix) of xs and will be denoted by ∂A(xs). Figure 1.4 illustrates the concept of stability region and stability boundary.
As time increases, every trajectory in the stability region A(xs) converges to the asymptotic stable equilibrium point (SEP) xs and every trajectory on the stability boundary evolves on the stability boundary.

The concept of stability region of an asymptotic stable equilibrium point can be extended to that of other types of attractors. For example, the stability region of an asymptotic stable closed orbit, γ, is defined as follows:

where d(.,.) is a distance function. The stability regions of other types of attractors, such as asymptotically stable quasi-periodic solutions and asymptotically stable chaotic trajectories, are similarly defined. Global stability (i.e. stability in the large) rarely occurs in physical and engineering systems due to physical and operational limits, such as saturations and control actions. In addition, the cost of designing systems to be globally stable, when feasible, is usually very high. These factors make the task of determining stability regions of nonlinear systems of great importance for practical application. It is fair to state that knowledge of the stability region of an attractor is equally important to verification of the stability of the attractor itself.
Knowledge of the stability region is essential in a variety of application areas such as direct methods for power system transient stability analysis [Reference Chiang, Chu and Cauley51,Reference Chiang, Wu and Varaya65,Reference Davy and Hiskens81,Reference Hill and Mareels121,Reference Praprost and Loparo207,Reference Sauer and Pai224,Reference Varaiya, Wu and Chen257,Reference Venkatasubramanian, Schattler and Zaborsky264,Reference Xin, Gan, Qiu and Qu280], stabilization of nonlinear systems [Reference da Silva and Tarbouriech101,Reference Henrion, Tarbouriech and Garcia120,Reference Kokotovic and Marino147,Reference Meza, Santibanez and Campa179,Reference Milani183,Reference Shim and Seo227,Reference Tibken250,Reference Toussaint and Basar253,Reference Xin, Gan, Huang and Wang279], decentralized control design for nonlinear systems, power system voltage collapse problems [Reference Hill and Mareels121,Reference Hiskens and Hill126], schemes for choosing manipulator specifications and parameters in robotics [Reference Bondi, Casalino and Gambardella26,Reference Ortega, Loria and Kelly196], the design of associative memory in artificial neural networks [Reference Ciliz and Harova71,Reference Djukanovic, Sobajic and Pao83,Reference Hopfield127], solution methods for nonlinear optimization problems [Reference Chiang, Chen, Reddy, Pardalos and Coleman48,Reference Chiang and Chu49,Reference Chiang, Lee, Lee and El-Sharkawi56,Reference Chiang, Wang and Jiang62,Reference Lee and Chiang162,Reference Lee and Chiang163], the effect of discretized feedback in a closed loop system on stability [Reference Laila, Lovera and Astolfi155], and so forth. Knowledge of the stability region of a stable limit cycle is critical in areas such as biology [Reference Baer, Li and Smith19] and robotics [Reference Westervelt, Grizzle and de Wit274,Reference Westervelt, Grizzle and Koditschek275].
Determining stability regions of nonlinear dynamical systems is an old problem, and yet it remains challenging. Recent advances in theoretical developments of stability regions and in the development of effective methods for estimating stability regions offer promising results to meet the challenges. These advances can be classified as follows.
Theoretical development:
characterization of a subset of stability regions of general nonlinear dynamical systems,
complete characterization of stability boundaries of equilibrium points and attractors of a fairly large class of nonlinear dynamical systems,
complete characterization of stability boundaries of fixed points of a class of time-discrete nonlinear dynamical systems,
characterization of stability boundaries of two-time-scale systems,
complete characterization of stability boundaries of a class of nonlinear non-hyperbolic dynamical systems,
characterization of relevant stability boundaries of a class of nonlinear dynamical systems.
Methods for estimating the stability region:
optimal estimation of stability regions of a fairly large class of continuous nonlinear dynamical systems,
optimal estimation of stability regions of second-order systems,
optimal estimation of stability regions of a large class of discrete dynamical systems,
constructive approach to iteratively improve estimations of stability regions,
optimal estimation of relevant stability regions of a class of nonlinear dynamical systems.
In this book, a comprehensive treatment of these contributions is presented in a structured way, followed by advanced topics on stability regions and by illustrations of stability-region-based practical applications.
1.3 Characterization and estimation of stability regions
It is not easy to trace the first attempt to address the issue of stability regions in the literature, but the history of development of the concept of stability sheds some light on it. The subject of stability has attracted a significant, if not the most, amount of research and development in the area of nonlinear system analysis, design and control. The theory of stability and, in particular, methods to estimate stability regions are related to energy function theory. The mathematicians Leonhard Paul Euler and Joseph-Louis Lagrange, in the eighteenth century, established relations between the equilibrium point and stability with maxima and minima of energy functions. Aleksandr Mikhailovich Lyapunov (1857–1918), inspired by his master’s thesis on fluid dynamics, developed a general theory of stability in his PhD thesis: The general problem of the stability of motion (1892). Lyapunov derived sufficient conditions for stability based on the existence of a scalar function, nowadays called the Lyapunov function in his honor. George David Birkhoff (1884–1944) made an important contribution by developing stability theory for the asymptotic behavior of trajectories of differential equations.
Krasovskii was probably the first to prove an invariance principle [Reference Krasovskii149]. This principle explores the concept of limit sets introduced by Birkhoff. Joseph P. LaSalle, who received his PhD in 1941, developed a similar invariance principle in 1960 [Reference LaSalle158]. LaSalle’s invariance principle is probably the first tool proposed for estimating stability regions in a systematic way. The work of Krasovskii and LaSalle led to the development of the expression of stability region estimates in the form of level sets of Lyapunov-like functions.This pioneering work has sparked the development of a great number of methods for estimating stability regions of high-dimensional nonlinear systems.
The existing methods for estimating stability regions proposed in the literature can be classified into Lyapunov-function-based methods and non-Lyapunov-function-based methods. Unfortunately, the vast majority of methods always offer rather conservative estimations of stability regions; in other words, these methods offer estimated stability regions which are only a (small) subset of entire stability regions. This conservative estimation can lead to serious consequences. For example, conservative estimates of the stability region may result in unnecessary interruptions in the operation of power systems and in expensive over-design of control systems. Thus, there is a serious need for the development of effective methods for accurately estimating stability regions of high-dimensional nonlinear dynamical systems.
Lyapunov-function-based methods have been popular for estimating the stability regions of stable equilibrium points. This class of methods is applicable to large-scale nonlinear systems but may suffer from overly conservative estimation of stability regions. The degree of conservativeness of Lyapunov-function-based methods in estimating stability regions depends on the underlying Lyapunov function and the associated value of the critical level. Finding a good Lyapunov function for estimating stability regions is not an easy task. There is no systematic way to derive a Lyapunov function for general nonlinear dynamical systems. Recent advances along this line of research and development include the proposal of maximal Lyapunov functions [Reference Vannelli and Vidyasagar256], the optimal estimation of stability regions based on a given Lyapunov function [Reference Chiang and Fekih-Ahmed53], LMI optimization techniques for constructing Lyapunov functions, and estimating stability regions for polynomial dynamical systems [Reference Chesi, Garulli, Tesi and Vicino41,Reference Coutinho, Bazanella, Trofino and Silva76,Reference Johansen137,Reference Levin164,Reference Tan and Packard247,Reference Tibken250,Reference Topcu, Packard, Seiler and Wheeler252] and for non-polynomial systems [Reference Chesi39]. These optimization-based methods entail high computation effort, tending to grow rapidly with the system dimension, making them unsuitable for estimating stability regions of high-dimensional nonlinear dynamical systems. The LMI-based estimation methods generally yield (overly) conservative estimations of stability regions.
Another advance is the constructive Lyapunov function methodology for determining optimal Lyapunov functions to estimate stability regions [Reference Chiang and Thorp60]. The constructive methodology yields a sequence of estimated stability regions which form a strictly monotonic increasing sequence, and yet each of them is contained in the stability region of the system under study. The constructive methodology can either stand by itself or be used with existing methods serving as the input to the constructive methodology. This methodology can reduce the conservativeness in estimating stability regions via the Lyapunov function approach.
There are very few methods which are able to estimate the entire stability region. They all entail serious computational problems, making their application impractical. For example, Zubov’s method [Reference Grune and Wirth106,Reference Margolis and Vogt175] offers a technique for computing the entire stability region via the “optimal” Lyapunov function. However, constructing this “optimal” Lyapunov function requires solving a set of nonlinear partial differential equations (PDEs) which are difficult, if not impossible, to solve. Because of this problem, several techniques have been proposed which attempt to approximate the solution of the PDEs, but with limited success. Furthermore, it has been found that even for some second-order systems the use of approximated solutions to construct the “optimal” Lyapunov function still results in rather conservative estimations.
Another method which attempts to reduce the conservativeness in estimating the stability boundary was proposed in [Reference Genesio, Tartaglia and Vicino97], in which the estimated stability boundary was synthesized from a number of system trajectories obtained by backward integration. This method, known as the trajectory reversing method [Reference Genesio, Tartaglia and Vicino97,Reference Genesio and Vicino99,Reference Loccufier and Noldus168], is suitable only for low-dimensional systems due to its excessive computational burden. Other methods for estimating the stability region include approximating the stability boundary by polytopes [Reference Psiaki and Luh208] and the cell-to-cell mapping method [Reference Hsu128].
A majority of the existing proposed methods for estimating stability regions are only applicable to low-dimensional nonlinear systems. Very few of them are applicable to high-dimensional nonlinear systems (say several hundred or thousands of dimensions). To be practical, estimation methods need to be able to deal with very large-scale systems (say, tens of thousands of state variables).
An important breakthrough in the development of the theory of stability regions occurred in the 1980s with the formulation of a comprehensive theory of stability regions and a complete characterization of the stability regions of a class of nonlinear dynamical systems [Reference Chiang, Hirsch and Wu54]. This class of nonlinear dynamical systems is characterized by its ω-limit set being composed of equilibrium points and limit cycles. A conceptual method based on the complete characterization derived in [Reference Chiang, Hirsch and Wu54], when feasible, can find the entire stability region. This method is based on a complete characterization of the stability boundary via the stable manifolds of unstable equilibrium points and unstable limit cycles on the stability boundary. For low-dimensional nonlinear dynamical systems, the derivation of the stable manifolds can be achieved by numerical methods. However, current computational methods are inadequate for computing the stable manifolds of unstable equilibrium points and/or of unstable limit cycles of high-dimensional nonlinear dynamical systems.
Knowledge of the complete characterization of a stability boundary has led to the development of several effective methods for accurate estimation of stability regions. By exploring the complete characterization of the stability boundary, several computational schemes for optimally estimating the stability regions have been developed, see for example [Reference Chiang and Fekih-Ahmed53]. These complete characterizations have also led to the development of effective methods to estimate relevant parts of the stability boundary. These methods have been fundamental to advancing a variety of important practical applications.
1.4 Practical applications of stability regions
Estimating or determining stability regions is central to solving many problems arising in sciences and engineering. The following list is a non-exhaustive enumeration of applications where knowledge of stability regions plays an important role.
1. Biology:
micromolecules and macromolecules;
dynamics of ecosystems.
2. Biomedicine:
dynamics of the immune response;
human respiratory models.
3. Control:
sliding control systems;
control of nonlinear systems;
linear systems with saturated controls;
control of polynomial systems.
4. Economics:
economic growth rate;
carrying capacity of the human population.
5. Robotics:
asymptotically stable walking cycle of a bipedal robot;
regulator design of robot manipulators.
6. Power grids and power systems:
direct power system transient stability analysis;
dynamic voltage stability analysis.
7. Power electronic circuits:
power-electronic-based converters;
DC-to-DC converters.
8. Neural networks:
dynamic recurrent neural networks;
associative memory;
Hopfield neural network models.
9. Optimization problems:
unconstrained optimization problems;
constrained optimization problems.
We briefly describe some of the above applications based on knowledge of stability regions.
1.4.1 Immune response
Stability regions provide insight into the analysis of the immune response where interaction among lymphocyte populations, antigens and antibiotics occurs [Reference Gunther and Hoffman110,Reference Kaufman and Thomas139,Reference Segel225,Reference Villafuerte and Mondié267]. The coexistence of multiple equilibriums has been reported in these models and the outcome of a treatment depends not only on how antigens are administered but also on the initial condition of the system when the treatment began. Depending on the initial condition, the dynamics of the treatment will converge to the attractor whose stability region contains the initial condition.
The immune system is primarily composed of a large number of cells called lymphocytes. Lymphocytes produce antibodies that bind to invading organisms (antigens) in order to eliminate them. An animal can produce a very large number of different antibodies (106 to 107) [Reference Gunther and Hoffman110]. The presence of an antigen stimulates the proliferation of cells (lymphocytes) with the specific antibody for that invader. The following set of differential equations models the dynamics of positive and negative cells of the immune system:

where x+ and x− respectively represent the concentrations of positive and negative cells in the organism. The constant k5 is an influx rate term while k4 is a death rate term. The function R is a replication rate that describes the proliferation of the positive cells, while the function D is a death rate due to killing by antibodies or anti-antibodies. A typical phase portrait of the immune dynamical system is shown in Figure 1.5. Typically, immunization systems have four asymptotically stable equilibrium points: the virgin state, indicated as equilibrium #1 in Figure 1.5, where the concentrations of both positive and negative cells are low, the immune state, depicted as equilibrium #5, where the concentration of positive cells is much larger than that of negative cells, the anti-immune state, equilibrium #2, where the concentration of negative cells is high compared to the concentration of positive cells, and a suppressed state, equilibrium #6, where both concentrations are high. The immunization problem consists of designing a proper perturbation to the immune system, an immunization shot for example, such that the initial condition of the system after perturbation lies inside the stability region of the immune state equilibrium point, highlighted in gray in Figure 1.5. As a result, the immune system of the organism will abandon the virgin state equilibrium #1 and settle down in the immune state equilibrium #5.
The stability region of the immune state (equilibrium #5) of a typical immunization system is highlighted. The immune system contains four asymptotically stable equilibrium points (SEPs): equilibriums #1 (virgin state), #2 (anti-immune state), #5 (immune state) and #6 (suppressed state). Their stability boundaries are depicted in this figure as black lines. Equilibriums #3, #4 and #7 are unstable equilibrium points lying on the stability boundaries of these four SEPs.
1.4.2 Ecosystems
In biology, knowledge of stability regions is relevant to the problems of ecosystem dynamics in which different species coexist, in particular the coexistence of predators and prey species [Reference Baer, Li and Smith19,Reference Korobeinikov148,Reference May176]. For example, the influence of commercial exploitation of a population of salmon on the size of stability regions was investigated in [Reference Peterman206]. The resilience of an ecosystem can be viewed as the problem of determining whether or not a certain initial population lies inside the stability region of an attractor. Large stability regions are usually related to high-level “resilience” of the ecosystems.
1.4.3 Micromolecules and macromolecules
The task of finding saddle-points lying on a potential energy surface plays a crucial role in understanding the dynamics of micromolecules as well as in studying the folding pathways of macromolecules such as proteins. This task has been a topic of active research in the field of computational chemistry for more than two decades. Several methods have been proposed in the literature based on the Hessian matrix at the saddle-points, see for example [Reference Baker21,Reference Khait, Panin and Averyanov141]. These methods are not applicable to high-dimensional problems because the computational cost increases tremendously as the system dimension increases. Due to the scalability issue, several first-derivative-based methods for computing the saddle-points have been proposed, see for example [Reference Miron and Fichthorn189,Reference Quapp, Hirsch, Imig and Heidrich210]. A detailed description of such methods, along with their advantages and disadvantages, can be found in a survey paper [Reference Henkelman, Johannesson, Jonsson and Schwartz119]. A stability-region-based method has been developed for finding saddle-points of high-dimensional problems [Reference Reddy and Chiang213,Reference Reddy and Chiang214]. This method is based on the transformation of the task of finding the saddle-points into the task of finding the dynamic decomposition points lying on the stability boundary of two local minima (i.e. two stable equilibrium points). This method does not require that the gradient information starts from a local minimum (i.e. a stable equilibrium point). It finds the stability boundary in a given direction and then traces the stability boundary until the dynamic decomposition point (i.e. the saddle-point) is reached. This tracing of the stability boundary is far more efficient than searching for saddle-points in the entire search space. This again illustrates that knowledge of the stability boundary plays a key role in the development of this effective computational method.
1.4.4 Respiratory model and economics
Multiple equilibrium points exist in the respiratory model derived for humans [Reference Villafuerte, Mondié and Niculescu268] and in that derived for bacteria [Reference Fairén and Velarde91]. The presence of multiple equilibriums indicates that global stability is not possible in these models and knowledge of the stability region of each stable equilibrium point can provide a complete picture of the dynamic behavior of these respiratory models. The asymptotic behavior of a respiratory model will converge to the stable equilibrium point whose stability region contains the initial condition.
Nonlinear analysis of problems arising in economics can also benefit from knowledge of stability regions and how the stability region changes relative to parameter variations [Reference Arrow and Hahn16]. For example, an investigation of the impact of changes in technological level and saving rate on the relationship between the carrying capacity of the human population and economic growth rate was conducted in [Reference Cai34]. Multiple equilibriums as well as abrupt changes in their stability regions due to parameter variations have been reported and analyzed.
1.4.5 Nonlinear control systems
Characterization of the stability region is of great importance in modern nonlinear control systems [Reference da Silva and Tarbouriech101,Reference Henrion, Tarbouriech and Garcia120,Reference Kokotovic and Marino147,Reference Meza, Santibanez and Campa179,Reference Milani183,Reference Shim and Seo227,Reference Tibken250,Reference Toussaint and Basar253]. It has been recognized that high feedback control gain can destabilize closed loop nonlinear systems [Reference Kokotovic and Marino147,Reference Toussaint and Basar253]. Contraction of the stability region due to high feedback gain contributes to this destabilization. The task of maximizing the size of the stability region has become a design objective in nonlinear system analysis and controller design [Reference Wada270,Reference Shyu and Chen230], including the design of linear system controllers with saturation [Reference Coutinho and da Silva77,Reference da Silva and Tarbouriech101,Reference Henrion, Tarbouriech and Garcia120,Reference Milani183].
The characterization of stability regions of nonlinear control systems is important in practical applications, see for example [Reference Ailon, Segev and Arogeti3,Reference Chiang, Stefanopoulou and Jankoviv43,Reference Dong, Cheng and Oin84,Reference Jadbabaie and Hauser133,Reference Langson and Allevne154,Reference Zhong287]. Local stability analysis is based on a linearized model and does not provide information regarding the nature of the stability region. The stability region can only be characterized by taking into account the nonlinearity of the underlying nonlinear system. We present one example of controller design: one where the stability region shrinks with the increase in controller gain. This example serves to illustrate that overlooking both the nonlinear terms and the stability region characterization in the controller design can result in a closed loop nonlinear system with a very small size stability region and, consequently, with a small degree of robustness with respect to both state and parameter perturbations.
Consider the following nonlinear system from [Reference Kokotovic and Marino147]:
(1.4)where u ∈ R is an input, a and b are unknown parameters satisfying |a| < c and |b| < c, with c > 0 as an upper bound for the uncertain parameters a and b. The objective is to design a state feedback controller that stabilizes the origin of this system. For this purpose, consider the linearization of system (1.4)
(1.5)with the following feedback control:
By substituting (1.6) into (1.5) and computing the eigenvalues of the closed loop system, we conclude that the equilibrium point (0.0, 0.0) (i.e. the origin) of the linearized closed loop system is asymptotically stable, for any |a| < c and |b| < c, if γ >2c. Assuming the same state feedback (1.6) is employed to stabilize the nonlinear system (1.4), Figure 1.6 shows the stability region of the origin of the nonlinear closed loop system for a=0, b=0, c=1 and γ = 4. Since the eigenvalues of the Jacobian matrix evaluated at the origin are
, the origin of the closed loop system is indeed asymptotically stable. In spite of that, it is clear from Figure 1.6 that the stability region is too small to ensure robustness with respect to perturbations.
There is a nonlinear relationship between the stability boundary and the controller. Numerical studies show that the stability boundary of (0.0, 0.0) (the origin) is composed of an unstable limit cycle. In addition, the stability region shrinks as the controller gain γ increases, shown in Figure 1.7. This simple example illustrates that the linearization approach for controller design is completely independent of the size of the stability region. A design for a good-performance controller based on the linearized model can lead to very small size stability regions. As a consequence, it is important to adopt the size of the stability region as one criterion in designing linear controllers for controlling nonlinear systems.
1.4.6 Power systems and power electronics
Characterizations of the stability of an operating point and its stability region are very important in many engineering problems. For instance, they play a key role in several applications in electric power systems [Reference Chiang, Chu and Cauley51,Reference Chiang, Wu and Varaya65,Reference Davy and Hiskens81,Reference Hill and Mareels121,Reference Praprost and Loparo207,Reference Sauer and Pai224,Reference Varaiya, Wu and Chen257,Reference Venkatasubramanian, Schattler and Zaborsky264]. Nowadays, on-line transient stability assessment of power systems is a reality due to the development of comprehensive stability region theory and of fast computational methods for estimating stability regions. In particular, this on-line transient stability analysis was made possible due to the development of the controlling UEP method and the BCU method, which were developed by exploring the stability boundaries of a class of nonlinear power system models. These methods have been applied to direct stability analysis of very high-dimensional systems, of more than 50 000 state variables [Reference Chiang, Tada and Li59,Reference Tada and Chiang241].
Determination of the stability region is also essential in the area of power electronics. It is common to employ analysis of linearized power electric models and numerical simulation of nonlinear power electronic models to gain insight into the dynamical behavior of power electronic circuits. However, knowledge of the stability region can complement the nonlinear simulation approach to provide information regarding the robustness of the stable states and a comprehensive reliability assessment of the power electronic circuit under design. Power electronic based converters, for example, can be designed to operate nearly as ideal regulators. These power converters behave nearly as constant power loads and are a source of destabilization in power distribution systems. As a consequence, stability regions of power distribution systems connected to these constant power loads are a subset of the entire space [Reference Glover100]. Voltage-regulated boost DC-to-DC converters are also an example of power electronic circuits in which knowledge of stability regions is important [Reference Mazumder, Nayfeh and Borojevic177,Reference Rodriguez, Ortega, Escobar and Barabanov217]. For both power electronic circuits, determining stability regions is important to ensure the robust performance of the designed power electronic circuits.
1.4.7 Artificial neural networks
Complete stability is a desired property for recurrent artificial neural networks [Reference Ciliz and Harova71,Reference Djukanovic, Sobajic and Pao83,Reference Hopfield127]. Complete stability ensures that every trajectory converges to an equilibrium point. The property of complete stability can be translated into the problem of checking whether or not the union of the stability regions of all stable equilibrium points (SEPs) covers almost the entire state space. The coexistence of multiple SEPs indicates that the output of a recurrent neural network depends not only on the input signal but also on the history of the dynamics or, more precisely, on which stability region the initial condition of the network lies when the input signal is injected into the recurrent artificial neural network [Reference Ciliz and Harova71,Reference Djukanovic, Sobajic and Pao83,Reference Hopfield127].
1.4.8 Robotics
Stability regions of limit cycles are relevant in the analysis, design and monitoring of robotics [Reference Liu, Tian and Huang166]. Enlarging the stability region of the asymptotically stable walking cycle of a bipedal robot is a criterion in the design of robust controllers [Reference Siqueira and Terra229,Reference Westervelt, Grizzle and de Wit274,Reference Westervelt, Grizzle and Koditschek275]. Keeping the robot inside the stability region of the walking cycle prevents its falling. The design of controllers with a constraint on the minimum size of the stability region is of great interest in the problem of regulator designing for robot manipulators [Reference Bondi, Casalino and Gambardella26,Reference Meza, Santibanez and Campa179,Reference Ortega, Loria and Kelly196]. The problem of robot navigation can be formulated in terms of stability regions. More precisely, it can be translated into the problem of designing a nonlinear system with a vector field which has the final destination as an asymptotically stable equilibrium point and the initial position of the robot lying inside the stability region of the stable equilibrium point [Reference Burridge, Rizzi and Koditschek32,Reference Koditschek145].
1.4.9 Applications to nonlinear optimization
Knowledge of stability regions can provide an effective approach to solving nonlinear optimization problems. This approach to solving optimization problems was recently proposed and demonstrated [Reference Chiang, Chen, Reddy, Pardalos and Coleman48,Reference Chiang and Chu49,Reference Chiang, Lee, Lee and El-Sharkawi56,Reference Chiang, Wang and Jiang62,Reference Lee and Chiang162,Reference Lee and Chiang163]. Its potential to become one of the mainstream approaches to solving optimization problems is very promising. Indeed, optimization technology has practical applications in almost every branch of science, economics, engineering and technology.
One popular method for solving nonlinear optimization problems is to use an iterative local search procedure which can be described as follows: start from an initial vector and search for a better solution in its neighborhood. If an improved solution is found, repeat the search procedure starting from the new solution as the initial solution; otherwise, the search is terminated. Local search methods usually become trapped at local optimal solutions and are unable to escape from them. In fact, the great majority of existing nonlinear optimization methods for solving optimization problems usually come up with local optimal solutions but not the global optimal solution.
The drawback of iterative local search methods has motivated the development of a number of more sophisticated local search methods, termed modern heuristics, designed to find better solutions via introducing some mechanisms that allow the search process to escape from local optimal solutions. The underlying “escape” mechanisms use certain search strategies to accept a cost-deteriorating neighborhood to make escape from a local optimal solution possible. These sophisticated local search algorithms include simulated annealing, genetic algorithm, Tabu search, evolutionary programming and particle swarm operator methods. However, these sophisticated local search methods, among other problems, require intensive computational effort and usually cannot find the globally optimal solution. To overcome the difficulties encountered by the majority of existing optimization methods, the following two important and challenging issues in the course of searching for multiple high-quality optimal solutions need to be fully addressed:
(C1) how to effectively move (escape) from a local optimal solution and move toward another local optimal solution;
(C2) how to avoid revisiting local optimal solutions which are already known.
A stability-region-based methodology which is a new paradigm for solving nonlinear optimization problems will be presented in this book. This new methodology has several distinguished features, to be described in this book, and can address the two challenges (C1) and (C2).
1.5 Purpose of this book
The main purpose of this book is to present a comprehensive framework for developing the theory of stability regions of different types of nonlinear dynamical systems. Advanced topics on stability regions will also be presented. In addition, this book presents a unified framework to estimate stability regions of nonlinear dynamical systems. Optimal schemes for estimating stability regions of nonlinear dynamical systems will be presented for different types of these systems. Practical applications of stability regions to several topics of engineering are demonstrated. The transformation of nonlinear optimization problems into the stability region problem is also presented and shown to be a fruitful research and development area.
Nonlinear dynamical systems arising from different engineering disciplines and the sciences are vast and appear in a variety of different forms. This book covers the following types of nonlinear analysis:
continuous nonlinear dynamical systems,
discrete-time nonlinear dynamical systems,
complex continuous nonlinear dynamical systems,
constrained continuous nonlinear dynamical systems,
two-time-scale nonlinear dynamical systems,
interconnected nonlinear dynamical systems,
non-hyperbolic nonlinear dynamical systems.
From computational viewpoints, effective schemes for estimating the stability regions of the above different types of nonlinear dynamical systems are described and analyzed. In addition, a constructive methodology for optimally estimating stability regions will be presented and analyzed.
From a practical viewpoint, knowledge of stability regions has significant applications. This book describes practical applications of stability regions to the following areas:
direct stability analysis in electric power systems,
stability-region-based nonlinear optimization methods.
We believe that solving challenging practical problems efficiently can be accomplished through a thorough understanding of the underlying theory, in conjunction with exploring the special features of the practical problem under study to develop effective solution methodologies. This book covers both comprehensive theoretical developments of stability regions and comprehensive solution methodologies for estimating stability regions.
There are 22 chapters contained in this book. These chapters can be classified as shown in Figure 1.8.
An overview of the organization and content of this book.
In summary, this book presents theoretical developments of stability regions of various types of nonlinear dynamical systems as well as solution methodologies for estimating these stability regions. The interplay between stability regions and bifurcations is also described. On the application side of the knowledge of stability regions, the long-standing research and development of fast stability-region-based methods for power system transient stability analysis and the emerging area of stability-region-based nonlinear optimization methods are presented in detail. In particular, this book
develops a comprehensive theory of stability regions of nonlinear dynamical systems (including continuous and discrete systems),
presents a complete characterization of stability boundaries of a class of nonlinear dynamical systems,
presents a complete characterization of stability boundaries of a class of complex nonlinear dynamical systems,
develops a comprehensive theory of stability regions of two-time-scale nonlinear dynamical systems,
develops a comprehensive theory of stability regions of a class of non-hyperbolic nonlinear dynamical systems,
develops schemes for estimating stability regions of general nonlinear dynamical systems,
presents optimal schemes for estimating stability regions of a class of nonlinear dynamical systems,
presents a complete characterization of relevant stability regions of a class of nonlinear dynamical systems,
presents optimal schemes for estimating relevant stability regions of a class of nonlinear dynamical systems.
It is expected that the reader has some familiarity with the theory of ordinary differential equations and nonlinear dynamical systems. This book can be read sequentially, chapter to chapter, or the reader may jump to chapters of interest. The minimum suggested path would be Chapters 1, 2, 3, 4, 6, 8, 10, 13, 18 and 22. This sequence will give to the reader a very comprehensive understanding of the theory of stability regions for continuous dynamical systems and the methods for estimating stability regions. Readers may want to include Chapters 5 and 11 to gain some insight into the characterization of the stability boundaries of a more general class of continuous dynamical systems, i.e. systems that exhibit complex behavior such as closed orbits and chaos.
Chapters 9 and 12 present a complete characterization of stability boundaries and methods to estimate the stability region of nonlinear discrete-time systems. They can be read separately but the contents of Chapters 4 and 10 would be useful background. Chapter 7 extends the characterization of stability boundaries developed in Chapter 4 to the class of nonlinear constrained systems, i.e. systems that are modeled by a set of differential and algebraic equations. It is suggested that Chapter 4 should be read before Chapter 7. The advanced topic chapters require some working knowledge of the theory chapters and of the optimal estimation chapters. The same is true for the application chapters.
