Delay differential equation

In mathematics, delay differential equations (DDEs) are a type of differential equation in which the derivative of the unknown function at a certain time is given in terms of the values of the function at previous times. DDEs are also called time-delay systems, systems with aftereffect or dead-time, hereditary systems, equations with deviating argument, or differential-difference equations. They belong to the class of systems with the functional state, i.e. partial differential equations (PDEs) which are infinite dimensional, as opposed to ordinary differential equations (ODEs) having a finite dimensional state vector. Four points may give a possible explanation of the popularity of DDEs:^[1]

1. Aftereffect is an applied problem: it is well known that, together with the increasing expectations of dynamic performances, engineers need their models to behave more like the real process. Many processes include aftereffect phenomena in their inner dynamics. In addition, actuators, sensors, and communication networks that are now involved in feedback control loops introduce such delays. Finally, besides actual delays, time lags are frequently used to simplify very high order models. Then, the interest for DDEs keeps on growing in all scientific areas and, especially, in control engineering.
2. Delay systems are still resistant to many classical controllers: one could think that the simplest approach would consist in replacing them by some finite-dimensional approximations. Unfortunately, ignoring effects which are adequately represented by DDEs is not a general alternative: in the best situation (constant and known delays), it leads to the same degree of complexity in the control design. In worst cases (time-varying delays, for instance), it is potentially disastrous in terms of stability and oscillations.
3. Voluntary introduction of delays can benefit the control system.^[2]
4. In spite of their complexity, DDEs often appear as simple infinite-dimensional models in the very complex area of partial differential equations (PDEs).

A general form of the time-delay differential equation for ${\displaystyle x(t)\in \mathbb {R} ^{n}}$ is

$${\displaystyle {\frac {d}{dt}}x(t)=f(t,x(t),x_{t}),}$$

where ${\displaystyle x_{t}=\{x(\tau ):\tau \leq t\}}$ represents the trajectory of the solution in the past. In this equation, ${\displaystyle f}$ is a functional operator from ${\displaystyle \mathbb {R} \times \mathbb {R} ^{n}\times C^{1}(\mathbb {R} ,\mathbb {R} ^{n})}$ to ${\displaystyle \mathbb {R} ^{n}.}$

Examples

• Continuous delay
  $${\displaystyle {\frac {d}{dt}}x(t)=f\left(t,x(t),\int _{-\infty }^{0}x(t+\tau )\,d\mu (\tau )\right)}$$

   
• Discrete delay
  $${\displaystyle {\frac {d}{dt}}x(t)=f(t,x(t),x(t-\tau _{1}),\dots ,x(t-\tau _{m}))}$$

   
  for ${\displaystyle \tau _{1}>\dots >\tau _{m}\geq 0.}$ 
• Linear with discrete delays
  $${\displaystyle {\frac {d}{dt}}x(t)=A_{0}x(t)+A_{1}x(t-\tau _{1})+\dots +A_{m}x(t-\tau _{m})}$$

   
  where ${\displaystyle A_{0},\dotsc ,A_{m}\in \mathbb {R} ^{n\times n}}$ .
• Pantograph equation
  $${\displaystyle {\frac {d}{dt}}x(t)=ax(t)+bx(\lambda t),}$$

   
  where a, b and λ are constants and 0 < λ < 1. This equation and some more general forms are named after the pantographs on trains.^[3][4]

Solving DDEs

DDEs are mostly solved in a stepwise fashion with a principle called the method of steps. For instance, consider the DDE with a single delay

$${\displaystyle {\frac {d}{dt}}x(t)=f(x(t),x(t-\tau ))}$$

 

with given initial condition ${\displaystyle \phi \colon [-\tau ,0]\to \mathbb {R} ^{n}}$ . Then the solution on the interval ${\displaystyle [0,\tau ]}$  is given by ${\displaystyle \psi (t)}$  which is the solution to the inhomogeneous initial value problem

$${\displaystyle {\frac {d}{dt}}\psi (t)=f(\psi (t),\phi (t-\tau )),}$$

 

with ${\displaystyle \psi (0)=\phi (0)}$ . This can be continued for the successive intervals by using the solution to the previous interval as inhomogeneous term. In practice, the initial value problem is often solved numerically.

Example

Suppose ${\displaystyle f(x(t),x(t-\tau ))=ax(t-\tau )}$  and ${\displaystyle \phi (t)=1}$ . Then the initial value problem can be solved with integration,

$${\displaystyle x(t)=x(0)+\int _{s=0}^{t}{\frac {d}{dt}}x(s)\,ds=1+a\int _{s=0}^{t}\phi (s-\tau )\,ds,}$$

 

i.e., ${\displaystyle x(t)=at+1}$ , where the initial condition is given by ${\displaystyle x(0)=\phi (0)=1}$ . Similarly, for the interval ${\displaystyle t\in [\tau ,2\tau ]}$  we integrate and fit the initial condition,

$${\displaystyle {\begin{aligned}x(t)=x(\tau )+\int _{s=\tau }^{t}{\frac {d}{dt}}x(s)\,ds&=(a\tau +1)+a\int _{s=\tau }^{t}\left(a(s-\tau )+1\right)ds\\&=(a\tau +1)+a\int _{s=0}^{t-\tau }\left(as+1\right)ds,\end{aligned}}}$$

 

i.e., ${\textstyle x(t)=(a\tau +1)+a(t-\tau )\left({\frac {1}{2}}{a(t-\tau )}+1\right).}$ 

Reduction to ODE

In some cases, differential equations can be represented in a format that looks like delay differential equations.

• Example 1 Consider an equation
  $${\displaystyle {\frac {d}{dt}}x(t)=f\left(t,x(t),\int _{-\infty }^{0}x(t+\tau )e^{\lambda \tau }\,d\tau \right).}$$

   
  Introduce ${\displaystyle y(t)=\int _{-\infty }^{0}x(t+\tau )e^{\lambda \tau }\,d\tau }$  to get a system of ODEs
  $${\displaystyle {\frac {d}{dt}}x(t)=f(t,x,y),\quad {\frac {d}{dt}}y(t)=x-\lambda y.}$$

   
• Example 2 An equation
  $${\displaystyle {\frac {d}{dt}}x(t)=f\left(t,x(t),\int _{-\infty }^{0}x(t+\tau )\cos(\alpha \tau +\beta )\,d\tau \right)}$$

   
  is equivalent to
  $${\displaystyle {\frac {d}{dt}}x(t)=f(t,x,y),\quad {\frac {d}{dt}}y(t)=\cos(\beta )x+\alpha z,\quad {\frac {d}{dt}}z(t)=\sin(\beta )x-\alpha y,}$$

   
  where
  $${\displaystyle y=\int _{-\infty }^{0}x(t+\tau )\cos(\alpha \tau +\beta )\,d\tau ,\quad z=\int _{-\infty }^{0}x(t+\tau )\sin(\alpha \tau +\beta )\,d\tau .}$$

   

The characteristic equation

Similar to ODEs, many properties of linear DDEs can be characterized and analyzed using the characteristic equation.^[5] The characteristic equation associated with the linear DDE with discrete delays

$${\displaystyle {\frac {d}{dt}}x(t)=A_{0}x(t)+A_{1}x(t-\tau _{1})+\dots +A_{m}x(t-\tau _{m})}$$

 

is

$${\displaystyle \det(-\lambda I+A_{0}+A_{1}e^{-\tau _{1}\lambda }+\dotsb +A_{m}e^{-\tau _{m}\lambda })=0.}$$

 

The roots λ of the characteristic equation are called characteristic roots or eigenvalues and the solution set is often referred to as the spectrum. Because of the exponential in the characteristic equation, the DDE has, unlike the ODE case, an infinite number of eigenvalues, making a spectral analysis more involved. The spectrum does however have some properties which can be exploited in the analysis. For instance, even though there are an infinite number of eigenvalues, there are only a finite number of eigenvalues to the right of any vertical line in the complex plane.^{[citation needed]}

This characteristic equation is a nonlinear eigenproblem and there are many methods to compute the spectrum numerically.^[6] In some special situations it is possible to solve the characteristic equation explicitly. Consider, for example, the following DDE:

$${\displaystyle {\frac {d}{dt}}x(t)=-x(t-1).}$$

 

The characteristic equation is

$${\displaystyle -\lambda -e^{-\lambda }=0.}$$

 

There are an infinite number of solutions to this equation for complex λ. They are given by

$${\displaystyle \lambda =W_{k}(-1),}$$

 

where W_k is the kth branch of the Lambert W function.

Applications

• Dynamics of diabetes^[7]
• Epidemiology^[8][9]
• Population dynamics^[10][11]
• Classical electrodynamics^[12]

See also

• Functional differential equation
• Halanay Inequality

References

1. Richard, Jean-Pierre (2003). "Time Delay Systems: An overview of some recent advances and open problems". Automatica. 39 (10): 1667–1694. doi:10.1016/S0005-1098(03)00167-5.
2. Lavaei, Javad; Sojoudi, Somayeh; Murray, Richard M. (2010). "Simple delay-based implementation of continuous-time controllers". Proceedings of the 2010 American Control Conference: 5781–5788. doi:10.1109/ACC.2010.5530439. ISBN 978-1-4244-7427-1. S2CID 1200900.
3. Griebel, Thomas (2017-01-01). "The pantograph equation in quantum calculus". Masters Theses.
4. Ockendon, John Richard; Tayler, A. B.; Temple, George Frederick James (1971-05-04). "The dynamics of a current collection system for an electric locomotive". Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences. 322 (1551): 447–468. Bibcode:1971RSPSA.322..447O. doi:10.1098/rspa.1971.0078. S2CID 110981464.
5. Michiels, Wim; Niculescu, Silviu-Iulian (2007). Stability and Stabilization of Time-Delay Systems. Advances in Design and Control. Society for Industrial and Applied Mathematics. pp. 3–32. doi:10.1137/1.9780898718645. ISBN 978-0-89871-632-0.
6. Michiels, Wim; Niculescu, Silviu-Iulian (2007). Stability and Stabilization of Time-Delay Systems. Advances in Design and Control. Society for Industrial and Applied Mathematics. pp. 33–56. doi:10.1137/1.9780898718645. ISBN 978-0-89871-632-0.
7. Makroglou, Athena; Li, Jiaxu; Kuang, Yang (2006-03-01). "Mathematical models and software tools for the glucose-insulin regulatory system and diabetes: an overview". Applied Numerical Mathematics. Selected Papers, The Third International Conference on the Numerical Solutions of Volterra and Delay Equations. 56 (3): 559–573. doi:10.1016/j.apnum.2005.04.023. ISSN 0168-9274.
8. Salpeter, Edwin E.; Salpeter, Shelley R. (1998-02-15). "Mathematical Model for the Epidemiology of Tuberculosis, with Estimates of the Reproductive Number and Infection-Delay Function". American Journal of Epidemiology. 147 (4): 398–406. doi:10.1093/oxfordjournals.aje.a009463. ISSN 0002-9262. PMID 9508108.
9. Kajiwara, Tsuyoshi; Sasaki, Toru; Takeuchi, Yasuhiro (2012-08-01). "Construction of Lyapunov functionals for delay differential equations in virology and epidemiology". Nonlinear Analysis: Real World Applications. 13 (4): 1802–1826. doi:10.1016/j.nonrwa.2011.12.011. ISSN 1468-1218.
10. Gopalsamy, K. (1992). Stability and Oscillations in Delay Differential Equations of Population Dynamics. Mathematics and Its Applications. Dordrecht, NL: Kluwer Academic Publishers. doi:10.1007/978-94-015-7920-9. ISBN 978-0792315940.
11. Kuang, Y. (1993). Delay Differential Equations with Applications in Population Dynamics. Mathematics in Science and Engineering. San Diego, CA: Academic Press. ISBN 978-0080960029.
12. López, Álvaro G. (2020-09-01). "On an electrodynamic origin of quantum fluctuations". Nonlinear Dynamics. 102 (1): 621–634. arXiv:2001.07392. doi:10.1007/s11071-020-05928-5. ISSN 1573-269X. S2CID 210838940.

Further reading

• Bellen, Alfredo; Zennaro, Marino (2003). Numerical Methods for Delay Differential Equations. Numerical Mathematics and Scientific Computation. Oxford, UK: Oxford University Press. ISBN 978-0198506546.
• Bellman, Richard; Cooke, Kenneth L. (1963). Differential-Difference Equations (PDF). Mathematics in Science and Engineering. New York, NY: Academic Press. ISBN 978-0120848508.
• Briat, Corentin (2015). Linear Parameter-Varying and Time-Delay Systems: Analysis, Observation, Filtering & Control. Advances in Delays and Dynamics. Heidelberg, DE: Springer-Verlag. ISBN 978-3662440490.
• Driver, Rodney D. (1977). Ordinary and Delay Differential Equations. Applied Mathematical Sciences. Vol. 20. New York, NY: Springer-Verlag. doi:10.1007/978-1-4684-9467-9. ISBN 978-0387902319.
• Erneux, Thomas (2009). Applied Delay Differential Equations. Surveys and Tutorials in the Applied Mathematical Sciences. Vol. 3. New York, NY: Springer Science+Business Media. doi:10.1007/978-0-387-74372-1. ISBN 978-0387743714.

External links

• Skip Thompson (ed.). "Delay-Differential Equations". Scholarpedia.