Lyapunov Numbers and Their Numerical Calculation Methods for Multidimensional Maps
Definition 1
Given a smooth map $\mathbf{f} : \mathbb{R}^{m} \to \mathbb{R}^{m}$ and initial value $\mathbf{v}_{0} \in \mathbb{R}^{m}$, let’s say $J_{n} := D \mathbf{f}^{n} ( \mathbf{v}_{0}) \in \mathbb{R}^{m \times m}$. For $k = 1 , \cdots , m$, consider the length of the $k$-th longest axis of the ellipsoid $J_{n} N$, which is the unit sphere $N := \left\{ \mathbf{x} \in \mathbb{R}^{m} : \left\| \mathbf{x} \right\|_{2} = 1 \right\}$ in $m$ dimensions, as $r_{k}^{(n)}$. Now, the $k$-th Lyapunov number $L_{k}$ of $\mathbf{v}_{0}$ is defined as follows: $$ L_{k} := \lim_{n\to\infty} \left( r_{k}^{(n)} \right)^{1/n} $$ The $k$-th Lyapunov exponent of $\mathbf{v}_{0}$ is defined as in $h_{k} := \ln L_{k}$.
- In $r_{k}^{(n)}$, the superscript $(n)$ does not mean power or number of derivatives, but implies that the map $\mathbf{f}$ has been applied $n$ times.
- Obviously, in definitions, $L_{1} \ge L_{2} \ge \cdots \ge L_{m}$, and $h_{1} \ge h_{2} \ge \cdots \ge h_{m}$, usually only the largest $h_{1}$ that is meaningfully comparable with $0$ is considered. This is similar to comparing $L_{1}$ with $1$, but with less clarity than the Lyapunov exponent which only requires consideration of sign, thus it’s not commonly used. However, when studying the concept, the Lyapunov number is more intuitive and thus helpful.
Description
The Lyapunov number for a multidimensional map is literally an extension of the $1$-dimensional map’s Lyapunov number, defined using the axes of the ellipsoid. Here, the axis formed by the Jacobian of map $\mathbf{f}^{n}$ means that $\mathbf{f}^{n}$ is moving the point in the direction of that axis. If the size of this axis is larger than $1$, it implies expansion, and if smaller, contraction in that direction. Considering that the Lyapunov number of a $1$-dimensional map is defined based on whether the magnitude of the derivative is greater or smaller than $1$, i.e., based on increment or decrement, this generalization to include nonlinear maps is quite reasonable.
Moreover, reconsidering the Lyapunov number from the perspective of numerical calculation, we inevitably think of the singular value decomposition of matrices as the value of $n$ increases, leading to extremely large singular values $\sigma_{1}$ and very small singular values $\sigma_{m}$. Unlike humans, computers have limitations in storing such numbers, and even without that, calculating $J_{n} = D \mathbf{f}^{n} ( \mathbf{v}_{0})$ is a challenge itself. Therefore, it’s generally better to avoid directly calculating $J_{n}N$ and to use a numerically smarter method instead.
Formula
$$ h_{k} \approx {{ 1 } \over { n }} \sum_{i=1}^{n} \ln \left\| \mathbf{y}_{k}^{(i)} \right\|_{2} $$
- $\| \cdot \|_{2}$ refers to the Euclidean norm.
Derivation
For some $U^{(i)}$, if the size of the axis of the ellipsoid $J_{n} N$ and $J_{n} U^{(i)}$ is the same, it does not matter if we calculate $J_{n} U^{(i)}$. According to the chain rule, $$ J_{n} U^{(0)} = D \mathbf{f}(\mathbf{v}_{n-1}) \cdots D \mathbf{f}(\mathbf{v}_{0}) N $$ we will calculate from the right-hand side term $D \mathbf{f}(\mathbf{v}_{0}) N$ in order towards the left. Given that $N$ is a unit sphere, if we consider $N$ as the orthogonal basis $N = \left[ \mathbf{w}_{1}^{(0)} \cdots \mathbf{w}_{m}^{(0)} \right]$, $$ \mathbf{z}_{1} = D \mathbf{f}(\mathbf{v}_{0}) \mathbf{w}_{1}^{(0)} \\ \vdots \\ \mathbf{z}_{m} = D \mathbf{f}(\mathbf{v}_{0}) \mathbf{w}_{m}^{(0)} $$ then, $$ J_{n} U^{(0)} = D \mathbf{f}(\mathbf{v}_{n-1}) \cdots D \mathbf{f}(\mathbf{v}_{1}) \left[ \mathbf{z}_{1} \cdots \mathbf{z}_{m} \right] $$ By applying Gram-Schmidt orthogonalization to the obtained $\left[ \mathbf{z}_{1} \cdots \mathbf{z}_{m} \right]$, we get the orthogonal basis $\left[ \mathbf{y}_{1}^{(1)} \cdots \mathbf{y}_{m}^{(1)} \right]$. Considering not to acquire too large values, if we set it as $\left[ \mathbf{w}_{1}^{(1)} \cdots \mathbf{w}_{m}^{(1)} \right] := \left[ {{ \mathbf{y}_{1}^{(1)} } \over { \left\| \mathbf{y}_{1}^{(1)} \right\|_{2} }} \cdots {{ \mathbf{y}_{m}^{(1)} } \over { \left\| \mathbf{y}_{m}^{(1)} \right\|_{2} }} \right]$, for some $U^{(1)}$, $$ J_{n} U^{(1)} = D \mathbf{f}(\mathbf{v}_{n-1}) \cdots D \mathbf{f}(\mathbf{v}_{1}) \left[ \mathbf{w}_{1}^{(1)} \cdots \mathbf{w}_{m}^{(1)} \right] $$ Repeating this calculation yields, $$ J_{n} U^{(n)} = \left[ \mathbf{w}_{1}^{(n)} \cdots \mathbf{w}_{m}^{(n)} \right] $$ Therefore, the length of the $k$-th axis of ellipsoid $J_{n} N$ is similar to $\left\| \mathbf{w}_{k}^{(n)} \right\|_{2}^{1/n}$. Meanwhile, $\left\| \mathbf{y}_{k}^{(i)} \right\|_{2}$ represents the increment or decrement in the $k$-th direction with each repetition, so the length of the axis becomes $r_{k}^{(n)} \approx \left\| \mathbf{y}_{k}^{(1)} \right\|_{2} \cdots \left\| \mathbf{y}_{k}^{(n)} \right\|_{2}$. Thus, for sufficiently large $n$, $$ \begin{align*} h_{k} =& \ln \lim_{n\to\infty} \left( r_{k}^{(n)} \right)^{1/n} \\ \approx& \ln\left( r_{k}^{(n)} \right)^{1/n} \\ \approx& \ln\left( \left\| \mathbf{y}_{k}^{(1)} \right\|_{2} \cdots \left\| \mathbf{y}_{k}^{(n)} \right\|_{2} \right)^{1/n} \\ =& {{ 1 } \over { n }} \sum_{i=1}^{n} \ln \left\| \mathbf{y}_{k}^{(i)} \right\|_{2} \end{align*} $$
■
See Also
Lyapunov Number for 1-Dimensional Maps
Yorke. (1996). CHAOS: An Introduction to Dynamical Systems: p195. ↩︎