Power Series Solutions

In mathematics, the power series method is used to seek a power series solution to certain differential equations. In general, such a solution assumes a power series with unknown coefficients, then substitutes that solution into the differential equation to find a recurrence relation for the coefficients.

Method

Consider the second-order linear differential equation

$a_{2}(z)f''(z)+a_{1}(z)f'(z)+a_{0}(z)f(z)=0.\;\!$

Suppose a₂ is nonzero for all z. Then we can divide throughout to obtain

$f''+{a_{1}(z) \over a_{2}(z)}f'+{a_{0}(z) \over a_{2}(z)}f=0.$

Suppose further that a₁/a₂ and a₀/a₂ are analytic functions.

The power series method calls for the construction of a power series solution

$f=\sum _{k=0}^{\infty }A_{k}z^{k}.$

If a₂ is zero for some z, then the Frobenius method, a variation on this method, is suited to deal with so called "singular points". The method works analogously for higher order equations as well as for systems.

Example usage

Let us look at the Hermite differential equation,

$f''-2zf'+\lambda f=0;\;\lambda =1$

We can try to construct a series solution

$f=\sum _{k=0}^{\infty }A_{k}z^{k}$

$f'=\sum _{k=1}^{\infty }kA_{k}z^{k-1}$

$f''=\sum _{k=2}^{\infty }k(k-1)A_{k}z^{k-2}$

Substituting these in the differential equation

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} & \sum_{k=2}^\infty k(k-1)A_kz^{k-2}-2z\sum_{k=1}^\infty kA_kz^{k-1}+\sum_{k=0}^\infty A_kz^k=0 \\ = & \sum_{k=2}^\infty k(k-1)A_kz^{k-2}-\sum_{k=1}^\infty 2kA_kz^k+\sum_{k=0}^\infty A_kz^k \end{align} }

Making a shift on the first sum

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} & = \sum_{k=0}^\infty (k+2)(k+1) A_{k+2} z^k - \sum_{k=1}^\infty 2k A_k z^k + \sum_{k=0}^\infty A_k z^k \\ & = 2 A_2 + \sum_{k=1}^\infty (k+2)(k+1) A_{k+2} z^k - \sum_{k=1}^\infty 2k A_k z^k + A_0 + \sum_{k=1}^\infty A_k z^k \\ & = 2 A_2 + A_0 + \sum_{k=1}^\infty \left( (k+2) (k+1) A_{k+2} + (-2k+1) A_k \right) z^k \end{align} }

If this series is a solution, then all these coefficients must be zero, so for both k=0 and k>0:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (k+2)(k+1)A_{k+2}+(-2k+1)A_k=0\;\!}

We can rearrange this to get a recurrence relation for A_k+2.

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (k+2)(k+1)A_{k+2}=-(-2k+1)A_k\;\!}

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A_{k+2}={(2k-1)\over (k+2)(k+1)}A_k\;\!}

Now, we have

$A_{2}={-1 \over (2)(1)}A_{0}={-1 \over 2}A_{0},\,A_{3}={1 \over (3)(2)}A_{1}={1 \over 6}A_{1}$

We can determine A₀ and A₁ if there are initial conditions, i.e. if we have an initial value problem.

So we have

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} A_4 & ={1\over 4}A_2 = \left({1\over 4}\right)\left({-1 \over 2}\right)A_0 = {-1 \over 8}A_0 \\[8pt] A_5 & ={1\over 4}A_3 = \left({1\over 4}\right)\left({1 \over 6}\right)A_1 = {1 \over 24}A_1 \\[8pt] A_6 & = {7\over 30}A_4 = \left({7\over 30}\right)\left({-1 \over 8}\right)A_0 = {-7 \over 240}A_0 \\[8pt] A_7 & = {3\over 14}A_5 = \left({3\over 14}\right)\left({1 \over 24}\right)A_1 = {1 \over 112}A_1 \end{align} }

and the series solution is

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \begin{align} f & = A_0z^0 + A_1z^1 +A_2z^2 +A_3z^3 +A_4z^4 +A_5z^5 + A_6z^6 + A_7z^7+\cdots \\[8pt] & = A_0z^0 + A_1z^1 + {-1\over 2}A_0z^2 + {1\over 6}A_1z^3 + {-1 \over 8}A_0z^4 + {1 \over 24}A_1z^5 + {-7 \over 240}A_0z^6 + {1 \over 112}A_1z^7 + \cdots \\[8pt] & = A_0z^0 + {-1\over 2}A_0z^2 + {-1 \over 8}A_0z^4 + {-7 \over 240}A_0z^6 + A_1z + {1\over 6}A_1z^3 + {1 \over 24}A_1z^5 + {1 \over 112}A_1z^7 + \cdots \end{align} }

which we can break up into the sum of two linearly independent series solutions:

$f=A_{0}\left(1+{-1 \over 2}z^{2}+{-1 \over 8}z^{4}+{-7 \over 240}z^{6}+\cdots \right)+A_{1}\left(z+{1 \over 6}z^{3}+{1 \over 24}z^{5}+{1 \over 112}z^{7}+\cdots \right)$

which can be further simplified by the use of hypergeometric series.

A simpler way using Taylor series

A much simpler way of solving this equation (and power series solution in general) using the Taylor series form of the expansion. Here we assume the answer is of the form

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f=\sum_{k=0}^\infty {A_kz^k\over {k!}}}

If we do this, the general rule for obtaining the recurrence relationship for the coefficients is

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y^{[n]} \to A_{k+n} }

and

$x^{m}y^{[n]}\to (k)(k-1)\cdots (k-m+1)A_{k+n-m}$

In this case we can solve the Hermite equation in fewer steps:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f''-2zf'+\lambda f=0;\;\lambda=1}

becomes

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A_{k+2} -2kA_k +\lambda A_k=0}

or

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A_{k+2} = (2k-\lambda) A_k}

in the series

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f=\sum_{k=0}^\infty {A_kz^k\over {k!}}}

Nonlinear equations

The power series method can be applied to certain nonlinear differential equations, though with less flexibility. A very large class of nonlinear equations can be solved analytically by using the Parker–Sochacki method. Since the Parker–Sochacki method involves an expansion of the original system of ordinary differential equations through auxiliary equations, it is not simply referred to as the power series method. The Parker–Sochacki method is done before the power series method to make the power series method possible on many nonlinear problems. An ODE problem can be expanded with the auxiliary variables which make the power series method trivial for an equivalent, larger system. Expanding the ODE problem with auxiliary variables produces the same coefficients (since the power series for a function is unique) at the cost of also calculating the coefficients of auxiliary equations. Many times, without using auxiliary variables, there is no known way to get the power series for the solution to a system, hence the power series method alone is difficult to apply to most nonlinear equations.

The power series method will give solutions only to initial value problems (opposed to boundary value problems), this is not an issue when dealing with linear equations since the solution may turn up multiple linearly independent solutions which may be combined (by superposition) to solve boundary value problems as well. A further restriction is that the series coefficients will be specified by a nonlinear recurrence (the nonlinearities are inherited from the differential equation).

In order for the solution method to work, as in linear equations, it is necessary to express every term in the nonlinear equation as a power series so that all of the terms may be combined into one power series.

As an example, consider the initial value problem

$FF''+2F'^{2}+\eta F'=0\quad ;\quad F(1)=0\ ,\ F'(1)=-{\frac {1}{2}}$

which describes a solution to capillary-driven flow in a groove. There are two nonlinearities: the first and second terms involve products. The initial values are given at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \eta = 1} , which hints that the power series must be set up as:

$F(\eta )=\sum _{i=0}^{\infty }c_{i}(\eta -1)^{i}$

since in this way

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \frac{d^n F}{d \eta^n} \Bigg|_{\eta = 1} = n! \ c_n}

which makes the initial values very easy to evaluate. It is necessary to rewrite the equation slightly in light of the definition of the power series,

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle F F'' + 2 F'^2 + (\eta - 1) F' + F' = 0 \quad ; \quad F(1) = 0 \ , \ F'(1) = -\frac{1}{2}}

so that the third term contains the same form Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \eta - 1} that shows in the power series.

The last consideration is what to do with the products; substituting the power series in would result in products of power series when it's necessary that each term be its own power series. This is where the Cauchy product

$\left(\sum _{i=0}^{\infty }a_{i}x^{i}\right)\left(\sum _{i=0}^{\infty }b_{i}x^{i}\right)=\sum _{i=0}^{\infty }x^{i}\sum _{j=0}^{i}a_{i-j}b_{j}$

is useful; substituting the power series into the differential equation and applying this identity leads to an equation where every term is a power series. After much rearrangement, the recurrence

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \sum_{j = 0}^i \left((j + 1) (j + 2) c_{i - j} c_{j + 2} + 2 (i - j + 1) (j + 1) c_{i - j + 1} c_{j + 1}\right) + i c_i + (i + 1) c_{i + 1} = 0 }

is obtained, specifying exact values of the series coefficients. From the initial values, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle c_0 = 0} and Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle c_1 = -1/2} , thereafter the above recurrence is used. For example, the next few coefficients:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle c_2 = -\frac{1}{6} \quad ; \quad c_3 = -\frac{1}{108} \quad ; \quad c_4 = \frac{7}{3240} \quad ; \quad c_5 = -\frac{19}{48600} \ \dots }

A limitation of the power series solution shows itself in this example. A numeric solution of the problem shows that the function is smooth and always decreasing to the left of $\eta =1$, and zero to the right. At Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \eta = 1} , a slope discontinuity exists, a feature which the power series is incapable of rendering, for this reason the series solution continues decreasing to the right of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \eta = 1} instead of suddenly becoming zero.

Licensing

Content obtained and/or adapted from:

• Power series solution of differential equations, Wikipedia under a CC BY-SA license