About
News
Products & Services
Guidelines
Contact
Browse Publications By Name
Browse Publications By Subject

From Pythagoras to Fourier and From Geometry to Nature

Next Chapter in Book

DOI: https://doi.org/10.55060/b.p2fg2n.ch006.220215.009

Chapter 6. Orthogonal Polynomials

Downloads:
1,183
Full-Text Views:
76

In Hilbertian spaces L w2(a,b), the introduction of a basis of orthogonal polynomials {Pn(x)} allows one to obtain, in a constructive way, the so-called best approximation of the functions f(x) of the space by a finite linear combination of polynomials of the basis. By minimizing the deviation maxx∈(a,b)∥f(x)−∑k=0NakPk(x)∥=min, a remarkable extension of the classical least squares method, which goes back to Carl Friedrich Gauss, is obtained.

6.1 General Properties of Orthogonal Polynomials

In this section, we give the simplest properties of the orthogonal polynomials with respect to a weight w. For a more in-depth study of the subject one can consult the classic texts.

Denoting by kn the leading coefficient of the nth polynomial Pn(x) and putting, as usual:

hk=∥Pk(x)∥2=∫abP k2(x)w(x)dx 
we begin by noting that given the weight w and the interval [a, b] the orthogonal polynomials are each determined up to a multiplicative constant (which can be arranged to make the system orthonormal).

Recurrence relation

Three consecutive orthogonal polynomial system polynomials, associated with weight w on the interval (a, b), are related by the following recurrence relation:

Pn(x)=(Anx+Bn)Pn−1(x)−CnPn−2(x) (n=2,3,...)
where An, Bn, Cn are constants such that ∀n, An ≠ 0 and Cn > 0.

Furthermore, we have:

{An=knkn−1,  Cn=An hn−1An−1 hn−2Bn=An(kn′kn−kn−1′kn−1)

Christoffel-Darboux identity

For orthogonal polynomials, associated with the weight w on [a, b], the following Christoffel-Darboux identity holds:

1h0P0(y)P0(x)+1h1P1(y)P1(x)+⋯+1hnPn(y)Pn(x) =1hnknkn+1Pn+1(y)Pn(x)−Pn+1(x)Pn(y)y−x

Location of zeros

∀n, the zeros x1, x2, … , xn of the polynomial Pn, belonging to the set of polynomials orthogonal in [a, b] with respect to the weight w, are all real, distinct and internal to the interval [a, b].

Separation of zeros

Two consecutive orthogonal polynomials Pn(x) and Pn+1(x) of the set of orthogonal polynomials in (a, b) with respect to an assigned weight w have no common zeros.

Moreover, there exists the so-called theorem of separation of zeros. Denoting by x1 < x2 < ⋯ < xn+1 the zeros of the polynomial Pn+1(x), belonging to the set of polynomials orthogonal in (a, b) with respect to the weight w, in each of the open intervals (xk, xk+1) (k = 1, 2, ..., n) exactly one zero of Pn(x) falls.

6.2 The Classical Orthogonal Polynomials

The orthogonal polynomials that are most frequently encountered in applications are those called classical orthogonal polynomials, which are solutions of a differential equation of the hypergeometric type (see [75]), that is, of the type:

σ(x)y″+τ(x)y′+λny=0
where σ(x) is a polynomial of degree not greater than 2, τ (x) is a polynomial of degree not greater than 1 and λn denotes a constant which is related to the other coefficients by the equation:
λn=−nτ′(x)−n(n−1)2σ″(x)

These polynomials, disregarding inessential linear changes in the independent variable, can be reduced to the following:

  1. Jacobi polynomials: P n(α,β)(x) (α>−1, β>−1) orthogonal in (−1, 1) with respect to the weight:

    w(x)=(1−x)α(1+x)β

  2. Laguerre polynomials: L n(α)(x) (α>−1) orthogonal in (0, +∞) with respect to the weight:

    w(x)=xαe−x

  3. Hermite polynomials: Hn(x) orthogonal in (−∞, +∞) with respect to the weight:

    w(x)=e−x2

All of the above systems of polynomials constitute complete systems in the respective spaces L w2. The main reason why the above orthogonal polynomials are frequently used in applications is the possibility to obtain a lot of information from them, as a consequence of the fact that they verify the properties listed below (we remind that these properties characterize the sets of classical orthogonal polynomials, see e.g. [31] pp. 150 and after):

  1. The weight w(x) of the classical orthogonal polynomials satisfies the following Pearson differential equation:

    w′(x)w(x)=D+ExA+Bx+Cx2 (A,B,C,D,E=constants)

  2. Classical orthogonal polynomials satisfy the following generalized Rodrigues’ formula:

    Pn(x)=1Knw(x)dndxn([A+Bx+Cx2]n w(x))
    with Kn being a normalization constant which can be chosen arbitrarily and which in the following is chosen in order to respect the traditional standardization. In all cases (I), (II) and (III) it is verified that:
    dkdxk([A+Bx+Cx2]n w(x))  ∀k=0,1,…,n
    vanishes at the extremes of the interval under consideration. So it is possible to prove the orthogonality of Pn(x) with respect to each power xk (where k = 0, 1, … , n − 1) representing Pn(x) with the generalized Rodrigues’ formula and performing successive integrations by parts. The classical orthogonal polynomials satisfy the hypergeometric differential equation (6.5) which can be rewritten in the form:
    (A+Bx+Cx2)y″+[B+D+(2C+E)x]y′ −n[(n+1)C+E]y=0

In what follows, we limit ourselves to consider only the Chebyshev polynomials.

6.3 Chebyshev Polynomials

Starting from the identity (eit)n = ei nt, by using Euler’s formula:

(cost+isint)n=cos(nt)+isin(nt)
and expanding the first member with Newton’s binomial formula, we get:
∑k=0nik(nk)cosn−ktsinkt =∑h=0[n2](−1)h(n2h)cosn−2htsin2ht  +i∑h=0[n−12](−1)h(n2h+1)cosn−2h−1tsin2h+1t =∑h=0[n2](−1)h(n2h)cosn−2ht(1−cos2t)h  +isint∑h=0[n−12](−1)h(n2h+1)cosn−2h−1t(1−cos2t)h

Comparing Equations (6.11) and (6.12) we find:

cos(nt)=∑h=0[n2] (−1)h(n2h)cosn−2ht (1−cos2t)h
sin(nt)sint=∑h=0[n−12] (−1)h (n2h+1)cosn−2h−1t (1−cos2t)h

Putting x = cos t in (6.13) and (6.14), we obtain two polynomials in x of degrees n and n − 1 which are called, respectively, Chebyshev polynomials (CP in short) of the first and second kind:

Tn(x)≔cos(n arccos x)=∑h=0[n2] (−1)h(n2h)xn−2h(1−x2)hUn−1(x)≔sin(n arccos x)sin(arccos x)=∑h=0[n−12] (−1)h (n2h+1)xn−2h−1(1−x2)h

Such polynomials enjoy many important properties [71, 84] of which we recall the most simple ones.

6.3.1 First Kind and Second Kind Chebyshev Polynomials

Main properties of the first kind CP

The trigonometric identity:

cos((n+1)t)+cos((n−1)t)=2costcos(nt)
gives the recursion:
Tn+1(x)=2xTn(x)−Tn−1(x)
from which, by using the initial values T0(x) = 1 and T1(x) = x, the subsequent polynomials easily follow:
T2(x)=2x2−1T3(x)=4x3−3xT4(x)=8x4−8x2+1T5(x)=16x5−20x3+5xT6(x)=32x6−48x4+18x2−1T7(x)=64x7−112x5+56x3−7xT8(x)=128x8−256x6+160x4−32x2+1…

Note that:

  • The leading coefficient of Tn(x) is 2n−1.

  • When n = 2m (m ∈ ℕ), T2m (x) is an even function of x, while T2m+1(x) is an odd function of x.

  • ∀ n ∈ ℕ, Tn(1) = 1 and Tn(−1) = (−1)n.

From the equation:

∫0πcos(nt)cos(mt) dt=0  (if m≠n)
by the change of variable t = arccos x, we find the orthogonality property in [−1, 1] with respect to the weight function (1 − x2)−1/2:
∫−11Tn(x)Tm(x)1−x2dx=0  (if m≠n)

Furthermore, it follows that:

∫−1111−x2dx=π∫−11T n2(x)1−x2dx=∫0πcos2(nt) dt=π2  (n∈N)

All the n zeros of Tn(x) are real, simple and internal to [−1, 1]. More precisely, they are given by:

xk=cos((2k+1)n π2)  (k=0,1,…,n−1)

In fact, it follows that:

|Tn(xk)|=|cos(n arccosxk)|=|cos((2k+1)π2)|=0

Main properties of the second kind CP

Similarly, the properties of the second kind Chebyshev polynomials can be obtained, but we limit ourselves to list them here. They verify the same recursion as the Tn(x):

Un+1(x)=2xUn(x)−Un−1(x) 
with the initial conditions U0(x) = 1 and U1(x) = 2x. Therefore, the first few of them are:
U2(x)=4x2−1U3(x)=8x3−4xU4(x)=16x4−12x2+1U5(x)=32x5−32x3+6xU6(x)=64x6−80x4−24x2−1U7(x)=128x7−192x5+80x3−8xU8(x)=256x8−448x6+240x4−40x2+1…

The second kind Chebyshev polynomials play an important role in representing the powers of a 2×2 non-singular matrix [76, 81]. Extension of this polynomial family to the multivariate case has been considered for representing the powers of an r × r (r ≥ 3) non-singular matrix (see [80, 81]).

Remark 1.

Chebyshev polynomials are a particular case of the Jacobi polynomials P n(α,β)(x), which are orthogonal in the interval [−1, 1] with respect to the weight (1 − x)α(1 + x)β, since:

Tn(x)=P n(−1/2,−1/2)(x) ,   Un(x)=P n(1/2,1/2)(x) 

Therefore, properties of the Chebyshev polynomials could be deduced in a more general framework of the hypergeometric functions.

6.3.2 Third Kind and Fourth Kind Chebyshev Polynomials

In connection with interpolation and quadrature problems, another couple of Chebyshev polynomials have been considered. They correspond to different choices of weights:

Vn(x)=P n(1/2,−1/2)(x),   Wn(x)=P n(−1/2,1/2)(x)

These were called the third and fourth kind Chebyshev polynomials by Walter Gautschi [38].

The third and fourth kind Chebyshev polynomials are defined in [−1, 1] as follows:

Vn(x)=cos[(n+1/2)arccos x]cos[(arccos x)/2]Wn(x)=sin[(n+1/2)arccos x]sin[(arccos x)/2]

Since Wn(x) = (−1)nVn(−x), the third kind Chebyshev polynomials transform into those of the fourth kind by interchanging the ends of the interval [−1, 1] and so they are not essentially different from each other.

6.4 Non-Trigonometric Fourier Series

Taking up the case of the expansions of a function f(x) in (a, b) by means of the uniformly convergent series:

f(x)=f0u0(x)+f1u1(x)+⋯+fnun(x)+⋯
whose Fourier coefficients are:
fk=(f,uk)w=∫abf(x)uk(x)w(x)dx 
it is worth to note that the Bessel inequality always holds, that is:
f 02+f 12+⋯+f n2+⋯=∑k=0∞f k2≤∥f∥w=∫abf(x)w(x)dx 

Moreover, if the system of the uk(x) functions is complete, then the extension to the L w2 space of the Pythagorean theorem, which is known as the Parseval equality, holds:

∑k=0∞f k2=∥f∥w=∫abf(x)w(x)dx 

If the system used is not complete, the convergence in quadratic mean does not occur towards the function f(x), but towards the projection of the function f(x) on the linear manifold generated by the linear combinations of the functions of the system being used.

Next Chapter in Book