A power series is the limit of its polynomial partial sums, and where it converges it defines a function as smooth as a polynomial and computable to any accuracy by truncation. The exponential, the sine, and the cosine are defined this way, and their series are what give meaning to the of a characteristic function. This post develops the convergence of series and of power series, proves that a power series can be differentiated term by term, and constructs the exponential, building on the completeness and differentiation of the earlier posts [1], [2].
#Series and absolute convergence
The series converges to when its partial sums converge to . It converges absolutely when converges.
Convergence is a statement about the sequence of partial sums, so the Cauchy criterion applies, and a series converges if and only if its partial-sum tails are small. Absolute convergence is the stronger and more useful condition.
An absolutely convergent series converges, and .
For the partial-sum increment is bounded by , which is the corresponding increment of the partial sums of . Since the latter series converges its increments tend to , so is Cauchy and converges by completeness. The inequality follows from by passing to the limit, using continuity of the absolute value.
The test that decides absolute convergence for power series is the root test, which compares the terms with a geometric series.
Let . If the series converges absolutely, and if it diverges.
If , choose with . By definition of the limit superior, for all large , so eventually, and converges as a geometric series with ratio below , so converges by comparison. If , then for infinitely many , so infinitely often, the terms do not tend to , so the series cannot converge.
#The radius of convergence
A power series converges on an interval symmetric about its centre, and the root test computes its half-length exactly.
For the power series , set , with when the limit superior is and when it is . The series converges absolutely for and diverges for . The number is the radius of convergence.
Apply the root test to the series , whose terms have . This is below exactly when , giving absolute convergence there, and above when , giving divergence. When the limit superior is , so , the computed value is for every , leaving only convergent, and when it is , so , the value is for every . The boundary is left undecided, as it must be, since the behaviour there depends on the series.
#Term-by-term differentiation
Inside the radius the series defines a function, and that function is differentiable, with derivative the series differentiated term by term.
The differentiated series has the same radius of convergence as .
For the differentiated series is , and multiplication by the fixed nonzero factor does not affect convergence, so and converge for exactly the same (both at trivially) and share a radius. That radius is governed by , using , which holds because . A convergent factor passes through the limit superior, so the two series share the value of and hence the radius .
The passage to the derivative rests on a general principle about differentiating a limit, which the uniform convergence of the partial sums supplies.
Let be differentiable on an interval with pointwise and the derivatives uniformly. Then is differentiable with .
Fix a point and form the difference quotients for . For two indices the mean value theorem applied to gives a point with , so , a bound independent of . Since uniformly the right side tends to , so is uniformly Cauchy and converges uniformly to . Each has the limit as , so the iterated-limit (Moore-Osgood) theorem applies, its two hypotheses being the uniform convergence just shown and the existence of each inner limit . With existing by hypothesis it permits exchanging that limit with the limit in , so
The left side is by definition , so .
Inside its radius of convergence a power series is differentiable with , and by iteration it is infinitely differentiable and equals its own Taylor series, with .
Fix and work on . The partial sums are polynomials with , and these derivatives converge uniformly on , since and converges by Lemma 5 and absolute convergence at . By Theorem 6, is differentiable on with , and since was arbitrary this holds on . By Lemma 5 the derivative is itself a power series of radius , so the argument reapplies to and, by induction, exists as a power series of radius for every . Then , and evaluating the -th derivative at leaves only the constant term , so , the Taylor coefficients.
#The exponential function
The exponential is , a series with radius of convergence since .
The exponential satisfies , , and the functional equation .
Differentiating term by term with Corollary 7, , and from the constant term. For the functional equation, fix and let , whose derivative is by the product and chain rules with , so is constant by the mean value theorem, equal to its value . Thus , and taking shows , so .
With the exponential in hand the trigonometric functions are its even and odd parts on the imaginary axis, , and the same term-by-term calculus gives their derivatives and identities. The power series is the bridge from the algebra of polynomials to the transcendental functions of analysis, and the term-by-term differentiation proved here is what turns formal manipulation of infinite sums into rigorous calculus. The exponential series in particular is the function the characteristic function evaluates at imaginary arguments, and its functional equation is the reason characteristic functions of independent sums multiply.