Differentiation of Power Series

Power series serve as a profound bridge in mathematics, representing complex functions as "infinite polynomials." This unique representation offers a new lens through which to view functions like $\sin(x)$ or $\arctan(x)$, but it also presents a critical question: Can we treat these infinite sums just like finite polynomials when performing calculus? The ability to differentiate a function is a cornerstone of analysis, yet applying it to an infinite series seems like a leap of faith. This article demystifies that leap, demonstrating that term-by-term differentiation is not only possible but is a robust and powerful tool with clear rules and astonishing applications.

In the following sections, we will explore the core technique of term-by-term differentiation, validating this seemingly simple process and examining the crucial rules governing its use, including the conservation of the radius of convergence. We will see how this mechanism elegantly reveals the deep connection between functions like sine and cosine. Following that, we will unleash the practical power of this method. We will see how it allows us to generate new series from old ones, calculate the exact sum of complex numerical series, and even solve the differential equations that describe the physical world, connecting abstract mathematics to physics and engineering.

Imagine you have a machine, a beautiful, intricate machine made of gears and levers. You understand a few basic principles about how it works, but its full capability is a mystery. Then one day, you discover a simple, master rule that allows you to manipulate this machine to perform tasks you never thought possible. That is what we are about to do with power series. As we saw in the introduction, a power series is like a function’s secret identity, an "infinite polynomial" that represents it perfectly. The question we now ask is a daring one: if a function can be written as an infinite polynomial, can we treat it like one? Specifically, can we use the simple rules of calculus on it, term-by-term?

The answer, astonishingly, is yes. This is the heart of the matter, a principle of profound power and elegance.

When you first learned calculus, you mastered the power rule: the derivative of $x^n$ is $n x^{n-1}$. It's a simple, mechanical process. Differentiating a polynomial like $f(x) = c_2 x^2 + c_1 x + c_0$ is just applying this rule to each piece: $f'(x) = 2 c_2 x + c_1$.

What if we had a ​​power series​​, which is essentially a polynomial that never ends? $f(x) = \sum_{n=0}^{\infty} c_n x^n = c_0 + c_1 x + c_2 x^2 + c_3 x^3 + \dots$ It seems almost too good to be true, but the central mechanism is that we can do exactly the same thing. We can differentiate the entire infinite sum by simply differentiating each term individually and adding them back up: $f'(x) = \frac{d}{dx} \left( \sum_{n=0}^{\infty} c_n x^n \right) = \sum_{n=0}^{\infty} \frac{d}{dx} (c_n x^n) = \sum_{n=1}^{\infty} n c_n x^{n-1}$ This technique, called ​​term-by-term differentiation​​, transforms the often-difficult, abstract process of finding a function's derivative into a simple, algebraic manipulation of its series coefficients. It’s like being handed a universal key that unlocks the inner workings of a vast family of functions.

Let's see this magic in action. You probably know that the derivative of $\sin(x)$ is $\cos(x)$. It's one of the first beautiful relationships you learn in trigonometry and calculus. Can we see this relationship in their "infinite polynomial" forms?

The Maclaurin series for $\sin(x)$ is a cascade of odd powers: $\sin(x) = x - \frac{x^3}{3!} + \frac{x^5}{5!} - \frac{x^7}{7!} + \dots = \sum_{n=0}^{\infty} \frac{(-1)^n}{(2n+1)!} x^{2n+1}$ Let's be bold and apply our new rule, differentiating this series term by term as if it were a simple polynomial.

The derivative of the first term, $x$, is $1$. The derivative of the second term, $-\frac{x^3}{3!}$, is $-\frac{3x^2}{3!} = -\frac{x^2}{2!}$. The derivative of the third term, $\frac{x^5}{5!}$, is $\frac{5x^4}{5!} = \frac{x^4}{4!}$. And so on.

Putting it all together, the derivative of the sine series is: $1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \frac{x^6}{6!} + \dots = \sum_{n=0}^{\infty} \frac{(-1)^n}{(2n)!} x^{2n}$ Look closely at this result. This is precisely the Maclaurin series for $\cos(x)$! Term-by-term differentiation has allowed us to watch, at the most fundamental level, as the sine function transforms into the cosine function. The seemingly abstract calculus rule, $\frac{d}{dx}\sin(x) = \cos(x)$, is revealed as a simple algebraic shuffle of coefficients and exponents. The same elegant dance occurs between the hyperbolic functions $\cosh(x)$ and $\sinh(x)$ as well.

This method doesn't just confirm things we already know; it reveals hidden connections. Consider the Maclaurin series for the arctangent function, $\arctan(x)$: $f(x) = \arctan(x) = x - \frac{x^3}{3} + \frac{x^5}{5} - \frac{x^7}{7} + \dots = \sum_{n=0}^{\infty} \frac{(-1)^n x^{2n+1}}{2n+1}$ This series looks related to the sine series, but it's different. What happens if we differentiate it? $f'(x) = \frac{d}{dx} \left( \sum_{n=0}^{\infty} \frac{(-1)^n x^{2n+1}}{2n+1} \right) = \sum_{n=0}^{\infty} \frac{(-1)^n (2n+1) x^{2n}}{2n+1} = \sum_{n=0}^{\infty} (-1)^n x^{2n}$ The result is astonishingly simple: $f'(x) = 1 - x^2 + x^4 - x^6 + \dots$ You might recognize this as a ​​geometric series​​ with first term $1$ and common ratio $-x^2$. We know the sum of such a series is $\frac{1}{1-r}$, so this sums to $\frac{1}{1 - (-x^2)} = \frac{1}{1+x^2}$.

Think about what just happened. We started with the somewhat arcane series for $\arctan(x)$, and by applying a simple mechanical rule, we discovered that its derivative is the clean, rational function $\frac{1}{1+x^2}$. This is a famous derivative pair, but seeing it emerge from the series itself is like finding a Rosetta Stone that translates between two different mathematical languages. It shows an underlying unity we might never have suspected. This also works in reverse. If we start with the easily-derived series for $\frac{1}{1+x^2}$, we can integrate it term-by-term to discover the series for $\arctan(x)$. This powerful duality also applies to functions like $\ln(1-x)$, whose derivative series is the fundamental geometric series, and even more complex functions like $\arccos(x)$.

By now, you might be wondering, "What's the catch?" Can we really do this for any series, anywhere? Not quite. Calculus is a game of precision, and our powerful new tool has some rules.

A power series doesn't always converge for all values of $x$. It typically has a territory where it behaves properly. This territory is defined by its ​​radius of convergence​​, $R$. For a series centered at $x=0$, it is guaranteed to converge for all $x$ in the open interval $(-R, R)$. Outside this interval (for $|x| > R$), the terms of the series grow too fast and it diverges.

So, the rule for term-by-term differentiation is that it is valid within this open interval of convergence. But here is the truly beautiful part, a kind of "conservation law" for power series: ​​When you differentiate a power series, the new series has the exact same radius of convergence $R$.​​

This is a spectacular result! It means that the "playground" where we can safely perform calculus doesn't shrink. If you have a series that works on the interval $(-1, 1)$, its derivative series will also work on $(-1, 1)$. The domain of validity is conserved. This principle is so fundamental that it holds true even when we venture into the realm of complex numbers, where the "interval" becomes a "disk of convergence".

Our conservation law is about the radius $R$, which defines the open interval $(-R, R)$. But what happens right on the edge, at the boundary points $x=R$ and $x=-R$? Here, the situation is more delicate. Convergence at an endpoint is often fragile, and the process of differentiation—which involves multiplying terms by an ever-increasing factor of $n$—can be enough to disrupt it.

Think of differentiation as a "roughening" process. A smooth function might have a less-smooth derivative. For series, this can mean losing convergence at the boundary.

Let's look at an example. The series $f(x) = \sum_{n=1}^{\infty} \frac{x^n}{n^2}$ has a radius of convergence $R=1$. At the endpoints, $x=1$ and $x=-1$, the series converges. So its full interval of convergence is the closed interval $[-1, 1]$.

Now, let's differentiate it: $g(x) = f'(x) = \sum_{n=1}^{\infty} \frac{n x^{n-1}}{n^2} = \sum_{n=1}^{\infty} \frac{x^{n-1}}{n}$ Our theorem assures us the radius of convergence is still $R=1$. But what about the endpoints?

• At $x=-1$, the series becomes the alternating harmonic series $\sum \frac{(-1)^{n-1}}{n}$, which converges.
• At $x=1$, the series becomes the harmonic series $\sum \frac{1}{n}$, which famously diverges.

We lost convergence at one of the endpoints! The original series was well-behaved on the entire interval $[-1, 1]$, but its derivative is only well-behaved on $[-1, 1)$.

This loss of endpoint convergence can be progressive. One can even construct a series that converges at an endpoint, as does its first derivative, but whose second derivative no longer converges there. It's as if each act of differentiation sands away a bit of the series' "polish" at the boundary, until finally the good behavior is gone.

In grasping these principles, we see the full picture. Term-by-term differentiation is a tool of immense power, allowing us to treat infinite series with the familiarity of high-school algebra. It reveals the deep structural unity of mathematics, where the derivative of $\sin(x)$ is not just a rule to be memorized but a necessary consequence of their series forms. The main principle is robust—the radius of convergence is beautifully conserved. And the subtleties at the boundaries are not flaws, but a fascinating glimpse into the delicate nature of the infinite.

Now that we have explored the machinery of power series and the rules for their manipulation, you might be asking a fair question: "What is all this for?" It is a question I deeply appreciate. The pursuit of knowledge for its own sake is a noble one, but the real magic, the true beauty of a physical or mathematical idea, is often revealed when it steps off the page and allows us to do something new—to understand the world in a different way, to calculate something previously incalculable, or to see a hidden connection between two seemingly unrelated fields.

The simple act of differentiating a power series term by term is one such magical key. It is a tool of astonishing power and versatility, a master key that unlocks doors in pure mathematics, physics, and engineering. Let us embark on a journey to see what doors it can open.

Imagine you have a single, fundamental object—say, the infinite geometric series, a veritable pillar of mathematics that we have come to know and love:

This is a complete description of the function on the left in terms of the simplest possible building blocks, the powers of $x$. Now, let's ask a simple question. We know what the derivative of the function $\frac{1}{1-x}$ is; it's $\frac{1}{(1-x)^2}$. Does our series representation know this? Can we discover the series for this new function without starting from scratch?

The principle of term-by-term differentiation says, "Yes, absolutely!" We can simply apply the differentiation operator to every single term in the infinite sum, as if it were just a very, very long polynomial:

And so, just like that, we have discovered an entirely new power series representation, as if by magic.

This is a remarkable result. The series on the right has coefficients that simply count up: 1, 2, 3, 4, ... Who would have thought they would sum up to such a compact and elegant function?

But why stop there? We have a new series. Let's differentiate it again! Differentiating $\frac{1}{(1-x)^2}$ gives $\frac{2}{(1-x)^3}$. On the series side, we get $\sum_{n=2}^{\infty} n(n-1)x^{n-2}$. This allows us to "bootstrap" our way to series representations for a whole family of more complex functions. With a few algebraic tweaks, like multiplying by powers of $x$, we can generate series for functions like $\frac{x^2}{(1-x)^3}$ and beyond. We are not merely checking answers; we are generating new mathematical facts from a single starting point.

So far, we have used known functions to discover new series. Let's turn the telescope around. Can we use this idea to find the exact value of a seemingly difficult infinite sum of numbers?

Consider a sum like this one:

At first glance, this is rather intimidating. The terms get smaller, so it converges, but to what? A direct calculation is impossible. However, let us look at its structure. It looks just like our series $\sum nx^n$, but with the specific value $x=\frac{1}{5}$ plugged in.

We already know the closed-form function for $\sum_{n=1}^{\infty} nx^{n-1}$. By simply multiplying by $x$, we get a function for the series we want:

We have essentially built a "calculator" for any sum of this form. All we have to do is substitute $x=\frac{1}{5}$ into our function:

How beautiful! A messy, infinite sum of fractions is exactly $\frac{5}{16}$. This technique is immensely powerful. By repeatedly differentiating the geometric series, we can find closed-form expressions for series like $\sum n(n-1)x^n$, which allows us to evaluate even more complex numerical sums, such as $\sum \frac{n^2-n}{4^n}$, with grace and precision.

Perhaps the most profound application of this idea is its role as a bridge to the physical sciences. Many of the fundamental laws of nature—from the motion of a pendulum to the flow of heat and the vibrations of a guitar string—are expressed as differential equations. These equations relate a function to its own derivatives.

Consider the equation for simple harmonic motion, which describes oscillators of all kinds: springs, electrical circuits, and even the swaying of a skyscraper in the wind. A simple version of this equation is:

where $A$ is some positive constant related to the physical properties of the system (like the stiffness of the spring).

How do we find a function $y(x)$ that solves this? One of the most powerful and general methods is to assume the solution can be written as a power series: $y(x) = \sum c_n x^n$. If we can do this, we can differentiate it term-by-term, twice, to get an expression for $y''(x)$. Then, we substitute both series into the differential equation.

The result is magical. The differential equation—a problem of calculus—is transformed into an algebraic equation relating the coefficients $c_n$. By demanding that the total coefficient for each power of $x$ be zero, we derive a "recurrence relation" that tells us how to calculate every coefficient from the previous ones.

For instance, one might verify that a function given by a power series, like $y(x) = \sum_{n=0}^{\infty} \frac{(-1)^n 4^n}{(2n+1)!} x^{2n+1}$ (which happens to be the series for $\sin(2x)$), is indeed a solution to $y'' + 4y = 0$ by simply differentiating the series term by term and seeing that the resulting series for $y''$ is exactly $-4$ times the original series for $y$. This is how we discover that the solutions to the oscillator equation are sines and cosines—not by guesswork, but by the systematic and mechanical logic of power series.

The power of term-by-term differentiation does not stop with simple functions. It scales beautifully to higher levels of mathematical abstraction, revealing an even deeper unity.

Many problems in physics and engineering involve not one, but many, interacting quantities. These are described by systems of differential equations, which can be written compactly using matrices. The solution to a system like $\mathbf{x}'(t) = A\mathbf{x}(t)$ involves the "matrix exponential," $\exp(tA)$, which is itself defined by a power series:

How do we know this is the right solution? We must show that its derivative with respect to time is $A\exp(tA)$. And the way we prove this fundamental theorem is by differentiating the series of matrices term-by-term, just as we did for simple numbers. The same simple idea holds, providing the cornerstone for solving complex linear systems that model everything from chemical reactions to control systems.

This pattern of thought—manipulating a parameter inside a sum or integral—echoes throughout mathematics. It is the discrete analogue to a powerful technique for evaluating definite integrals known as "Feynman's trick," where one differentiates an integral with respect to a parameter. In both cases, we are leveraging the wonderful interplay between the calculus of operators (like differentiation) and the algebraic structure of the expression.

Perhaps the most breathtaking view from this summit is how it connects the discrete world of sums with the continuous world of integrals. Using formal power series of the differentiation operator $D = \frac{d}{dx}$, mathematicians have derived the famous Euler-Maclaurin formula. This formula provides an explicit connection between a discrete sum $\sum f(n)$ and a continuous integral $\int f(x)dx$. It achieves this by expressing the "antidifference" operator (the inverse of summation) as a power series in the operator $D$. It is a stunning result that tells us that summation and integration are not distant cousins, but two sides of the same coin, linked by the logic of power series.

From generating a simple series to solving the equations of physics and unifying deep mathematical concepts, the principle of term-by-term differentiation is a testament to the fact that sometimes the simplest ideas are the most profound. They are the keys that, when turned in the right lock, reveal the magnificent and interconnected architecture of the world.