Partial derivative

In mathematics, a partial derivative of a function of several variables is its derivative with respect to one of those variables, with the others held constant (as opposed to the total derivative, in which all variables are allowed to vary). Partial derivatives are used in vector calculus and differential geometry.

The partial derivative of a function f(x, y, ...) with respect to the variable x is variously denoted by

$f^\prime_x,\ f_x,\ \partial_x f, \frac{\partial}{\partial x}f, \text{ or } \frac{\partial f}{\partial x}.$

Since in general a partial derivative is a function of the same arguments as was the original function, this functional dependence is sometimes explicitly included in the notation, as in

$f_x(x, y, ...), \ \frac{{\partial f}}{{\partial x}} (x, y, ...).$

The partial-derivative symbol is ∂. One of the first known uses of the symbol in mathematics is by Marquis de Condorcet from 1770, who used it for partial differences. The modern partial derivative notation is by Adrien-Marie Legendre (1786), though he later abandoned it; Carl Gustav Jacob Jacobi re-introduced the symbol in 1841.^[1]

Introduction

Suppose that ƒ is a function of more than one variable. For instance,

$z = f(x,y) = \,\! x^2 + xy + y^2.\,$

A graph of z = x² + xy + y². For the partial derivative at (1, 1) that leaves y constant, the corresponding tangent line is parallel to the xz-plane.

A slice of the graph above showing the function in the xz-plane at y= 1. Note that the two axes are shown here with different scales. The slope of the tangent line is 3.

The graph of this function defines a surface in Euclidean space. To every point on this surface, there is an infinite number of tangent lines. Partial differentiation is the act of choosing one of these lines and finding its slope. Usually, the lines of most interest are those that are parallel to the xz-plane, and those that are parallel to the yz-plane (which result from holding either y or x constant, respectively.)

To find the slope of the line tangent to the function at P(1, 1) that is parallel to the xz-plane, the y variable is treated as constant. The graph and this plane are shown on the right. On the graph below it, we see the way the function looks on the plane y = 1. By finding the derivative of the equation while assuming that y is a constant, the slope of ƒ at the point (x, y) is found to be:

$\frac{\partial z}{\partial x} = 2x+y$

So at (1, 1), by substitution, the slope is 3. Therefore

$\frac{\partial z}{\partial x} = 3$

at the point (1, 1). That is, the partial derivative of z with respect to x at (1, 1) is 3, as shown in the graph.

Definition

Basic definition

The function f can be reinterpreted as a family of functions of one variable indexed by the other variables:

$f(x,y) = f_y(x) = \,\! x^2 + xy + y^2.\,$

In other words, every value of y defines a function, denoted f_y, which is a function of one variable x.^{[lower-alpha 1]} That is,

$f_y(x) = x^2 + xy + y^2.\,$

Once a value of y is chosen, say a, then f(x,y) determines a function f_a which traces a curve x² + ax + a² on the xz plane:

$f_a(x) = x^2 + ax + a^2. \,$

In this expression, a is a constant, not a variable, so f_a is a function of only one real variable, that being x. Consequently, the definition of the derivative for a function of one variable applies:

$f_a'(x) = 2x + a. \,$

The above procedure can be performed for any choice of a. Assembling the derivatives together into a function gives a function which describes the variation of f in the x direction:

$\frac{\partial f}{\partial x}(x,y) = 2x + y.\,$

This is the partial derivative of f with respect to x. Here ∂ is a rounded d called the partial derivative symbol. To distinguish it from the letter d, ∂ is sometimes pronounced "tho" or "partial"

In general, the partial derivative of an n-ary function f(x₁,...,x_n) in the direction x_i at the point (a₁,...,a_n) is defined to be:

$\frac{\partial f}{\partial x_i}(a_1,\ldots,a_n) = \lim_{h \to 0}\frac{f(a_1,\ldots,a_i+h,\ldots,a_n) - f(a_1,\ldots, a_i, \dots,a_n)}{h}.$

In the above difference quotient, all the variables except x_i are held fixed. That choice of fixed values determines a function of one variable $f_{a_1,\ldots,a_{i-1},a_{i+1},\ldots,a_n}(x_i) = f(a_1,\ldots,a_{i-1},x_i,a_{i+1},\ldots,a_n)$, and by definition,

$\frac{df_{a_1,\ldots,a_{i-1},a_{i+1},\ldots,a_n}}{dx_i}(a_i) = \frac{\partial f}{\partial x_i}(a_1,\ldots,a_n).$

In other words, the different choices of a index a family of one-variable functions just as in the example above. This expression also shows that the computation of partial derivatives reduces to the computation of one-variable derivatives.

An important example of a function of several variables is the case of a scalar-valued function f(x₁,...x_n) on a domain in Euclidean space $\mathbb {R} ^{n}$ (e.g., on $\mathbb {R} ^{2}$ or $\mathbb {R} ^{3}$). In this case f has a partial derivative ∂f/∂x_j with respect to each variable x_j. At the point a, these partial derivatives define the vector

$\nabla f(a)=\left({\frac {\partial f}{\partial x_{1}}}(a),\ldots ,{\frac {\partial f}{\partial x_{n}}}(a)\right).$

This vector is called the gradient of f at a. If f is differentiable at every point in some domain, then the gradient is a vector-valued function ∇f which takes the point a to the vector ∇f(a). Consequently, the gradient produces a vector field.

A common abuse of notation is to define the del operator (∇) as follows in three-dimensional Euclidean space $\mathbb {R} ^{3}$ with unit vectors $\mathbf{\hat{i}}, \mathbf{\hat{j}}, \mathbf{\hat{k}}$:

$\nabla = \bigg[{\frac{\partial}{\partial x}} \bigg] \mathbf{\hat{i}} + \bigg[{\frac{\partial}{\partial y}}\bigg] \mathbf{\hat{j}} + \bigg[{\frac{\partial}{\partial z}}\bigg] \mathbf{\hat{k}}$

Or, more generally, for n-dimensional Euclidean space $\mathbb {R} ^{n}$ with coordinates (x₁, x₂, x₃,...,x_n) and unit vectors ($\mathbf{\hat{e}_1}, \mathbf{\hat{e}_2}, \mathbf{\hat{e}_3}, \dots , \mathbf{\hat{e}_n}$):

$\nabla = \sum_{j=1}^n \bigg[{\frac{\partial}{\partial x_j}}\bigg] \mathbf{\hat{e}_j} = \bigg[{\frac{\partial}{\partial x_1}}\bigg] \mathbf{\hat{e}_1} + \bigg[{\frac{\partial}{\partial x_2}}\bigg] \mathbf{\hat{e}_2} + \bigg[{\frac{\partial}{\partial x_3}}\bigg] \mathbf{\hat{e}_3} + \dots + \bigg[{\frac{\partial}{\partial x_n}}\bigg] \mathbf{\hat{e}_n}$

Formal definition

Like ordinary derivatives, the partial derivative is defined as a limit. Let U be an open subset of Rⁿ and f : U → R a function. The partial derivative of f at the point a = (a₁, ..., a_n) ∈ U with respect to the i-th variable a_i is defined as

$\frac{ \partial }{\partial a_i }f(\mathbf{a}) = \lim_{h \rightarrow 0}{ f(a_1, \dots , a_{i-1}, a_i+h, a_{i+1}, \dots ,a_n) - f(a_1, \dots, a_i, \dots ,a_n) \over h }$

Even if all partial derivatives ∂f/∂a_i(a) exist at a given point a, the function need not be continuous there. However, if all partial derivatives exist in a neighborhood of a and are continuous there, then f is totally differentiable in that neighborhood and the total derivative is continuous. In this case, it is said that f is a C¹ function. This can be used to generalize for vector valued functions (f : U → R'^m) by carefully using a componentwise argument.

The partial derivative $\frac{\partial f}{\partial x}$ can be seen as another function defined on U and can again be partially differentiated. If all mixed second order partial derivatives are continuous at a point (or on a set), f is termed a C² function at that point (or on that set); in this case, the partial derivatives can be exchanged by Clairaut's theorem:

$\frac{\partial^2f}{\partial x_i\, \partial x_j} = \frac{\partial^2f} {\partial x_j\, \partial x_i}.$

Examples

Geometry

The volume of a cone depends on height and radius

The volume V of a cone depends on the cone's height h and its radius r according to the formula

$V(r, h) = \frac{\pi r^2 h}{3}.$

The partial derivative of V with respect to r is

$\frac{ \partial V}{\partial r} = \frac{ 2 \pi r h}{3},$

which represents the rate with which a cone's volume changes if its radius is varied and its height is kept constant. The partial derivative with respect to h is

$\frac{ \partial V}{\partial h} = \frac{\pi r^2}{3},$

which represents the rate with which the volume changes if its height is varied and its radius is kept constant.

By contrast, the total derivative of V with respect to r and h are respectively

$\frac{\operatorname dV}{\operatorname dr} = \overbrace{\frac{2 \pi r h}{3}}^\frac{ \partial V}{\partial r} + \overbrace{\frac{\pi r^2}{3}}^\frac{ \partial V}{\partial h}\frac{\operatorname d h}{\operatorname d r}$

and

$\frac{\operatorname dV}{\operatorname dh} = \overbrace{\frac{\pi r^2}{3}}^\frac{ \partial V}{\partial h} + \overbrace{\frac{2 \pi r h}{3}}^\frac{ \partial V}{\partial r}\frac{\operatorname d r}{\operatorname d h}$

The difference between the total and partial derivative is the elimination of indirect dependencies between variables in partial derivatives.

If (for some arbitrary reason) the cone's proportions have to stay the same, and the height and radius are in a fixed ratio k,

$k = \frac{h}{r} = \frac{\operatorname d h}{\operatorname d r}.$

This gives the total derivative with respect to r:

$\frac{\operatorname dV}{\operatorname dr} = \frac{2 \pi r h}{3} + \frac{\pi r^2}{3}k$

which simplifies to:

$\frac{\operatorname dV}{\operatorname dr} = k\pi r^2$

Similarly, the total derivative with respect to h is:

$\frac{\operatorname dV}{\operatorname dh} = \pi r^2$

The total derivative with respect to both r and h of the volume intended as scalar function of these two variables is given by the gradient vector $\nabla V = \left(\frac{\partial V}{\partial r},\frac{\partial V}{\partial h}\right) = \left(\frac{2}{3}\pi rh, \frac{1}{3}\pi r^2\right)$.

Optimization

Partial derivatives appear in any calculus-based optimization problem with more than one choice variable. For example, in economics a firm may wish to maximize profit π(x, y) with respect to the choice of the quantities x and y of two different types of output. The first order conditions for this optimization are π_x = 0 = π_y. Since both partial derivatives π_x and π_y will generally themselves be functions of both arguments x and y, these two first order conditions form a system of two equations in two unknowns.

Image resizing

Partial derivatives are key to target-aware image resizing algorithms. Widely known as seam carving, these algorithms require each pixel in an image to be assigned a numerical 'energy' to describe their dissimilarity against orthogonal adjacent pixels. The algorithm then progressively removes rows or columns with the lowest energy. The formula established to determine a pixel's energy (magnitude of gradient at a pixel) depends heavily on the constructs of partial derivatives.

Economics

Partial derivatives play a prominent role in economics, in which most functions describing economic behaviour posit that the behaviour depends on more than one variable. For example a societal consumption function may describe the amount spent on consumer goods as depending on both income and wealth; the marginal propensity to consume is then the partial derivative of the consumption function with respect to income.

Notation

For the following examples, let f be a function in x, y and z.

First-order partial derivatives:

$\frac{ \partial f}{ \partial x} = f_x = \partial_x f.$

Second-order partial derivatives:

$\frac{ \partial^2 f}{ \partial x^2} = f_{xx} = \partial_{xx} f.$

Second-order mixed derivatives:

$\frac{\partial^2 f}{\partial y \, \partial x} = \frac{\partial}{\partial y} \left( \frac{\partial f}{\partial x} \right) = (f_{x})_{y} = f_{xy} = \partial_{yx} f.$

Higher-order partial and mixed derivatives:

$\frac{ \partial^{i+j+k} f}{ \partial x^i\, \partial y^j\, \partial z^k } = f^{(i, j, k)}.$

When dealing with functions of multiple variables, some of these variables may be related to each other, and it may be necessary to specify explicitly which variables are being held constant. In fields such as statistical mechanics, the partial derivative of f with respect to x, holding y and z constant, is often expressed as

$\left( \frac{\partial f}{\partial x} \right)_{y,z}.$

Antiderivative analogue

There is a concept for partial derivatives that is analogous to antiderivatives for regular derivatives. Given a partial derivative, it allows for the partial recovery of the original function.

Consider the example of $\frac{\partial z}{\partial x} = 2x+y$. The "partial" integral can be taken with respect to x (treating y as constant, in a similar manner to partial differentiation):

$z = \int \frac{\partial z}{\partial x} \,dx = x^2 + xy + g(y)$

Here, the "constant" of integration is no longer a constant, but instead a function of all the variables of the original function except x. The reason for this is that all the other variables are treated as constant when taking the partial derivative, so any function which does not involve $x$ will disappear when taking the partial derivative, and we have to account for this when we take the antiderivative. The most general way to represent this is to have the "constant" represent an unknown function of all the other variables.

Thus the set of functions $x^2 + xy + g(y)$, where g is any one-argument function, represents the entire set of functions in variables x,y that could have produced the x-partial derivative $2x + y$.

If all the partial derivatives of a function are known (for example, with the gradient), then the antiderivatives can be matched via the above process to reconstruct the original function up to a constant.

Higher order partial derivatives

Second and higher order partial derivatives are defined analogously to the higher order derivatives of univariate functions. For the function $f(x, y, ...)$ the "own" second partial derivative with respect to x is simply the partial derivative of the partial derivative (both with respect to x):^{[2]:316–318}

$\frac{{\partial ^2 f}}{{\partial x^2}} \equiv \partial \frac{{\partial f / \partial x}}{{\partial x}} \equiv \frac{{\partial f_x }}{{\partial x }} \equiv f_{{xx}}.$

The cross partial derivative with respect to x and y is obtained by taking the partial derivative of f with respect to x, and then taking the partial derivative of the result with respect to y, to obtain

$\frac{{\partial ^2 f}}{{\partial y\, \partial x}} \equiv \partial \frac{{\partial f / \partial x}}{{\partial y}} \equiv \frac{{\partial f_x}}{{\partial y}} \equiv f_{{xy}}.$

Schwarz' theorem states that if the second derivatives are continuous the expression for the cross partial derivative is unaffected by which variable the partial derivative is taken with respect to first and which is taken second. That is,

$\frac {{\partial ^2 f}}{{\partial x\, \partial y}} = \frac{{\partial ^2 f}}{{\partial y\, \partial x}}$

or equivalently $f_{{xy}}=f_{{yx}}.$

Own and cross partial derivatives appear in the Hessian matrix which is used in the second order conditions in optimization problems.

See also

• d'Alembertian operator
• Chain rule
• Curl (mathematics)
• Directional derivative
• Divergence
• Exterior derivative
• Gradient
• Jacobian matrix and determinant
• Laplacian
• Symmetry of second derivatives
• Triple product rule, also known as the cyclic chain rule.

Notes

1. This can also be expressed as the adjointness between the product space and function space constructions.

References

1. Miller, Jeff (2009-06-14). "Earliest Uses of Symbols of Calculus". Earliest Uses of Various Mathematical Symbols. Retrieved 2009-02-20.
2. Chiang, Alpha C. Fundamental Methods of Mathematical Economics, McGraw-Hill, third edition, 1984.

External links

• Hazewinkel, Michiel, ed. (2001), "Partial derivative", Encyclopedia of Mathematics, Springer, ISBN 978-1-55608-010-4
• Partial Derivatives at MathWorld