Skip to content

Total Derivative as a Linear Map

Definition

Let E⊆RnE\subseteq \mathbb{R}^n, let f ⁣:E→Rk\boldsymbol{f}\colon E\to\mathbb{R}^k be a function, let x0∈int⁡E\boldsymbol{x}_0\in\operatorname{int}E, and let L ⁣:Rn→Rk\boldsymbol{L}\colon \mathbb{R}^n\to\mathbb{R}^k be a linear transformation. We say that f\boldsymbol{f} is (totally) differentiable at x=x0\boldsymbol{x}=\boldsymbol{x}_{0} with (total) derivative L\boldsymbol{L} if, as x→x0\boldsymbol{x}\to\boldsymbol{x}_0,

∥f(x)−f(x0)−L(x−x0)∥∥x−x0∥→0.\frac{\|\boldsymbol{f}(\boldsymbol{x})-\boldsymbol{f}(\boldsymbol{x}_0)-\boldsymbol{L}(\boldsymbol{x}-\boldsymbol{x}_0)\|}{\|\boldsymbol{x}-\boldsymbol{x}_0\|}\to0.

The limit must hold however x\boldsymbol{x} approaches x0\boldsymbol{x}_0, that is, along every convergent sequence xj→x0\boldsymbol{x}_j\to\boldsymbol{x}_0 with xj≠x0\boldsymbol{x}_j\neq\boldsymbol{x}_0, not just along coordinate lines. It says that the relative error in the linear approximation tends to zero.


Interpretation

Total differentiability means the function can be approximated near the point by a linear transformation, with the error shrinking to zero faster than the distance to the point. The linear map h↦Lh\boldsymbol{h}\mapsto\boldsymbol{L}\boldsymbol{h} is also called the differential of f\boldsymbol{f} at x0\boldsymbol{x}_0; for n=k=1n=k=1 it is h↦f′(x0)hh\mapsto f'(x_0)h, the one-variable differential dy=f′(x) dx\mathrm{d}y=f'(x)\,\mathrm{d}x.

It is the multidimensional version of the one-variable fact that ff is differentiable at x0x_0 if and only if f(x0+h)=f(x0)+f′(x0)h+o(h)f(x_0+h)=f(x_0)+f'(x_0)h+o(h) as h→0h\to0 (sometimes called Newton's approximation).

A small grid around x0 with a vector h, mapped by f onto a slanted grid around f(x0) with the image vector Lh: to first order, small squares become small parallelograms.

The first-order approximation is f(x0+h)=f(x0)+Lh+o(∥h∥)\boldsymbol{f}(\boldsymbol{x}_0+\boldsymbol{h})=\boldsymbol{f}(\boldsymbol{x}_0)+\boldsymbol{L}\boldsymbol{h}+o(\|\boldsymbol{h}\|), where L=Df(x0)\boldsymbol{L}=\boldsymbol{Df}(\boldsymbol{x}_0). Locally, f\boldsymbol{f} acts like this linear map, so small squares become approximate parallelograms.

Move x0\boldsymbol x_0 and zoom in: near x0\boldsymbol x_0 the graph is almost the plane f(x0)+Dfx0(h)f(\boldsymbol x_0)+\mathrm{D}f_{\boldsymbol x_0}(\boldsymbol h), with an error that shrinks faster than ∥h∥\|\boldsymbol h\|.


Key Results

  • For the function f ⁣:Rn→Rk\boldsymbol{f}\colon \mathbb{R}^n\to\mathbb{R}^k at x=x0\boldsymbol{x}=\boldsymbol{x}_0, its derivative, Dfx0\mathrm{D} \boldsymbol{f}_{\boldsymbol{x}_0}, is a k×nk\times n matrix or an equivalent linear transformation from Rn\mathbb{R}^n to Rk\mathbb{R}^k.
  • Dfx0(h)\mathrm{D} \boldsymbol{f}_{\boldsymbol{x}_0}(\boldsymbol{h}), where h\boldsymbol{h} is an infinitesimal vector, provides an approximation of the shift in f\boldsymbol{f} (a vector in Rk\mathbb{R}^k) arising from the change h\boldsymbol{h} in x\boldsymbol{x} around x=x0\boldsymbol{x}=\boldsymbol{x}_0 (a vector in Rn\mathbb{R}^n).

Examples

  • The function f(x,y)=(x2,y2)\boldsymbol{f}(x,y) = (x^2,y^2) is differentiable at x=(1,2)\boldsymbol{x}=(1,2) with the derivative L(x,y)=(2x,4y)\boldsymbol{L}(x,y) = (2x,4y).
  • The function f(x,y)=sin⁡(x2+y)f(x,y) = \sin(x^2+y) is differentiable at (x,y)=(0,0)(x,y)=(0,0) and the derivative is L(x,y)=yL(x,y)=y.

Prerequisites

Sources

Aliases: total derivative, Frechet derivative, Fréchet derivative, totally differentiable Keywords: differential Symbols: element of, real numbers, subset

Last updated: 17 October 2026 21:53