Skip to content

Method of Lagrange for Equality Constraints

Theorem

Let A⊆RnA\subseteq\mathbb{R}^n be open. Consider

max⁡x∈Af(x)subject tohj(x)=cj, j=1,…,m,\begin{aligned} &\max_{\boldsymbol{x}\in A} f(\boldsymbol{x})\\ &\text{subject to}\quad h_j(\boldsymbol{x})=c_j,\ j=1,\ldots,m, \end{aligned}

with C1C^1 data and m<nm<n. Define

L(x,μ)=f(x)+∑j=1mμj(cj−hj(x)).L(\boldsymbol{x},\boldsymbol{\mu})=f(\boldsymbol{x})+\sum_{j=1}^m\mu_j(c_j-h_j(\boldsymbol{x})).

If f(x∗)f(\boldsymbol{x}^\ast) is a local maximum or minimum subject to the constraints, then either nondegenerate constraint qualification (NDCQ) fails at x∗\boldsymbol{x}^\ast or there exists μ∗∈Rm\boldsymbol{\mu}^\ast\in\mathbb{R}^m such that

∇L(x∗,μ∗)=0.\boldsymbol{\nabla} L(\boldsymbol{x}^\ast,\boldsymbol{\mu}^\ast)=0.

Interpretation

A regular equality-constrained optimum must be a critical point of the Lagrangian. The reason is that ff cannot be improved to first order by moving along the constraint set, which happens exactly when ∇f\boldsymbol{\nabla} f is a linear combination of the constraint gradients.

Circular level sets of f and the constraint line h(x) = c. At x star the gradients of f and h are parallel. At another point on the line they are not, so moving along the line still improves f.

The grey circles are level curves of ff around its unconstrained maximum, and the blue line is the constraint h(x)=ch(\boldsymbol{x})=c. At x∗\boldsymbol{x}^\ast the level curve of the highest value that still meets the line just touches it, and the gradients of ff and hh are parallel: ∇f(x∗)=μ∇h(x∗)\boldsymbol{\nabla} f(\boldsymbol{x}^\ast)=\mu\boldsymbol{\nabla} h(\boldsymbol{x}^\ast). At the orange point ∇f\boldsymbol{\nabla} f has a component along the line, so moving along h(x)=ch(\boldsymbol{x})=c still increases ff.

The equations ∂L/∂xi=0\partial L/\partial x_i=0 say ∇f(x∗)=∑jμj∗∇hj(x∗)\displaystyle \boldsymbol{\nabla} f(\boldsymbol{x}^\ast)=\sum_j\mu_j^\ast\boldsymbol{\nabla} h_j(\boldsymbol{x}^\ast), and ∂L/∂μj=0\partial L/\partial\mu_j=0 gives back hj(x∗)=cjh_j(\boldsymbol{x}^\ast)=c_j: n+mn+m equations for n+mn+m unknowns. NDCQ is needed for the multipliers to exist. Minimizing xx on the curve x3−y2=0x^3-y^2=0 shows why: the minimizer is the origin, where ∇h=(3x2,−2y)\boldsymbol{\nabla} h=(3x^2,-2y) is 0\boldsymbol{0}, and no μ\mu gives (1,0)=μ0(1,0)=\mu\boldsymbol{0}. Such points are kept as separate candidates, and all candidates still have to be compared, since the conditions are only necessary.

The method optimizes the restriction of ff to the constraint set; without constraints it reduces to ∇f=0\boldsymbol{\nabla} f=\boldsymbol{0} (unconstrained extrema conditions). The multiplier returns later as a shadow price: for max⁡xy\max xy subject to x+y=10x+y=10 from the Examples, the solution is x=y=μ∗=5x=y=\mu^\ast=5; with 1010 replaced by cc the best value c2/4c^2/4 grows at rate c/2=5c/2=5 at c=10c=10.


Key Results

  • The theorem gives necessary, not sufficient, conditions.
  • Stationarity in the multiplier variables recovers the equality constraints.
  • Equality constraints can be written on either side because they have no direction.

Examples

  • Maximizing xyxy subject to x+y=10x+y=10 gives L=xy+μ(10−x−y)L=xy+\mu(10-x-y).
  • Minimizing x2+y2x^2+y^2 subject to x+y=1x+y=1 uses the same equality-constrained stationarity method.

Prerequisites

Sources

Keywords: Lagrange method with equalities, equality FONC, equality-constrained Lagrangian Symbols: element of, mu, nabla gradient, partial, real numbers, subset, sum

Last updated: 27 October 2026 11:52