Lagrange multiplier

In mathematical optimization, the method of Lagrange multipliers is a strategy for finding the local maxima and minima of a function subject to equality constraints (i.e., subject to the condition that one or more equations have to be satisfied exactly by the chosen values of the variables). It is named after the mathematician Joseph-Louis Lagrange. The basic idea is to convert a constrained problem into a form such that the derivative test of an unconstrained problem can still be applied. The relationship between the gradient of the function and gradients of the constraints rather naturally leads to a reformulation of the original problem, known as the Lagrangian function.The method can be summarized as follows: in order to find the maximum or minimum of a function



f
(
x
)


{\displaystyle f(x)}
subjected to the equality constraint



g
(
x
)
=
0


{\displaystyle g(x)=0}
, form the Lagrangian function






L


(
x
,
λ
)
=
f
(
x
)

λ
g
(
x
)


{\displaystyle {\mathcal {L}}(x,\lambda )=f(x)-\lambda g(x)}
and find the stationary points of





L




{\displaystyle {\mathcal {L}}}
considered as a function of



x


{\displaystyle x}
and the Lagrange multiplier



λ


{\displaystyle \lambda }
. The solution corresponding to the original constrained optimization is always a saddle point of the Lagrangian function, which can be identified among the stationary points from the definiteness of the bordered Hessian matrix.The great advantage of this method is that it allows the optimization to be solved without explicit parameterization in terms of the constraints. As a result, the method of Lagrange multipliers is widely used to solve challenging constrained optimization problems. Further, the method of Lagrange multipliers is generalized by the Karush–Kuhn–Tucker conditions, which can also take into account inequality constraints of the form



h
(

x

)

c


{\displaystyle h(\mathbf {x} )\leq c}
.

View More On Wikipedia.org
  • 64

    Greg Bernhardt

    A PF Singularity From USA
    • Messages
      19,451
    • Media
      227
    • Reaction score
      10,043
    • Points
      1,237
  • 1

    kostoglotov

    A PF Electron From Brisbane, Australia
    • Messages
      234
    • Reaction score
      6
    • Points
      20
  • 1

    a255c

    A PF Quark
    • Messages
      7
    • Reaction score
      0
    • Points
      6
  • 1

    mr.tea

    A PF Atom
    • Messages
      102
    • Reaction score
      12
    • Points
      38
  • 1

    Nico045

    A PF Electron
    • Messages
      10
    • Reaction score
      0
    • Points
      11
  • 1

    Argelium

    A PF Quark
    • Messages
      25
    • Reaction score
      7
    • Points
      4
  • 1

    Archimedess

    A PF Electron
    • Messages
      23
    • Reaction score
      0
    • Points
      14
  • 1

    Ted Ali

    A PF Atom
    • Messages
      12
    • Reaction score
      1
    • Points
      36
  • 1

    Kashmir

    A PF Atom
    • Messages
      468
    • Reaction score
      74
    • Points
      38
  • 1

    hello_world30

    A PF Quark
    • Messages
      4
    • Reaction score
      0
    • Points
      1
  • 1

    deuteron

    A PF Quark From Munich
    • Messages
      57
    • Reaction score
      13
    • Points
      6
  • 1

    shellert

    • Messages
      0
    • Reaction score
      0
    • Points
      0
  • Back
    Top