Langevin equation

In statistical physics, a Langevin equation (Paul Langevin, 1908) is a stochastic differential equation describing the time evolution of a subset of the degrees of freedom. These degrees of freedom typically are collective (macroscopic) variables changing only slowly in comparison to the other (microscopic) variables of the system. The fast (microscopic) variables are responsible for the stochastic nature of the Langevin equation.

Brownian motion as a prototype

The original Langevin equation^[1] describes Brownian motion, the apparently random movement of a particle in a fluid due to collisions with the molecules of the fluid,

$m\frac{d^{2}\mathbf{x}}{dt^{2}}=-\lambda \frac{d\mathbf{x}}{dt}+\boldsymbol{\eta}\left( t\right).$

The degree of freedom of interest here is the position $\mathbf {x}$ of the particle, $m$ denotes the particle's mass. The force acting on the particle is written as a sum of a viscous force proportional to the particle's velocity (Stokes' law), and a noise term ${\displaystyle {\boldsymbol {\eta }}\left(t\right)}$ (the name given in physical contexts to terms in stochastic differential equations which are stochastic processes) representing the effect of the collisions with the molecules of the fluid. The force ${\displaystyle {\boldsymbol {\eta }}\left(t\right)}$ has a Gaussian probability distribution with correlation function

$\left\langle \eta_{i}\left( t\right)\eta_{j}\left( t^{\prime}\right) \right\rangle =2\lambda k_{B}T\delta _{i,j}\delta \left(t-t^{\prime }\right) ,$

where $k_{B}$ is Boltzmann's constant, $T$ is the temperature and ${\displaystyle \eta _{i}\left(t\right)}$ is the i-th component of the vector ${\displaystyle {\boldsymbol {\eta }}\left(t\right)}$. The δ-function form of the correlations in time means that the force at a time $t$ is assumed to be completely uncorrelated with it at any other time. This is an approximation; the actual random force has a nonzero correlation time corresponding to the collision time of the molecules. However, the Langevin equation is used to describe the motion of a "macroscopic" particle at a much longer time scale, and in this limit the $\delta$-correlation and the Langevin equation become exact.

Another prototypical feature of the Langevin equation is the occurrence of the damping coefficient $\lambda$ in the correlation function of the random force, a fact also known as Einstein relation.

Mathematical aspects

A strictly $\delta$-correlated fluctuating force ${\displaystyle {\boldsymbol {\eta }}\left(t\right)}$ isn't a function in the usual mathematical sense and even the derivative ${\displaystyle d\mathbf {x} /dt}$ isn't defined in this limit. The Langevin equation as it stands requires an interpretation in this case, see Itō calculus.

Generic Langevin equation

There is a formal derivation of a generic Langevin equation from classical mechanics.^[2][3] This generic equation plays a central role in the theory of critical dynamics,^[4] and other areas of nonequilibrium statistical mechanics. The equation for Brownian motion above is a special case.

An essential condition of the derivation is a criterion dividing the degrees of freedom into the categories slow and fast. For example, local thermodynamic equilibrium in a liquid is reached within a few collision times. But it takes much longer for densities of conserved quantities like mass and energy to relax to equilibrium. Densities of conserved quantities, and in particular their long wavelength components, thus are slow variable candidates. Technically this division is realized with the Zwanzig projection operator,^[5] the essential tool in the derivation. The derivation is not completely rigorous because it relies on (plausible) assumptions akin to assumptions required elsewhere in basic statistical mechanics.

Let ${\displaystyle A=\{A_{i}\}}$ denote the slow variables. The generic Langevin equation then reads

$\frac{dA_{i}}{dt}=k_{B}T\sum\limits_{j}{\left[ {A_{i},A_{j}}\right] \frac{{d}\mathcal{H}}{{dA_{j}}}}-\sum\limits_{j}{\lambda _{i,j}\left( A\right) \frac{d\mathcal{H}}{{dA_{j}}}+}\sum\limits_{j}{\frac{d{\lambda _{i,j}\left(A\right) }}{{dA_{j}}}}+\eta _{i}\left( t\right).$

The fluctuating force ${\displaystyle \eta _{i}\left(t\right)}$ obeys a Gaussian probability distribution with correlation function

$\left\langle {\eta _{i}\left( t\right) \eta _{j}\left( t^{\prime }\right) }\right\rangle =2\lambda _{i,j}\left( A\right) \delta \left( t-t^{\prime}\right).$

This implies the Onsager reciprocity relation ${\displaystyle \lambda _{i,j}=\lambda _{j,i}}$ for the damping coefficients $\lambda$. The dependence ${\displaystyle d\lambda _{i,j}/dA_{j}}$ of $\lambda$ on $A$ is negligible in most cases. The symbol ${\displaystyle {\mathcal {H}}=-ln\left(p_{0}\right)}$ denotes the Hamiltonian of the system, where ${\displaystyle p_{0}\left(A\right)}$ is the equilibrium probability distribution of the variables $A$. Finally, $[A_{i},A_{j}]$ is the projection of the Poisson bracket of the slow variables $A_{i}$ and $A_{j}$ onto the space of slow variables.

In the Brownian motion case one would have ${\displaystyle {\mathcal {H}}=\mathbf {p} ^{2}/\left(2mk_{B}T\right)}$, ${\displaystyle A=\{\mathbf {p} \}}$ or ${\displaystyle A=\{\mathbf {x} ,\mathbf {p} \}}$ and ${\displaystyle [x_{i},p_{j}]=\delta _{i,j}}$. The equation of motion ${\displaystyle d\mathbf {x} /dt=\mathbf {p} /m}$ for $\mathbf {x}$ is exact, there is no fluctuating force ${\displaystyle \eta _{x}}$ and no damping coefficient ${\displaystyle \lambda _{x,p}}$.

Examples

Phase portrait of a harmonic oscillator showing spreading due to the Langevin Equation.

Harmonic oscillator in a fluid

A non-ideal harmonic oscillator is affected by some form of damping, from which it follows via the fluctuation-dissipation theorem that there must be some fluctuations in the system. The diagram at right shows a phase portrait of the time evolution of the momentum, $p=mv$, vs. position, $r$ of a harmonic oscillator. Deterministic motion would follow along the ellipsoidal trajectories which cannot cross each other without changing energy. The presence of some form of damping, e.g. a molecular fluid environment (represented by diffusion and damping terms), continually adds and removes kinetic energy from the system, causing an initial ensemble of stochastic oscillators (dotted circles) to spread out, eventually reaching thermal equilibrium.

An electric circuit consisting of a resistor and a capacitor.

Thermal noise in an electrical resistor

There is a close analogy between the paradigmatic Brownian particle discussed above and Johnson noise, the electric voltage generated by thermal fluctuations in every resistor.^[6] The diagram at the right shows an electric circuit consisting of a resistance R and a capacitance C. The slow variable is the voltage U between the ends of the resistor. The Hamiltonian reads ${\displaystyle {\mathcal {H}}=E/k_{B}T=CU^{2}/(2k_{B}T)}$, and the Langevin equation becomes

$\frac{dU}{dt} =-\frac{U}{RC}+\eta \left( t\right),\;\; \left\langle \eta \left( t\right) \eta \left( t^{\prime }\right)\right\rangle = \frac{2k_{B}T}{RC^{2}}\delta \left(t-t^{\prime }\right).$

This equation may be used to determine the correlation function

$\left\langle U\left(t\right) U\left(t^{\prime }\right) \right\rangle =\left( k_{B}T/C\right) \exp \left( -\left\vert t-t^{\prime }\right\vert /RC\right) \approx 2Rk_{B}T\delta \left( t-t^{\prime }\right),$

which becomes a white noise (Johnson noise) when the capacitance C becomes negligibly small.

Critical dynamics

The dynamics of the order parameter $\varphi$ of a second order phase transition slows down near the critical point and can be described with a Langevin equation.^[4] The simplest case is the universality class "model A" with a non-conserved scalar order parameter, realized for instance in axial ferromagnets,

${\begin{aligned}{\frac {\partial \varphi \left({\mathbf {x}},t\right)}{\partial t}}&=-\lambda {\frac {\delta {\mathcal {H}}}{\delta \varphi }}+\eta \left({\mathbf {x}},t\right),\\{\mathcal {H}}&=\int d^{{d}}x\left\{{\frac {1}{2}}\varphi \left[r_{{0}}-\nabla ^{{2}}\right]\varphi +u\varphi ^{{4}}\right\},\\\left\langle \eta \left({\mathbf {x}},t\right)\eta \left({\mathbf {x}}',t'\right)\right\rangle &=2\lambda \delta \left({\mathbf {x}}-{\mathbf {x}}'\right)\delta \left(t-t'\right).\end{aligned}}$

Other universality classes (the nomenclature is "model A",..., "model J") contain a diffusing order parameter, order parameters with several components, other critical variables and/or contributions from Poisson brackets.^[4]

Recovering Boltzmann statistics

Langevin equations must reproduce the Boltzmann distribution. 1-dimensional overdamped Brownian motion is an instructive example. The overdamped case is realized when the inertia of the particle is negligible in comparison to the damping force. The trajectory $x(t)$ of the particle in a potential $V(x)$ is described by the Langevin equation

${\displaystyle \lambda {\frac {dx}{dt}}=-{\frac {\partial V(x)}{\partial x}}+\eta (t),}$

where the noise is characterized by ${\displaystyle \left\langle \eta (t)\eta (t')\right\rangle =2k_{B}T\lambda \delta (t-t')}$ and $\lambda$ is the damping constant. We would like to compute the distribution $p(x)$ of the particle's position in the course of time. A direct way to determine this distribution is to introduce a test function $f$, and to look at the average of this function over all realizations (ensemble average)

${\displaystyle \lambda {\frac {d\left\langle f(x(t))\right\rangle }{dt}}=\left\langle f'(x(t))\lambda {\frac {dx}{dt}}\right\rangle =\left\langle -f'(x(t)){\frac {\partial V}{\partial x}}+f'(x(t))\eta (t)\right\rangle .}$

If $x(t)$ remains finite then this quantity is null. Moreover, using the Stratonovich interpretation, we are able to get rid of the eta in the second term so that we end up with

${\displaystyle \left\langle -f'(x){\frac {\partial V}{\partial x}}+k_{B}Tf''(x)\right\rangle =0,}$

where we make use of the probability density function $p(x)$. This is done by explicitly computing the average,

${\displaystyle \int \left(-f'(x){\frac {\partial V}{\partial x}}p(x)+{k_{B}T}f''(x)p(x)\right)dx=\int \left(-f'(x){\frac {\partial V}{\partial x}}p(x)-{k_{B}T}f'(x)p'(x)\right)dx=0,}$

where the second term was integrated by parts (hence the negative sign). Since this is true for arbitrary functions $f$, we must have:

${\displaystyle {\frac {\partial V}{\partial x}}p(x)+{k_{B}T}p'(x)=0,}$

thus recovering the Boltzmann distribution

${\displaystyle p(x)\propto \exp \left({-{\frac {V(x)}{k_{B}T}}}\right).}$

Equivalent techniques

A solution of a Langevin equation for a particular realization of the fluctuating force is of no interest by itself, what is of interest are correlation functions of the slow variables after averaging over the fluctuating force. Such correlation functions also may be determined with other (equivalent) techniques.

Fokker Planck equation

A Fokker–Planck equation is a deterministic equation for the time dependent probability density ${\displaystyle P\left(A,t\right)}$ of stochastic variables $A$. The Fokker–Planck equation corresponding to the generic Langevin equation above may be derived with standard techniques (see for instance ref.^[7]),

$\frac{\partial P\left(A,t\right)}{\partial t}=\sum_{i,j}\frac{\partial}{\partial A_{i}}\left(-k_{B}T\left[A_{i},A_{j}\right]\frac{\partial\mathcal{H}}{\partial A_{j}}+\lambda_{i,j}\frac{\partial\mathcal{H}}{\partial A_{j}}+\lambda_{i,j}\frac{\partial}{\partial A_{j}}\right)P\left(A,t\right).$

The equilibrium distribution ${\displaystyle P(A)=p_{0}(A)=const\times \exp(-{\mathcal {H}})}$ is a stationary solution.

Path integral

A path integral equivalent to a Langevin equation may be obtained from the corresponding Fokker–Planck equation or by transforming the Gaussian probability distribution ${\displaystyle P^{(\eta )}(\eta )d\eta }$ of the fluctuating force $\eta$ to a probability distribution of the slow variables, schematically ${\displaystyle P(A)dA=P^{(\eta )}(\eta (A))\det(d\eta /dA)dA}$. The functional determinant and associated mathematical subtleties drop out if the Langevin equation is discretized in the natural (causal) way, where ${\displaystyle A(t+\Delta t)-A(t)}$ depends on $A(t)$ but not on ${\displaystyle A(t+\Delta t)}$. It turns out to be convenient to introduce auxiliary response variables ${\tilde {A}}$. The path integral equivalent to the generic Langevin equation then reads ^[8]

$\int P(A,{\tilde {A}})\,dA\,d{\tilde {A}}=N\int \exp \left(L(A,{\tilde {A}})\right)dA\,d{\tilde {A}},$

where $N$ is a normalization factor and

$L(A,{\tilde {A}})=\int \sum _{{i,j}}\left\{{\tilde {A}}_{{i}}\lambda _{{i,j}}{\tilde {A}}_{{j}}-\widetilde {A}_{{i}}\left\{\delta _{{i,j}}{\frac {dA_{{j}}}{dt}}-k_{{B}}T\left[A_{{i}},A_{{j}}\right]{\frac {d{\mathcal {H}}}{dA_{{j}}}}+\lambda _{{i,j}}{\frac {d{\mathcal {H}}}{dA_{{j}}}}-{\frac {d\lambda _{{i,j}}}{dA_{{j}}}}\right\}\right\}dt.$

The path integral formulation doesn't add anything new, but it does allow for the use of tools from quantum field theory; for example perturbation and renormalization group methods (if these make sense).

See also

• Langevin dynamics

References

1. Langevin, P. (1908). "Sur la théorie du mouvement brownien [On the Theory of Brownian Motion]". C. R. Acad. Sci. (Paris). 146: 530–533. ; reviewed by D. S. Lemons & A. Gythiel: Paul Langevin’s 1908 paper "On the Theory of Brownian Motion" [...], Am. J. Phys. 65, 1079 (1997), DOI:10.1119/1.18725
2. Kawasaki, K. (1973). "Simple derivations of generalized linear and nonlinear Langevin equations". J. Phys. A: Math. Nucl. Gen. 6: 1289. Bibcode:1973JPhA....6.1289K. doi:10.1088/0305-4470/6/9/004.
3. Dengler, R. (2015). "Another derivation of generalized Langevin equations". arXiv:1506.02650v2.
4. Hohenberg, P. C.; Halperin, B. I. (1977). "Theory of dynamic critical phenomena". Reviews of Modern Physics. 49 (3): 435–479. Bibcode:1977RvMP...49..435H. doi:10.1103/RevModPhys.49.435.
5. Zwanzig, R. (1961). "Memory effects in irreversible thermodynamics". Phys. Rev. 124 (4): 983–992. Bibcode:1961PhRv..124..983Z. doi:10.1103/PhysRev.124.983.
6. J. Johnson, "Thermal Agitation of Electricity in Conductors", Phys. Rev. 32, 97 (1928) – details of the experiment
7. Ichimaru, S. (1973), Basic Principles of Plasma Physics (1st. ed.), USA: Benjamin, p. 231, ISBN 0805387536
8. Janssen, H. K. (1976). "Lagrangean for Classical Field Dynamics and Renormalization Group Calculations of Dynamical Critical Properties". Z. Phys. B. 23: 377. Bibcode:1976ZPhyB..23..377J. doi:10.1007/BF01316547.

Further reading

• W. T. Coffey (Trinity College, Dublin, Ireland) and Yu P. Kalmykov (Université de Perpignan, France, The Langevin Equation: With Applications to Stochastic Problems in Physics, Chemistry and Electrical Engineering (Third edition), World Scientific Series in Contemporary Chemical Physics - Vol 27.
• Reif, F. Fundamentals of Statistical and Thermal Physics, McGraw Hill New York, 1965. See section 15.5 Langevin Equation
• R. Friedrich, J. Peinke and Ch. Renner. How to Quantify Deterministic and Random Influences on the Statistics of the Foreign Exchange Market, Phys. Rev. Lett. 84, 5224 - 5227 (2000)
• L.C.G. Rogers and D. Williams. Diffusions, Markov Processes, and Martingales, Cambridge Mathematical Library, Cambridge University Press, Cambridge, reprint of 2nd (1994) edition, 2000.