8.5: Jarzynski's Equality and Nonequilibrium Methods
- Page ID
- 5250
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)In this section, the relationship between work and free energy will be explored in greater detail. We have already introduced the inequality in Equation \ref{16}, which states that if an amount of work \(W_{\cal {A}\cal {B}}\) is performed on a system, taking from state \({\cal A} \) to state \({\cal B } \), then \(W_{\cal A\cal B}\geq A_{\cal A\cal B} \). Here, equality holds only if the work is performed reversibly. The work referred to here is thermodynamic quantity and, as such, must be regarded as an ensemble average. In statistical mechanics, we can also introduce the mechanical or microscopic work \( {\cal W}_{\cal A\cal B}({\rm x}) \) performed on one member of the ensemble to drive it from state \(\cal A \) to state \(\cal B \). Then, \(W_{\cal A\cal B}\) is simply an ensemble average of \( {\cal W}_{\cal A\cal B} \). However, we need to be somewhat careful about how we define this ensemble average because the work is defined along a particular path or trajectory which takes the system from state \(\cal A\) to state \(\cal B \), and equilibrium averages do not refer not to paths but to microstates. This distinction is emphasized by the fact that the work could be carried out irreversibly, such that the system is driven out of equilibrium. Thus, the proper definition of the ensemble average follows along the lines already discussed in the context of the free-energy perturbation approach, namely, averaging over the canonical distribution for the state \(\cal A \). In this case, since we will be discussing actual paths \( {\rm x_t} \), we let the initial condition \( {\rm x_0} \) be the phase space vector for the system in the (initial) state \(\cal A \). Recall that \(x_t = x_t (x_0) \) is a unique function of the initial conditions. Then
\[ \begin{align} W_{\cal A\cal B} &= \langle {\cal W}_{\cal A\cal B}(\rm x_0) \rangle _{\cal A} \\[4pt] &= {C_N \over Q_{\cal A} (N, V, T)} \int d \rm x_0 e^{-\beta H_{\cal A}({\rm x}_0)}{\cal W}_{\cal A\cal B}({\rm x}_0) \label{17} \end{align}\]
and the Clausius inequality can be stated as \( \langle {\cal W}_{\cal A\cal B}({\rm x}_0)\rangle_{\cal A}\geq A_{\cal A\cal B} \).
From such an inequality, it would seem that using the work as a method for calculating the free energy is of limited utility, since the work necessarily must be performed reversibly, otherwise one obtains only upper bound on the free energy. It turns out, however, that irreversible work can be used to calculate free energy differences by virtue of a connection between the two quantities first discovered in 1997 by C. Jarzynski that as come to be known as the Jarzynski equality. This equality states that if, instead of averaging \( {\cal W}_{\cal A\cal B}({\rm x}_0) \) over the initial canonical distribution (that of state \(\cal A\)), an average of \(\exp[-\beta{\cal W}_{\cal A\cal B}({\rm x}_0)] \) is performed over the same distribution, the result is \( \exp[-\beta A_{\cal A\cal B}] \), i.e.
\[ \begin{align} e^{-\beta A_{\cal A\cal B} } &= \langle e^{-\beta {\cal W}_{\cal A \cal B}(\rm x_0)} \rangle_{\cal A} \\[4pt] &= \dfrac{C_N}{Q_{\cal A} (N, V, T )} \int d \rm x_0 e^{-\beta H_{\cal A} (\rm x_0)} e^{-\beta {\cal W}_{\cal A\cal B} (\rm x_0)} \label{18} \end{align}\]
This remarkable result not only provides a foundation for the development of nonequilibrium free-energy methods but also has profound implications for thermodynamics, in general.
The Jarzynski equality be proved using different strategies. Here, however, we will present a proof that is most relevant for the finite-sized systems and techniques employed in molecular dynamics calculations. Consider a time-dependent Hamiltonian of the form
\[ H({\bf p},{\bf r},t) = \sum_{i=1}^N {{\bf p}_i^2 \over 2m_i} + U({\bf r}_1,...,{\bf r}_N,t) \label{19}\]
For time-dependent Hamiltonian's, the usual conservation law \(dH/dt=0 \) no longer holds, which can be seen by computing
\[ {dH \over dt} = \nabla_{{\rm x}_t}H\dot{{\rm x}_t} +{\partial H \over \partial t} \label{20}\]
where the phase space vector \( {\rm x}= ({\bf p}_1,...,{\bf p}_N,{\bf r}_1,...,{\bf r}_N)\equiv ({\bf p},{\bf r}) \) has been introduced. Integrating both sides over time from \( t = 0\) to a final time \(t = \tau \), we find
\[ \int_0^{\tau}\;dt\;{dH \over dt}= \int_0^{\tau}\;dt\;\nabla _{\rm x_t} H{\rm x}_t+ \int_0^{\tau}\;dt\;{\partial H \over \partial t} \label{21}\]
Equation \ref{21} can be regarded as a microscopic version of the first law of thermodynamics, in which the first and second terms represent the heat absorbed by the system and the work done on the system over the trajectory, respectively. Note that the work is actually a function of the initial phase-space vector \( {{\rm x}_0} \), which can be seen by writing this term explicitly as
\[ W_{\tau}({\rm x}_0) = \int_0^{\tau}\;dt\;{\partial \over \partial t}H({\rm x}_t({\rm x}_0),t) \label{22}\]
where the fact that the work depends explicitly on \(\tau\) in Equation \ref{22} is indicated by the subscript. In the present discussion, we will consider that each initial condition, selected from a canonical distribution in \( {\rm x _0 }\), evolves according to Hamilton's equations in isolation. In this case, the heat term \( \nabla_{{\rm x}_t}H\cdot{\rm x}_t = 0 \), and we have the usual addition to Hamilton's equations \( dH/dt = \partial H/\partial t \).
With the above condition, we can write the microscopic work as
\[ {\cal W}_{\cal A\cal B}= \int_0^{\tau} {d \over dt}H({\rm x}_t (\rm x_0) , t)dt =H({\rm x}_{\tau}({\rm x}_0),\tau) - H({\rm x}_0,0) \label{23}\]
The last term \( H({\rm x}_0,0) \) is also \( H_{\cal A}({\rm x}_0) \). Thus, the ensemble average of the exponential of the work becomes
\[\langle e^{-\beta {\cal W}_{\cal A\cal B}}\rangle_{\cal A} = { {C_N \over Q_{\cal A}(N,V,T)}\int\;d{\rm x}_0\;e^{-\beta H_{\cal A} (\rm x_0)}e^{-\beta [H({\rm x}_{\tau}({\rm x}_0),\tau)-H_{\cal A}({\rm x}_0)]}} \]
\[ {{C_N \over Q_{\cal A}(N,V,T)}\int\;d{\rm x}_0\;e^{-\beta H({\rm x}_{\tau}({\rm x}_0),\tau)} }\]
The numerator in this expression becomes much more interesting if we perform a change of variables from \( {\rm x_0}\) to \( {\rm x_{\tau}}\). Since the solution of Hamilton's equations for the time-dependent Hamiltonian uniquely map the initial condition \( {\rm x_0}\) onto \( {\rm x_t}\), when \(t = \tau \), we have a new set of phase-space variables, and by Liouville's theorem, the phase-space volume element is preserved
\[ d{\rm x}_{\tau} = d{\rm x}_0 \label{24}\]
When the Hamiltonian is transformed, we find \( H({\rm x}_{\tau},\tau) =H_{\cal B}({\rm x}_{\tau}) \). Consequently,
\[\begin{align} \langle e^{-\beta {\cal W}_{\cal A\cal B}} \rangle_{\cal A} &=\dfrac{C_N}{Q(N,V,T)} \int\;d{\rm x}_{\tau}\;e^{-\beta H_{\cal B} ({\rm x}_{\tau})} \\[4pt] &= \dfrac{Q_{\cal B}(N,V,T)}{Q_{\cal A}(N,V,T)} \\[4pt] &= e^{-\beta A_{\cal A\cal B}}\end{align}\]
thus proving the equality. The implication of the Jarzynski equality is that the work can be carried out along a reversible or irreversible path, and the correct free energy will still be obtained.
Note that due to Jensen's inequality:
\[ \langle e^{-\beta{\cal W}_{\cal A\cal B}} \rangle_{\cal A} \ge e^{-\beta \langle{\cal W}_{\cal A\cal B}\rangle_{\cal A}} \label{25}\]
Using Jarzynski's equality, this becomes
\[ e^{-\beta A_{\cal A\cal B}} \ge e^{-\beta \langle{\cal W}_{\cal A\cal B}\rangle_{\cal A}} \label{26}\]
which implies, as expected, that
\[ A_{\cal A\cal B}\leq \langle{\cal W}_{\cal A\cal B}\rangle_{\cal A} \label{27}\]