Thermodynamic Fluctuations and Response Functions

Equilibrium thermodynamics assigns a single number to each state variable. The statistical description behind it assigns a distribution: the energy of a canonical system, the volume of a subsystem at fixed pressure, the magnetization of a paramagnet all fluctuate about their means from instant to instant. The mean is what thermodynamics reports; the variance is a separate, measurable quantity, and it is fixed by the same equilibrium data. The energy variance in the canonical ensemble already appeared as $⟨\Delta E^2⟩=k_B{T}^2{C}_V$, a static fluctuation equal to a thermal response. That identity is one case of a general theorem. This lesson derives the general result from Einstein's inversion of the Boltzmann entropy formula, tabulates the fluctuation–response identities, and follows them to the critical point, where the responses diverge and the fluctuations grow until they invalidate the thermodynamic description that produced them.

Einstein's inversion of the entropy formula

The Boltzmann relation $S=k_B\ln \Omega$ counts the microstates $\Omega$ consistent with a macrostate. Read forward it computes entropy from a count. Einstein read it backward: the number of microstates consistent with a value $x$ of some internal variable is $\Omega (x)=e^{S(x)/k_B}$, and since every microstate of an isolated system is equally probable, the probability of observing the value $x$ is proportional to that count.¹

The entropy is maximal at the equilibrium value $\bar{x}$, so $S^{\prime }(\bar{x})=0$ and $S^{\prime \prime }(\bar{x})<0$. Expanding to second order in the fluctuation $\Delta x=x-\bar{x}$,

turns the probability into a Gaussian,

The variance of a fluctuation is $k_B$ divided by the curvature of the entropy at its maximum. A stiff entropy maximum (large curvature) suppresses fluctuations; a flat one permits large ones. The sign works out because stability requires the maximum, $S^{\prime \prime }<0$, so $⟨\Delta x^2⟩>0$. The whole of Gaussian fluctuation theory is the systematic evaluation of that curvature for each choice of $x$.

Fluctuations of a subsystem at fixed temperature and pressure

Most systems of interest are not isolated but held at a fixed temperature $T_0$ and pressure $P_0$ by a large medium. The isolated-system formula still applies if $x$ is a variable of the small subsystem, provided $S(x)$ is the total entropy of subsystem plus medium. The change in total entropy when the subsystem fluctuates away from equilibrium is $-R_{\min }/T_0$, where $R_{\min }$ is the minimum work that an external agent would have to supply to produce that fluctuation reversibly. For a fluctuation at fixed $T_0,P_0$,²

with $\Delta E,\Delta S,\Delta V$ the changes in the subsystem's own energy, entropy, and volume. Expanding to second order in the subsystem's independent variations, the first-order terms cancel against the equilibrium conditions $T=T_0$, $P=P_0$, leaving a quadratic form. The compact result is

so the fluctuation probability is

Here $\Delta T,\Delta S,\Delta P,\Delta V$ are the deviations of the subsystem's temperature, entropy, pressure, and volume from their equilibrium values; only two of the four are independent. The quadratic form is diagonalized by choosing the right pair.

Because the quadratic form is diagonal, temperature and volume fluctuations are statistically independent: $⟨\Delta T\Delta V⟩=0$. Reading off the two variances,

where ${\kappa }_T=-V^{-1}(\partial V/\partial P{)}_T$ is the isothermal compressibility. The temperature fluctuation is inversely proportional to the heat capacity, the volume fluctuation directly proportional to the compressibility. Both variances are manifestly positive because stability forces $C_V>0$ and ${\kappa }_T>0$; the same inequalities that guarantee a stable equilibrium guarantee real fluctuations about it.

The conjugate choice, $(S,P)$ as the independent pair, diagonalizes the same form the other way and gives

The four variances of $(\Delta T,\Delta V,\Delta S,\Delta P)$ are set by the four response functions $C_V$, ${\kappa }_T$, $C_P$, ${\kappa }_S$. A cross-correlation that does not vanish is $⟨\Delta T\Delta S⟩=k_{B}T$, obtained directly from the diagonal form; it restates $⟨\Delta E^2⟩=k_B{T}^2{C}_V$ once $\Delta E$ is expressed through $\Delta S$ and $\Delta V$.

The fluctuation–response identities

Each extensive variable pairs with an intensive conjugate field through the energy, and the variance of the extensive variable equals $k_{B}T$ times its response to that field. The pattern is uniform across the ensembles.

• Energy and temperature. In the canonical ensemble $⟨\Delta E^2⟩=k_B{T}^2{C}_V$, derived from ${\partial }^2\ln Z/\partial {\beta }^2$. The spread of the energy is the heat capacity.
• Volume/number and pressure. For a subsystem at fixed pressure $⟨\Delta V^2⟩=k_{B}TV{\kappa }_T$; equivalently, in the grand ensemble the particle number obeys $⟨\Delta N^2⟩=k_{B}T(\partial N/\partial \mu {)}_{T,V}=k_{B}T{N}^2{\kappa }_T/V$. Density fluctuations are the compressibility.
• Magnetization and field. For a magnet in a field $H$, $⟨\Delta M^2⟩=k_{B}T(\partial M/\partial H{)}_T=k_{B}T{\chi }_T$. The spread of the magnetization is the isothermal susceptibility.

The proof is one differentiation. Adding a field term $-fA$ to the Hamiltonian shifts every Boltzmann weight by $e^{\beta fA}$, so the partition function generates the moments of $A$: $⟨A⟩={\beta }^{-1}\partial \ln Z/\partial f$ and $\partial ⟨A⟩/\partial f=\beta (⟨A^2⟩-⟨A{⟩}^2)$. The identity is the statement that the first derivative of the mean (the response) and the second cumulant (the variance) come from consecutive derivatives of the same $\ln Z$. The response function is a susceptibility measured by applying a field; the variance is a fluctuation measured with no field applied. That they are equal means an equilibrium fluctuation predicts a nonequilibrium response, the seed of the fluctuation–dissipation theorem in its full dynamical form.

Relative fluctuations and the thermodynamic limit

Every extensive variance is itself extensive: $⟨\Delta A^2⟩\sim N$ because both $⟨A⟩$ and the response are proportional to $N$. The root-mean-square fluctuation therefore grows as $\sqrt{N}$, while the mean grows as $N$, so the relative fluctuation shrinks:

For a macroscopic sample with $N\sim 10^{23}$ this is of order $10^{-12}$, and the distinction between a fluctuating variable and a sharp one is undetectable. The sharpness of thermodynamic quantities is the $1/\sqrt{N}$ law, and it is what lets equilibrium thermodynamics report single numbers rather than distributions. The law rests on two assumptions: that the response functions are finite, and that correlations extend over a microscopic range so that $N$ independent regions each fluctuate on their own. Both fail at a critical point.

Critical divergence and critical opalescence

The volume and density fluctuations are proportional to the isothermal compressibility ${\kappa }_T$. Along a liquid–gas coexistence curve ${\kappa }_T$ grows as the critical point is approached, and at the critical point the isotherm has a horizontal inflection, $(\partial P/\partial V{)}_T=0$, so ${\kappa }_T\to \infty$. The density variance diverges with it:

A diverging variance means the Gaussian theory itself breaks down — the quadratic expansion of the entropy loses its leading term — but the approach to the divergence is physical. As ${\kappa }_T$ grows, density fluctuations become correlated over a length $\xi$, the correlation length, which diverges as $\xi \sim |T-T_c{|}^{-\nu }$. When $\xi$ reaches the wavelength of visible light, the fluid scatters light strongly and turns milky. This is critical opalescence: a transparent fluid at its critical point becomes cloudy because density fluctuations on the scale of hundreds of nanometres refract light in every direction.³ The scattering intensity is proportional to the structure factor, which by the fluctuation identity is proportional to ${\kappa }_T$, so the opalescence is a direct optical readout of the diverging compressibility.

The limits of the thermodynamic description

Away from criticality the relative fluctuation of an extensive variable is $O(N^{-1/2})$, and thermodynamics is exact in the limit $N\to \infty$. Near a continuous transition the argument fails in a specific way. The independent fluctuating regions have volume ${\xi }^d$ in $d$ dimensions, so the effective number of independent regions in a sample of volume $V$ is $V/{\xi }^d$, not $N$. As $\xi \to \infty$ this number falls toward one, and the relative fluctuation within a correlation volume approaches unity. The order parameter is then not sharp, and the mean-field (Gaussian) treatment of its fluctuations becomes self-inconsistent. The condition that fluctuations remain small compared with the mean order parameter is the Ginzburg criterion, and where it is violated the critical exponents are no longer those of Gaussian theory. This is the quantitative reason the mean-field exponents of Landau theory disagree with experiment below the upper critical dimension: fluctuations, small everywhere else, dominate the critical region.

Summary

• Einstein's inversion of $S=k_B\ln \Omega$ gives the fluctuation probability $w\propto e^{S/k_B}$; expanding the entropy about its maximum yields a Gaussian with $⟨\Delta x^2⟩=-k_B/({\partial }^{2}S/\partial x^2)$ — the variance is $k_B$ over the entropy curvature.
• For a subsystem at fixed $T,P$ the probability is $w\propto \exp [-(\Delta T\Delta S-\Delta P\Delta V)/2k_{B}T]$; choosing $(T,V)$ as independent variables diagonalizes it, giving $⟨(\Delta T{)}^2⟩=k_B{T}^2/C_V$ and $⟨(\Delta V{)}^2⟩=k_{B}TV{\kappa }_T$ with $⟨\Delta T\Delta V⟩=0$.
• The fluctuation–response identities $⟨\Delta E^2⟩=k_B{T}^2{C}_V$, $⟨\Delta V^2⟩=k_{B}TV{\kappa }_T$, $⟨\Delta N^2⟩=k_{B}T{N}^2{\kappa }_T/V$, $⟨\Delta M^2⟩=k_{B}T{\chi }_T$ all follow from $⟨\Delta A^2⟩=k_{B}T(\partial ⟨A⟩/\partial f{)}_T$: an equilibrium variance equals $k_{B}T$ times a static susceptibility.
• Relative fluctuations scale as $1/\sqrt{N}$ and are negligible for macroscopic samples, which is why thermodynamic variables are effectively sharp.
• At a critical point the responses diverge, so the variances diverge; the correlation length grows to the scale of visible light (critical opalescence), and the Ginzburg criterion marks where fluctuations invalidate the mean-field description.