The Partition Function and the Helmholtz Free Energy

The Boltzmann distribution $p_i=e^{-\beta E_i}/Z$ requires a normalizing sum, $Z={\sum }_i{e}^{-\beta E_i}$, introduced in the previous lesson as a bookkeeping constant. That sum carries far more than a normalization. Every thermodynamic quantity of the system — its mean energy, entropy, pressure, and free energy — is a derivative of $\ln Z$. The partition function is the generating function of the canonical ensemble, and the single relation $F=-k_{B}T\ln Z$ ties it to the Helmholtz free energy, from which classical thermodynamics is recovered by differentiation.

The partition function as a sum over states

The name records what $Z$ does: it partitions unit probability among the microstates in the ratios of their Boltzmann factors.¹ At low temperature ($\beta \to \infty$) only the ground state contributes and $Z\to g_0$, the ground-state degeneracy. At high temperature ($\beta \to 0$) every factor approaches unity and $Z$ counts the accessible microstates. Between these limits $Z$ is a smooth, monotonically increasing function of $T$ that measures the effective number of thermally accessible states.

Mean energy from the partition function

The mean energy is the Boltzmann-weighted average $⟨E⟩={\sum }_i{p}_i{E}_i=Z^{-1}{\sum }_i{E}_i{e}^{-\beta E_i}$. The sum in the numerator is a derivative of $Z$: since $\partial e^{-\beta E_i}/\partial \beta =-E_i{e}^{-\beta E_i}$,

The internal energy $U=⟨E⟩$ is the logarithmic derivative of $Z$ with respect to $\beta$. In terms of temperature, using $\partial /\partial \beta =-k_B{T}^2\partial /\partial T$,

A single differentiation of $\ln Z$ has produced a full thermodynamic function without any counting of microstates beyond forming $Z$ itself.

The Helmholtz free energy

The link between $Z$ and thermodynamics is fixed by evaluating the Gibbs entropy on the canonical distribution. From $\ln p_i=-\beta E_i-\ln Z$,

Multiply through by $T$ and use $k_B\beta T=1$:

The left side is the definition of the Helmholtz free energy, $F=U-TS$. Hence the bridge equation of the canonical ensemble.²

This relation carries the canonical ensemble the way $S=k_B\ln \Omega$ carries the microcanonical one. There, entropy is the logarithm of a count at fixed energy; here, free energy is the logarithm of a weighted sum at fixed temperature. The two are Legendre transforms of one another: fixing $E$ versus fixing its conjugate $\beta$.

Thermodynamics by differentiation

The differential of the Helmholtz free energy is $\mathbf{d}F=-S\mathbf{d}T-P\mathbf{d}V+\mu \mathbf{d}N$, so its first partials return the entropy, pressure, and chemical potential directly.³ With $F=-k_{B}T\ln Z$,

The entropy expression reproduces $S=(U-F)/T$ obtained above, a check that the differentiation is consistent. The pressure formula has a direct microscopic reading: the energies $E_i(V)$ shift as the volume changes, and $P=-⟨\partial E_i/\partial V⟩$ is the ensemble-averaged force per unit area on the walls, which equals $k_{B}T\partial \ln Z/\partial V$. The internal energy re-emerges as $U=F+TS$, closing the set.

Factorization over independent degrees of freedom

When the energy splits into independent additive pieces, the partition function factorizes. Suppose the microstate is specified by two independent labels $a$ and $b$ with energy $E_{ab}={\epsilon }_a^{(a)}+{\epsilon }_b^{(b)}$. The double sum separates,

For $N$ identical independent subsystems whose states do not need to be distinguished from one another only by relabeling — for instance $N$ localized oscillators fixed to lattice sites, which are distinguishable by position — the partition function is the $N$-th power of the single-subsystem partition function,

The free energy is then extensive, proportional to $N$, as a thermodynamic potential must be. For $N$ identical particles free to occupy the same states — an ideal gas, where a permutation of labels is not a new microstate — the naive $z_1^N$ overcounts by the $N!$ permutations, and the correct counting inserts a factor $1/N!$; that correction and the extensivity it restores are the subject of the classical-gas module.⁴ Factorization reduces the many-body problem to a single-subsystem sum whenever the parts are independent, and it is the reason the oscillator and two-level results of the following lessons extend immediately to macroscopic solids and paramagnets.

Free energy as the minimized potential

At fixed temperature and volume the equilibrium of a system is the state that minimizes the Helmholtz free energy, and the canonical distribution realizes that minimum. Define the free-energy functional of an arbitrary distribution $\{p_i\}$,

Minimizing $F[\{p_i\}]$ over normalized distributions reproduces the Boltzmann weights $p_i=e^{-\beta E_i}/Z$, and the minimum value is $F=-k_{B}T\ln Z$. The functional expresses a competition: the energy term $⟨E⟩$ is lowered by concentrating probability in the lowest states, while the entropy term $-TS$ is lowered by spreading probability across many states. The balance point is temperature-dependent.⁵

• Low temperature. The factor $T$ multiplying $S$ is small, so $F\approx U$; minimizing $F$ minimizes the energy, and the system settles into its lowest-energy states. Order wins.
• High temperature. The entropy term dominates, so minimizing $F$ maximizes $S$; the system spreads over as many microstates as its energy permits. Disorder wins.

The next lesson returns to the fluctuations of the energy about $U$, which a second derivative of $\ln Z$ measures and which link the canonical ensemble back to the microcanonical one.

Summary

• The partition function $Z={\sum }_i{e}^{-\beta E_i}$ normalizes the Boltzmann distribution and generates the thermodynamics; it counts the ground-state degeneracy at low $T$ and the accessible microstates at high $T$.
• The mean energy is the first logarithmic derivative, $U=-\partial \ln Z/\partial \beta =k_B{T}^2(\partial \ln Z/\partial T{)}_V$.
• Evaluating the Gibbs entropy on the canonical distribution gives the bridge equation $F=-k_{B}T\ln Z$; then $S=-(\partial F/\partial T{)}_V$, $P=-(\partial F/\partial V{)}_T$, and $\mu =(\partial F/\partial N{)}_{T,V}$ recover all thermodynamics by differentiation.
• $Z$ factorizes over independent degrees of freedom: $Z=Z_a{Z}_b$ for independent parts and $Z=z_1^N$ for $N$ distinguishable identical subsystems, making $F$ extensive.
• At fixed $T$ and $V$ the equilibrium distribution minimizes the free-energy functional $⟨E⟩-TS$; the energy term controls it at low $T$, the entropy term at high $T$.