The Bolzano-Weierstrass theorem

Scope of the theorem and its limits

Moving to higher dimensions

In Rd\mathbb{R}^d, the theorem remains true, and is proved by successive extractions. Let (un)\left(u_n\right) be a bounded sequence in R2\mathbb{R}^2, with coordinates (xn,yn)\left(x_n, y_n\right).

The sequence (xn)(x_n) is bounded: we extract a convergent (xφ(n))\left(x_{\varphi(n)}\right) from it. The sequence (yφ(n))\left(y_{\varphi(n)}\right) is still bounded: we extract a convergent (yφ∘ψ(n))\left(y_{\varphi \circ \psi(n)}\right) from it. Since a subsequence of a convergent sequence converges to the same limit, the first coordinate still converges after this second extraction. The subsequence (uφ∘ψ(n))\left(u_{\varphi \circ \psi(n)}\right) therefore converges in R2\mathbb{R}^2.

The procedure is repeated dd times in dimension dd, and applies as is to C\mathbb{C}, viewed as R2\mathbb{R}^2.

The major theorems that follow from it

Result Role of Bolzano-Weierstrass
Extreme value theorem extract from a maximizing sequence
Heine's theorem extract from the two sequences of the negation
R\mathbb{R} is complete a bounded Cauchy sequence with a convergent subsequence converges
Heine-Borel theorem in Rd\mathbb{R}^d equivalence of the definitions of compactness

Take the first one. If ff is continuous on [a,b][a, b], consider M=sup⁡fM = \sup f — a priori in R∪{+∞}\mathbb{R} \cup \{+\infty\} — and a sequence (xn)(x_n) in [a,b][a, b] such that f(xn)→Mf(x_n) \to M. The sequence (xn)(x_n) is bounded, so we extract xφ(n)→cx_{\varphi(n)} \to c, with c∈[a,b]c \in [a, b] since the interval is closed. Continuity gives f(xφ(n))→f(c)f\left(x_{\varphi(n)}\right) \to f(c), hence M=f(c)M = f(c): the supremum is finite and attained.

Where the theorem stops

In infinite dimension, it fails. In the space ℓ2\ell^2 of square-summable sequences, consider the canonical basis (en)\left(e_n\right), where ene_n has a 11 in position nn and 00s elsewhere. This sequence is bounded, since ∥en∥=1\lVert e_n \rVert = 1 for all nn, and yet

∥en−em∥=2whenever n≠m\lVert e_n - e_m \rVert = \sqrt{2} \qquad \text{whenever } n \neq m

No subsequence is Cauchy, so none converges. This is the content of Riesz's theorem: the closed unit ball of a normed vector space is compact if and only if the space is finite-dimensional.

What the theorem says about R\mathbb{R}

Bolzano-Weierstrass is not a computational accident: it is equivalent to the least upper bound property, and hence to the very construction of R\mathbb{R}. In Q\mathbb{Q}, the statement is false — the sequence of decimal truncations of 2\sqrt{2} is bounded, and none of its subsequences converges to a rational number.

least upper bound  ⟺  nested intervals  ⟺  Bolzano-Weierstrass  ⟺  Cauchy sequences converge\text{least upper bound} \iff \text{nested intervals} \iff \text{Bolzano-Weierstrass} \iff \text{Cauchy sequences converge}

Classic pitfall

Concluding "the sequence converges" after applying the theorem. It only gives the existence of a convergent subsequence. To get back to the whole sequence, an additional argument is needed: uniqueness of the cluster point, monotonicity, or the Cauchy property.

Second pitfall: applying the theorem without checking that the sequence is bounded. For un=nu_n = n, no subsequence converges; for un=ncos⁡nu_n = n \cos n, which is unbounded, the theorem allows no conclusion.