Kruskal's tree theorem

Imagine a theorem so fundamental in mathematics that it reveals deep truths about what can and cannot be proven, while also giving rise to numbers so mind-bogglingly vast they dwarf almost every other large number you've ever heard of. Kruskal's tree theorem is one such profound result, establishing a surprising order within infinite sequences of tree structures. Join us as we explore how this abstract concept leads to the utterly massive TREE function and challenges the very limits of mathematical proof. Kruskal's tree theorem guarantees that any infinite sequence of finite trees will always contain two trees where one can be 'embedded' into the other, a property known as 'well-quasi-ordering.' This theorem has profound implications for the foundations of mathematics, demonstrating statements that require stronger logical systems to prove than might intuitively be expected. A direct application of the theorem leads to the TREE function, which generates numbers so incredibly large that TREE(3) is famously far greater than numbers like Graham's number or a googolplex.

Source: Wikipedia

AI Summary

Imagine a theorem so fundamental in mathematics that it reveals deep truths about what can and cannot be proven, while also giving rise to numbers so mind-bogglingly vast they dwarf almost every other large number you've ever heard of. Kruskal's tree theorem is one such profound result, establishing a surprising order within infinite sequences of tree structures. Join us as we explore how this abstract concept leads to the utterly massive TREE function and challenges the very limits of mathematical proof.

Order in the Forest

At its heart, Kruskal's tree theorem is a statement about order — specifically, about an ordering property called 'well-quasi-ordering.' It tells us that if you have an infinite collection of finite trees, eventually you'll find one tree that can be 'embedded' into a later tree in the sequence.

Think of it like this: no matter how you try to construct an infinitely growing sequence of distinct tree shapes, the theorem guarantees that one must eventually resemble an earlier one, not perfectly, but in a specific structural way. This seemingly abstract idea has surprisingly concrete and astonishing consequences.

The Birth of Giants: The TREE Function

One of the most famous and staggering applications of Kruskal's tree theorem is the existence of the 'TREE' function. While the theorem itself isn't immediately obvious, its finite applications lead to numbers so unfathomably huge that they make even a googolplex — that's a 1 followed by 100 zeros — seem utterly insignificant.

The number TREE(3), derived from this theorem, is widely considered one of the largest truly finite numbers ever defined in a simple way. It's so big, it completely eclipses other famous 'large numbers' like Graham's number, pushing the boundaries of what our minds can even begin to comprehend.

A Brief History of a Profound Result

The journey of Kruskal's tree theorem began with a conjecture by Andrew Vázsonyi. It was then first rigorously proven by Joseph Kruskal in 1960. Later, in 1963, Crispin Nash-Williams provided a much shorter and more elegant proof, solidifying its place in mathematical literature.

Beyond its initial proofs, the theorem became a cornerstone in the field of 'reverse mathematics.' This area of study asks: what specific logical axioms are necessary to prove a given theorem? Kruskal's theorem turned out to be remarkably 'strong' in this context, requiring more powerful axioms than many other fundamental results.

Generalizing the Idea

The core idea behind Kruskal's theorem proved so robust that it was later generalized from trees to more complex structures called 'graphs.' This led to the monumental Robertson–Seymour theorem in 2004, a result that itself comprises hundreds of pages of proof!

Just as Kruskal's theorem leads to the TREE function, the Robertson–Seymour theorem gives rise to an even faster-growing sequence known as the SSCG function. If TREE(3) blows our minds, SSCG(3) is... well, words simply fail to describe its scale.

Understanding the Theorem: The Basics of Trees

To grasp Kruskal's theorem, we first need to understand what kind of 'trees' it's talking about. In mathematics, a tree is a graph where any two vertices are connected by exactly one path. For this theorem, we consider 'finite rooted trees' — meaning they have a designated 'root' vertex, and every other vertex branches off from it.

Vertices in a rooted tree have a clear hierarchy. We call 'w' a 'successor' of 'v' if 'v' is on the unique path from the root to 'w'. If there are no other vertices between them on that path, 'w' is an 'immediate successor' — essentially a direct child.

What Does 'Embedding' Mean?

The crucial concept is 'inf-embeddability' — a specific type of homeomorphic embedding. Given two rooted trees, T1 and T2, both with labels from some partially ordered set X, we say T1 is inf-embeddable in T2 if we can find an injective map (a one-to-one correspondence) from T1's vertices to T2's vertices that preserves both the labeling and the successor relationships.

Intuitively, this means you can 'find' a structurally similar copy of T1 inside T2, respecting the labels and the branching patterns. It's like finding a miniature version of one tree hidden within the branches of a larger one, but without having to cut or rearrange any connections.

T_{1} \leq T_{2}

The Core Statement

Kruskal's theorem then states: If the set of labels 'X' is 'well-quasi-ordered' (meaning any infinite sequence of elements from X contains an increasing pair), then the set of all finite rooted trees labeled in X is also well-quasi-ordered under this inf-embeddable order.

This means that if you take any infinite sequence of such trees — T1, T2, T3, and so on — there must exist some earlier tree Ti and a later tree Tj (where i is less than j) such that Ti can be inf-embedded into Tj. It's a guarantee of order, a structural inevitability in the face of infinite possibilities.

This is the mathematical essence of the theorem, stating that within any endless procession of trees, an embedding relationship will eventually manifest.

T_{i} \leq T_{j}

Friedman's Surprising Discoveries

In the early 1980s, mathematician Harvey Friedman made groundbreaking observations about Kruskal's theorem using 'second-order arithmetic.' He showed that while the theorem can be expressed in this powerful system, certain simplified versions of it actually cannot be proven in weaker, though still significant, logical frameworks.

The Limits of Proof

Friedman discovered that even in the seemingly simple case of unlabeled trees (where X has only one element), Kruskal's theorem is unprovable within a system called ATR0. This was a monumental finding, as it provided one of the first examples of a mathematically 'predicative' result (one that doesn't rely on self-referential definitions) that nonetheless required 'impredicative' (more powerful) proofs.

This insight highlighted a fundamental limitation of certain logical systems and opened new avenues in reverse mathematics. It meant that to prove Kruskal's theorem in its full generality, you need specific, stronger foundational axioms than you might expect for such an apparently combinatorial statement.

Later, Friedman even found variations of the theorem that couldn't be proven in even stronger systems, revealing ever deeper layers of its logical complexity. The Robertson–Seymour theorem, the generalization to graphs, similarly falls into this category of 'unprovable in X' results.

Ordinal Analysis: Measuring Strength

The 'strength' of Kruskal's theorem has been precisely quantified through a technique called 'ordinal analysis.' This method assigns an 'ordinal number' to a mathematical theory, reflecting its proof-theoretic power. For Kruskal's theorem, this ordinal is the 'small Veblen ordinal' — a number that itself is incomprehensibly vast, indicating the theorem's immense logical heft.

The Weak Tree Function: A Prelude to Immensity

Before diving into the full power of the TREE function, let's consider a slightly simpler, 'weak' version. Imagine P(n) as the statement that for any 'n', there exists a finite sequence of n unlabeled trees, T1, T2, ..., Tm, where no Ti can be embedded into any later Tj in the sequence.

Kruskal's theorem, combined with another result called Kőnig's lemma, implies that all such statements P(n) are true. However, here's the kicker: while Peano arithmetic — the standard axiomatic system for natural numbers — can prove P(n) for any specific value of n, it cannot prove the general statement 'P(n) is true for all n'.

What's more, the length of the shortest proof for P(n) within Peano arithmetic grows at an utterly phenomenal rate as n increases. This growth far outstrips any 'primitive recursive function' or even the famous Ackermann function, hinting at the truly explosive nature of the functions to come.

The Indescribable TREE Function

Now, let's unleash the full power of the Kruskal's tree theorem's finitary applications with the labeled TREE function, defined by Harvey Friedman. For any positive integer 'n', TREE(n) is defined as the largest possible number 'm' such that you can create a sequence of 'm' rooted trees, where each tree is labeled with up to 'n' distinct labels, and no tree in the sequence can be embedded into any later tree in the sequence.

This function measures the maximum length of a 'Kruskal sequence' of trees under a specific labeling constraint. It's the ultimate test of how long you can avoid an embedding relationship.

TREE(1), TREE(2)... and the Unspeakable TREE(3)

The sequence of TREE values begins deceptively small. TREE(1) is simply 1. TREE(2) is 3. These seem innocuous, right? But then, something truly extraordinary happens with TREE(3).

TREE(3) explodes to a value so colossal, it cannot be written out in any meaningful way, nor can its sheer scale be easily grasped. To put it in perspective, many other 'large numbers' that are celebrated for their size — numbers like Graham's number, which itself is far larger than a googolplex — are, by comparison, astronomically tiny.

Graham's number, for instance, is a paltry speck compared to even the lower bounds established for TREE(3). This makes TREE(3) a true titan among finite numbers, a testament to the profound and often counter-intuitive power hidden within abstract mathematical theorems like Kruskal's tree theorem.

Article

Kruskal's tree theorem

In mathematics, Kruskal's tree theorem states that the set of finite trees over a well-quasi-ordered set of labels is itself well-quasi-ordered under homeomorphic embedding.

A finitary application of the theorem gives the existence of a fast-growing TREE function. TREE(3) is one of the largest simply defined finite numbers, dwarfing other large numbers such as Graham's number and googolplex.

History

Kruskal's tree theorem

The theorem was conjectured by Andrew Vázsonyi and proved by Joseph Kruskal ((/wiki/Kruskal'streetheorem#CITEREFKruskal1960)); a short proof was given by Crispin Nash-Williams ((/wiki/Kruskal'streetheorem#CITEREFNash-Williams1963)). It has since become a prominent example in reverse mathematics as a statement that cannot be proved in ATR0 (a second-order arithmetic theory with a form of arithmetical transfinite recursion).

In 2004, the result was generalized from trees to graphs as the Robertson–Seymour theorem, a result that has also proved important in reverse mathematics and leads to the even-faster-growing SSCG function, which dwarfs TREE.

Statement

Kruskal's tree theorem

The version given here is that proven by Nash-Williams; Kruskal's formulation is somewhat stronger. All trees we consider are finite.

Given a tree ${\displaystyle T}$ with a root, and given vertices ${\displaystyle v}$, ${\displaystyle w}$, call ${\displaystyle w}$ a descendant of ${\displaystyle v}$ if the unique path from the root to ${\displaystyle w}$ contains ${\displaystyle v}$, and call ${\displaystyle w}$ a child of ${\displaystyle v}$ if additionally the path from ${\displaystyle v}$ to ${\displaystyle w}$ contains no other vertex.

Take ${\displaystyle (X,\leq {X})}$ to be a partially ordered set. If ${\displaystyle T{1}}$, ${\displaystyle T{2}}$ are rooted trees with vertices labeled in ${\displaystyle X}$, we say that ${\displaystyle T{1}}$ is inf-embeddable in ${\displaystyle T{2}}$ and write ${\displaystyle T{1}\leq T{2}}$ if there is an injective map ${\displaystyle F}$ from the vertices of ${\displaystyle T{1}}$ to the vertices of ${\displaystyle T{2}}$ such that:

• For all vertices ${\displaystyle v}$ of ${\displaystyle T{1}}$, the label of ${\displaystyle v}$ is ${\displaystyle \leq {X}}$ the label of ${\displaystyle F(v)}$; • If ${\displaystyle w}$ is any descendant of ${\displaystyle v}$ in ${\displaystyle T{1}}$, then ${\displaystyle F(w)}$ is a descendant of ${\displaystyle F(v)}$; and • If ${\displaystyle w{1}}$, ${\displaystyle w{2}}$ are any two distinct children of ${\displaystyle v}$, then the path from ${\displaystyle F(w{1})}$ to ${\displaystyle F(w{2})}$ in ${\displaystyle T{2}}$ contains ${\displaystyle F(v)}$ (equivalently, ${\displaystyle F(w{1})}$ and ${\displaystyle F(w{2})}$ lie in different subtrees.)

If ${\displaystyle X}$ is well-quasi-ordered, then the set of rooted trees with labels in ${\displaystyle X}$ is well-quasi-ordered under the inf-embeddable order defined above. (That is to say, given any infinite sequence ${\displaystyle T{1},T{2},\ldots }$ of rooted trees labeled in ${\displaystyle X}$, there is some ${\displaystyle i<j}$ so that ${\displaystyle T{i}\leq T{j}}$.)

Friedman's work

Kruskal's tree theorem

For a countable label set ${\displaystyle X}$, Kruskal's tree theorem can be expressed and proven using second-order arithmetic. However, like Goodstein's theorem or the Paris–Harrington theorem, some special cases and variants of the theorem can be expressed in subsystems of second-order arithmetic much weaker than the subsystems where they can be proved. This was first observed by Harvey Friedman in the early 1980s, an early success of the then-nascent field of reverse mathematics. In the case where the trees above are taken to be unlabeled (that is, in the case where ${\displaystyle X}$ has size one), Friedman found that the result was unprovable in ATR0, thus giving the first example of a predicative result with a provably impredicative proof. This case of the theorem is still provable by Π1 1-CA0, but by adding a "gap condition" to the definition of the order on trees above, he found a natural variation of the theorem unprovable in this system. Much later, the Robertson–Seymour theorem would give another theorem unprovable by Π1 1-CA0.

Ordinal analysis confirms the strength of Kruskal's theorem, with the proof-theoretic ordinal of the theorem equaling the small Veblen ordinal (sometimes confused with the smaller Ackermann ordinal).

Weak tree function

Kruskal's tree theorem

Suppose that ${\displaystyle P(n)}$ is the statement:

There is some ${\displaystyle m}$ such that if ${\displaystyle T{1},\ldots ,T{m}}$ is a finite sequence of unlabeled rooted trees where ${\displaystyle T{i}}$ has ${\displaystyle i+n}$ vertices, then ${\displaystyle T{i}\leq T{j}}$ for some ${\displaystyle i<j}$.

All the statements ${\displaystyle P(n)}$ are true as a consequence of Kruskal's theorem and Kőnig's lemma. For each ${\displaystyle n}$, Peano arithmetic can prove that ${\displaystyle P(n)}$ is true, but Peano arithmetic cannot prove the statement "${\displaystyle P(n)}$ is true for all ${\displaystyle n}$". Moreover, the length of the shortest proof of ${\displaystyle P(n)}$ in Peano arithmetic grows phenomenally fast as a function of ${\displaystyle n}$, far faster than any primitive recursive function or the Ackermann function, for example. The least ${\displaystyle m}$ for which ${\displaystyle P(n)}$ holds similarly grows extremely quickly with ${\displaystyle n}$.

Friedman defined the following function, which is a weaker version of the TREE function below. For a positive integer ${\displaystyle n}$, take ${\displaystyle {\text{FFF}}(n)}$ to be the largest ${\displaystyle m}$ so that we have the following:

There is a sequence ${\displaystyle T{1},\ldots ,T{m}}$ of rooted trees, where each ${\displaystyle T{i}}$ has ${\displaystyle i+n-1}$ vertices, such that ${\displaystyle T{i}\leq T{j}}$ does not hold for any ${\displaystyle i<j\leq m}$.

Friedman computes the first few terms of this sequence as ${\displaystyle {\text{FFF}}(1)=1}$, ${\displaystyle {\text{FFF}}(2)=2}$, and ${\displaystyle {\text{FFF}}(3)=5}$. He also estimates ${\displaystyle {\text{FFF}}(4)}$ to be less than 100, while ${\displaystyle {\text{FFF}}(5)}$ suddenly explodes to a very large value. Any proof that ${\displaystyle {\text{FFF}}(5)}$ exists in Peano arithmetic requires at least ${\displaystyle A(10)}$ symbols, where ${\displaystyle A(n)}$ is the unary version of the Ackermann function, but it can be proved to exist in ACA0 with at most 10,000 symbols.

TREE function

Kruskal's tree theorem

A sequence of rooted trees labelled from a set of 3 labels (blue < red < green). The ${\displaystyle n}$th tree in the sequence contains at most ${\displaystyle n}$ vertices, and no tree is inf-embeddable within any later tree in the sequence. ${\displaystyle {\text{TREE}}(3)}$ is defined to be the longest possible length of such a sequence.

By incorporating labels, Friedman defined a far faster-growing function. For a positive integer ${\displaystyle n}$, take ${\displaystyle {\text{TREE}}(n)}$[a] to be the largest ${\displaystyle m}$ so that we have the following:

There is a sequence ${\displaystyle T{1},\ldots ,T{m}}$ of rooted trees labelled from a set of ${\displaystyle n}$ labels, where each ${\displaystyle T{i}}$ has at most ${\displaystyle i}$ vertices, such that ${\displaystyle T{i}\leq T{j}}$ does not hold for any ${\displaystyle i<j\leq m}$.

Kruskal's theorem asserts that ${\displaystyle {\text{TREE}}(n)}$ is finite for all ${\displaystyle n}$. The TREE function eventually dominates every provably recursive function of the system ACA0 + Π1 2-BI.

The sequence begins ${\displaystyle {\text{TREE}}(1)=1}$, ${\displaystyle {\text{TREE}}(2)=3}$; before ${\displaystyle {\text{TREE}}(3)}$ suddenly explodes to a value so large that many other "large" combinatorial constants, such as Friedman's ${\displaystyle n(4)}$ and Graham's number,[b] are extremely small by comparison. A lower bound for ${\displaystyle n(4)}$, and, hence, an extremely weak lower bound for ${\displaystyle {\text{TREE}}(3)}$, is ${\displaystyle A^{A(187196)}(1)}$[c], where ${\displaystyle A(x)}$ is the single-argument version of Ackermann's function, defined as ${\displaystyle A(x)=A(x,x)}$.

Friedman showed that ${\displaystyle {\text{TREE}}(3)}$ is greater than the halting time of any Turing machine that can be proved to halt in ACA0 + Π1 2-BI with at most ${\displaystyle 2\uparrow \uparrow 1000}$[d] symbols, where ${\displaystyle \uparrow \uparrow }$ denotes tetration.