<?xml version="1.0" encoding="UTF-8" standalone="yes"?><oembed><version><![CDATA[1.0]]></version><provider_name><![CDATA[Azimuth]]></provider_name><provider_url><![CDATA[https://johncarlosbaez.wordpress.com]]></provider_url><author_name><![CDATA[John Baez]]></author_name><author_url><![CDATA[https://johncarlosbaez.wordpress.com/author/johncarlosbaez/]]></author_url><title><![CDATA[Insanely Long Proofs]]></title><type><![CDATA[link]]></type><html><![CDATA[<p>&nbsp;</p>
<div align="center"><a href="http://math.ucr.edu/home/baez/mathematical/huge_blackboard.jpg"><img src="https://i2.wp.com/math.ucr.edu/home/baez/mathematical/huge_blackboard_small.jpg" /></a></div>
<p>There are theorems whose shortest proof is insanely long.  In 1936 Kurt Gödel published an abstract called “On the length of proofs”, which makes essentially this claim.</p>
<p>But what does &#8216;insanely long&#8217; mean?   </p>
<p>To get warmed up, let&#8217;s talk about some long proofs.  </p>
<h3> Long proofs </h3>
<p>You&#8217;ve surely heard of the quadratic formula, which lets you solve</p>
<p><img src='https://s0.wp.com/latex.php?latex=a+x%5E2+%2B+b+x+%2B+c++%3D+0+&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='a x^2 + b x + c  = 0 ' title='a x^2 + b x + c  = 0 ' class='latex' /></p>
<p>with the help of a square root:</p>
<p><img src='https://s0.wp.com/latex.php?latex=%5Cdisplaystyle%7B+x+%3D+%5Cfrac%7B-b+%5Cpm+%5Csqrt%7Bb%5E2+-+4+a+c%7D%7D%7B2+a%7D+%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='&#92;displaystyle{ x = &#92;frac{-b &#92;pm &#92;sqrt{b^2 - 4 a c}}{2 a} }' title='&#92;displaystyle{ x = &#92;frac{-b &#92;pm &#92;sqrt{b^2 - 4 a c}}{2 a} }' class='latex' /></p>
<p>There&#8217;s a similar but more complicated <a href="http://en.wikipedia.org/wiki/Cubic_function#General_formula_of_roots">&#8216;cubic formula&#8217;</a> that lets you solve cubic equations, like this:</p>
<p><img src='https://s0.wp.com/latex.php?latex=a+x%5E3+%2B+b+x%5E2+%2B+c+x+%2B+d+%3D+0+&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='a x^3 + b x^2 + c x + d = 0 ' title='a x^3 + b x^2 + c x + d = 0 ' class='latex' /></p>
<p>The cubic formula involves both square roots and cube roots.  There&#8217;s also a <a href="http://planetmath.org/QuarticFormula.html">&#8216;quartic formula&#8217;</a> for equations of degree 4, like this:</p>
<p><img src='https://s0.wp.com/latex.php?latex=a+x%5E4+%2B+b+x%5E3+%2B+c+x%5E2+%2B+d+x+%2B+e+%3D+0+&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='a x^4 + b x^3 + c x^2 + d x + e = 0 ' title='a x^4 + b x^3 + c x^2 + d x + e = 0 ' class='latex' /></p>
<p>The quartic formula is so long that I can only show it to you if I shrink it by an absurd amount:</p>
<div align="center">
<a href="http://images.planetmath.org/cache/objects/1525/l2h/img5.png"><img width="450" src="https://i0.wp.com/images.planetmath.org/cache/objects/1525/l2h/img5.png" /></a></div>
<p>(Click repeatedly to enlarge.)  But again, it only involves additions, subtraction, multiplication, division and taking roots.</p>
<p>In 1799, Paolo Ruffini proved that there was no general solution using radicals for polynomial equations of degree 5 or more.  But his proof was 500 pages long!  As a result, it was <a href="http://en.wikipedia.org/wiki/Abel%E2%80%93Ruffini_theorem#History">&#8220;mostly ignored&#8221;</a>.  I&#8217;m not sure what that means, exactly.  Did most people ignore it completely?  Or did everyone ignore most of it?   Anyway, his argument seems to have a gap&#8230; and later Niels Abel gave a proof that was just 6 pages long, so most people give the lion&#8217;s share of credit to Abel.</p>
<p>Jumping ahead quite a lot, the longest proof written up in journals is the <a href="http://en.wikipedia.org/wiki/Classification_of_finite_simple_groups">classification of finite simple groups</a>.  This was done by lots of people in lots of papers, and the total length is somewhere between 10,000 and 20,000 pages&#8230; nobody is exactly sure!  People are trying to simplify it and rewrite it.  The new proof will be a mere 5,000 pages long.  So far six books have been written as part of this project.</p>
<p>Even when it&#8217;s all in one book, how can we be sure such a long proof is right?  Some people want to use computers to make the argument completely rigorous, filling in all the details with the help of a program called a &#8216;proof assistant&#8217;.  </p>
<p>The French are so sexy that even their proof assistant sounds dirty: it&#8217;s called <a href="http://coq.inria.fr/">Coq</a>.   <a href="http://research.microsoft.com/en-us/news/features/gonthierproof-101112.aspx">Recently</a> mathematicians led by George Gonthier have used Coq to give a completely detailed proof of a small piece of the classification of finite simple groups: the <a href="http://en.wikipedia.org/wiki/Feit%E2%80%93Thompson_theorem">Feit&#8211;Thompson Theorem</a>.   Feit and Thompson&#8217;s original proof of this result, skipping lots of steps that are obvious to experts, took 255 pages!  </p>
<p>What does the Feit&#8211;Thompson theorem say?  Every finite group with an odd number of elements is solvable!  Explaining that statement might take quite a while, depending on what you know about math.  So let me just say this:</p>
<p>Galois invented group theory and used it to go further than Abel and Ruffini had.  He showed a bunch of <i>specific</i> polynomial equations couldn&#8217;t be solved just using addition, subtraction, multiplication, division and taking roots.  For example, those operations aren&#8217;t powerful enough to solve this equation:</p>
<p><img src='https://s0.wp.com/latex.php?latex=x%5E5+-+x+%2B+1+%3D+0&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='x^5 - x + 1 = 0' title='x^5 - x + 1 = 0' class='latex' /></p>
<p>while they can solve this one:</p>
<p><img src='https://s0.wp.com/latex.php?latex=x%5E5+-+x+%3D+0&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='x^5 - x = 0' title='x^5 - x = 0' class='latex' /></p>
<p>Galois showed that every polynomial equation has a group of symmetries, and you can solve the equation using addition, subtraction, multiplication, division and taking roots if its group has a certain special property.  So, this property of a group got the name <a href="http://en.wikipedia.org/wiki/Solvable_group">&#8216;solvability&#8217;</a>. </p>
<p><i>Every finite group with an odd number of elements is solvable</i>.  It&#8217;s quick to say, but hard to show&#8212;so hard that making the proof fully rigorous on a computer seemed out of reach at first:</p>
<blockquote><p>
When Gonthier first suggested a formal Feit-Thompson Theorem proof, his fellow members of the Mathematical Components team at Inria could hardly believe their ears.</p>
<p>“The reaction of the team the first time we had a meeting and I exposed a grand plan,” he recalls ruefully, “was that I had delusions of grandeur. But the real reason of having this project was to understand how to build all these theories, how to make them fit together, and to validate all of this by carrying out a proof that was clearly deemed to be out of reach at the time we started the project.”
</p></blockquote>
<p>It took them 6 years!  The completed computer proof has 170,000 lines.  It involves 15,000 definitions and 4,300 lemmas.  Maybe now Gonthier is dreaming of computerizing the whole classification of finite simple groups.</p>
<p>But there are even longer proofs of important results in math.  These longer proofs all involve computer calculations.  For example, Thomas Hales seems to have proved that <a href="http://en.wikipedia.org/wiki/Kepler_conjecture">the densest packing of spheres in 3d space is the obvious one</a>, like this:</p>
<div align="center">
<img width="300" src="https://i1.wp.com/math.ucr.edu/home/baez/mathematical/cubic_close_packing.jpg" />
</div>
<p>(There are infinitely many other <i>equally</i> dense packings, as I <a href="https://johncarlosbaez.wordpress.com/2012/04/15/ice/">explained earlier</a>, but none denser.)</p>
<p>Hales&#8217; proof is a hundred pages of writing <i>together with about 3 gigabytes of computer calculations</i>.  If we wrote out those calculations in a text file, they&#8217;d fill about <a href="http://www.lexisnexis.com/applieddiscovery/lawlibrary/whitePapers/ADI_FS_PagesInAGigabyte.pdf">2 million pages!</a>  </p>
<p>The method is called &#8216;proof by exhaustion&#8217;, because it involves reducing the problem to 10,000 special cases and then settling each one with detailed calculations&#8230; thus exhausting anybody who tries to check the proof by hand.  Now Hales is trying to create a fully formal proof that can be verified by automated proof checking software such as <a href="http://hol.sourceforge.net/">HOL</a>.  He expects that doing this will take 20 years.</p>
<p>These proofs are long, but they&#8217;re not what I&#8217;d call <i>insanely</i> long.</p>
<h3> Insanely long proofs </h3>
<p>What do I mean by &#8216;insanely&#8217; long?  Well, for example, I know a theorem that you can prove using the usual axioms of arithmetic&#8212;Peano arithmetic&#8212;but whose shortest proof using those axioms contains</p>
<p><img src='https://s0.wp.com/latex.php?latex=10%5E%7B1000%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='10^{1000}' title='10^{1000}' class='latex' /></p>
<p>symbols.  This is so many symbols that you couldn&#8217;t write them all down if you wrote one symbol on each proton, neutron and electron in the observable Universe! </p>
<p>I also know a theorem whose shortest proof in Peano arithmetic contains</p>
<p><img src='https://s0.wp.com/latex.php?latex=10%5E%7B10%5E%7B1000%7D%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='10^{10^{1000}}' title='10^{10^{1000}}' class='latex' /></p>
<p>symbols.  This is so many that if you tried to write down the <i>number</i> of symbols&#8212;not the symbols themselves&#8212;in ordinary decimal notation, you couldn&#8217;t do it if you wrote one digit on each proton, neutron and electron in the observable Universe!</p>
<p>I also know a theorem whose shortest proof in Peano arithmetic contains&#8230;</p>
<p>&#8230; well, you get the idea.</p>
<p>By the way, if you don&#8217;t know what <a href="http://en.wikipedia.org/wiki/Peano_axioms#First-order_theory_of_arithmetic">Peano arithmetic</a> is, don&#8217;t worry.  It&#8217;s just a list of obvious axioms about arithmetic, together with some obvious rules for reasoning, which turn out to be good enough to prove most everyday theorems about arithmetic.  The main reason I mention it is that we need to pick <i>some</i> particular setup before we can talk about the &#8216;shortest proof&#8217; of a theorem and have it be well-defined.   </p>
<p>Also by the way, I&#8217;m assuming Peano arithmetic is consistent.  If it were inconsistent, you could prove 0=1, and then everything would follow quite quickly from that.  But most people feel sure it&#8217;s consistent.</p>
<p>If it is, then the shortest proof using Peano arithmetic of the following theorem contains at least <img src='https://s0.wp.com/latex.php?latex=10%5E%7B1000%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='10^{1000}' title='10^{1000}' class='latex' /> symbols:</p>
<blockquote><p>
This statement has no proof in Peano arithmetic that contains fewer than <img src='https://s0.wp.com/latex.php?latex=10%5E%7B1000%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='10^{1000}' title='10^{1000}' class='latex' /> symbols.
</p></blockquote>
<p>Huh?  This doesn&#8217;t look a statement about arithmetic!  But G&ouml;del showed how you could encode the concept of &#8216;statement&#8217; and &#8216;proof&#8217; into arithmetic, and use this to create statements that refer to themselves.   He&#8217;s most famous for this one:</p>
<blockquote><p>
This statement has no proof in Peano arithmetic.
</p></blockquote>
<p>It turns out that this statement is true&#8230; so it&#8217;s an example of a true statement about arithmetic that can&#8217;t be proved using Peano arithmetic!  This is G&ouml;del&#8217;s <a href="http://en.wikipedia.org/wiki/Proof_sketch_for_G%C3%B6del%27s_first_incompleteness_theorem"><b>first incompleteness theorem</b></a>.  </p>
<p>This variation is similar:</p>
<blockquote><p>
This statement has no proof in Peano arithmetic that contains fewer than <img src='https://s0.wp.com/latex.php?latex=10%5E%7B1000%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='10^{1000}' title='10^{1000}' class='latex' /> symbols.
</p></blockquote>
<p>This statement is also true.  It&#8217;s provable in Peano arithmetic, but its proof contains at least <img src='https://s0.wp.com/latex.php?latex=10%5E%7B1000%7D&#038;bg=ffffff&#038;fg=000&#038;s=0' alt='10^{1000}' title='10^{1000}' class='latex' /> symbols.</p>
<h3> Even longer proofs </h3>
<p>But this is just the beginning.   If Peano arithmetic is consistent, there are infinitely many theorems whose shortest proof is longer than 10 to the 10 to the 10 to the 10 to the&#8230; where the stack of 10&#8217;s is as long as the statement of the theorem.</p>
<p>Indeed, take <i>any computable function</i>, say F&#8212;growing as fast as you like.   Then if Peano arithmetic is consistent, there are infinitely many theorems whose shortest proof is longer than this function of the length of the theorem!   </p>
<p>But how do we <i>know</i> this?  Here&#8217;s how.  Using Gödel&#8217;s clever ideas, we can create a statement in arithmetic that says:</p>
<blockquote><p>
This statement has no proof in Peano arithmetic that is shorter than F of the length of this statement.
</p></blockquote>
<p>Let&#8217;s call this statement P.   </p>
<p>We&#8217;ll show that if Peano arithmetic is consistent, then P is provable in Peano arithmetic.   <i>So, according to what P itself says, P is an example of a statement whose shortest proof is insanely long!</i></p>
<p>Now, let me sketch why if Peano arithmetic is consistent then P is provable in this setup.   To save time, I&#8217;ll use N to stand for &#8216;F of the length of P&#8217;.   So, P says: </p>
<blockquote><p>
P has no proof in Peano arithmetic whose length is less than N.
</p></blockquote>
<p>Assume there <i>were</i> a proof of P in Peano arithmetic whose length is less than N.  Then, thanks to what P actually says, P would be false.</p>
<p>Moreover, we could carry out the argument I just gave within Peano arithmetic.  So, within Peano arithmetic, we could disprove P.</p>
<p>But wait a minute&#8212;this would mean that within Peano arithmetic we could both prove and disprove P!  We&#8217;re assuming Peano arithmetic is consistent, so this is impossible.</p>
<p>So our assumption must have been wrong.  P must have no proof in Peano arithmetic whose length is less than N.  </p>
<p>But this is what P says!  So P is true!  </p>
<p>Even better, P is provable in Peano arithmetic.  Why?  Because we can just go through all proofs shorter than N, and check that they&#8217;re not proofs of P&#8230; we know they won&#8217;t be&#8230; and this will constitute a proof that:</p>
<blockquote><p>
P has no proof in Peano arithmetic whose length is less than N.
</p></blockquote>
<p>But this is just what P says!  So this is a way to prove P.  Moreover we can carry out this long-winded check within Peano arithmetic, and get a proof of P <i>in Peano arithmetic!</i></p>
<p>Of course, this proof has length more than N.  </p>
<p>By the way, here I&#8217;m using the fact that there are only finitely many proofs with length less than N, so we can go through them all.  We have to define &#8216;length&#8217; in a way that makes this true, for my argument to work.  For example, we can take the length to be the number of symbols.</p>
<p>Also, it&#8217;s important that our function F be <a href="http://en.wikipedia.org/wiki/Computable_function">computable</a>.  We need to compute N to know how many proofs we need to go through.</p>
<p>The upshot: if Peano arithmetic is consistent, there&#8217;s a provable statement whose shortest proof in Peano arithmetic is insanely long, by any computable standard of what counts as &#8216;insanely long&#8217;.   </p>
<p>Now, so far we&#8217;ve just gotten <i>one</i> theorem with an insanely long proof.  But we can get infinitely many, one for each natural number n, as follows.  Let P(n) be a statement in arithmetic that says:</p>
<blockquote><p>
This statement has no proof in Peano arithmetic whose length is less than n plus F of the length of this statement.
</p></blockquote>
<p>The same argument I just sketched shows that if Peano arithmetic is consistent then P(n) is provable, but has no proof shorter than n plus F of the length of P(n).  The statements P(n) are different for different values of n.    So, we get infinitely many different statements with insanely long proofs&#8230; at least if Peano arithmetic is consistent, which most people believe.</p>
<h3> Proof speedup </h3>
<p>But wait a minute!  If we&#8217;ve proved all these statements P(n) have proofs, then we&#8217;ve basically proved them&#8212;no?  And my argument, though sketchy, was quite short.  So, even a completely detailed version of my argument should not be &#8216;insanely long&#8217;.  Doesn&#8217;t that contradict my claim that the shortest proofs of these statements are insanely long?</p>
<p>Well, no.  I only showed that the shortest proof of P(n) <i>using Peano arithmetic</i> is insanely long.  I did provide a short proof of P(n).  But I did this <i>assuming Peano arithmetic is consistent!</i></p>
<p>So I didn&#8217;t give a short proof of P(n) using Peano arithmetic.  I gave a short proof using Peano arithmetic <i>plus the assumption that Peano arithmetic is consistent!</i></p>
<p>So, if we add to Peano arithmetic an extra axiom saying &#8216;Peano arithmetic is consistent&#8217;, infinitely many theorems get vastly shorter proofs!  </p>
<p>This is often called <b>Gödel&#8217;s speedup theorem</b>.  For more, see:</p>
<p>&bull; <a href="http://en.wikipedia.org/wiki/G%C3%B6del%27s_speed-up_theorem">Gödel&#8217;s speedup theorem</a>, Wikipedia.</p>
<h3> Connections </h3>
<p>It&#8217;s pretty cool how just <i>knowing Peano arithmetic was consistent</i> would let us vastly shorten infinitely many proofs.</p>
<p>As an instant consequence, we get G&ouml;del&#8217;s <a href="http://en.wikipedia.org/wiki/G%C3%B6del%27s_incompleteness_theorems#Second_incompleteness_theorem"><b>second incompleteness theorem</b></a>: it&#8217;s impossible to use Peano arithmetic to prove its own consistency.  For if we could, adding that consistency as an extra axiom couldn&#8217;t shorten proofs by an arbitrarily large amount.  It could only shorten proofs by a fixed finite amount: roughly, the number of symbols in the proof that Peano arithmetic is consistent.</p>
<p>And while we&#8217;re at it, let&#8217;s note how the existence of insanely long proofs is related to another famous result: the <a href="http://en.wikipedia.org/wiki/Entscheidungsproblem"><b>Church&#8211;Turing theorem</b></a>.  This says it&#8217;s impossible to write a computer program that can decide in a finite time, yes or no, whether any given statement is provable in Peano arithmetic.</p>
<p>Suppose that in Peano arithmetic there were a computable upper bound on the length of a proof of any statement, as a function of the length of that statement.  Then we could write a program that would go through all potential proofs of any statement and tell us, in a finite amount of time, whether it had a proof.  So, Peano arithmetic would be decidable!</p>
<p>But since it&#8217;s not decidable, no such computable upper bound can exist.  This is another way of seeing that there must be theorems with insanely long proofs.</p>
<p>So, the existence of insanely long proofs is tightly connected to the inability of Peano arithmetic to prove itself consistent, and also the undecidability of Peano arithmetic.  And these are features not just of Peano arithmetic, but of <i>any</i> system of arithmetic that&#8217;s sufficiently powerful, yet simple enough that we can write a program to check to see if a purported proof really is a proof.</p>
<h3> Buss&#8217; speedup theorem </h3>
<p>In fact Gödel stated his result in a more sophisticated way than I did.  He never published a proof&#8230; but <i>not</i> because the proof is insanely long, probably just because he was a busy man with many ideas.  Samuel Buss gave a proof in 1994:</p>
<p>&bull; <a href="http://www.math.ucsd.edu/~sbuss/ResearchWeb/godelone/index.html">On G&ouml;del&#8217;s theorems on lengths of proofs I: Number of lines and speedups for arithmetic</a>, <i>Journal of Symbolic Logic</i> <b>39</b> (1994), 737&#8211;756.</p>
<p>In <b><a href="http://en.wikipedia.org/wiki/First-order_arithmetic#First-order_theory_of_arithmetic">first-order arithmetic</a></b> you can use variables like x,y,z to stand for natural numbers like 0,1,2,3,&#8230;  This is the kind of arithmetic I&#8217;ve been talking about so far: Peano arithmetic is an example.   In <b><a href="http://en.wikipedia.org/wiki/Second-order_arithmetic">second-order arithmetic</a></b> you can also use variables of a different kind to stand for <i>sets</i> of natural numbers.  <b>Third-order arithmetic</b> goes further and lets you use variables for <i>sets of sets</i> of natural numbers, and so on.</p>
<p>Gödel claimed, and Buss showed, that each time you go up an order, some statements that were already provable get insanely shorter proofs.  So, turning this fact around, there are theorems that have insanely long proofs in first-order arithmetic!   </p>
<p>(And similarly for second-order arithmetic, and so on&#8230;)</p>
<p>For more details, explained in a fairly friendly way, try:</p>
<p>&bull; <a href="http://plato.stanford.edu/entries/goedel/#SpeUpThe">Speed-up theorems</a>, <i>Stanford Encyclopedia of Philosophy</i>.</p>
<p>By the way, this post is a kind of followup to my post on <a href="https://johncarlosbaez.wordpress.com/2012/04/24/enormous-integers/">enormous integers</a>.  Insanely long proofs are <i>related</i> to enormous integers: if you know a quick way to describe an enormous integer, you can use the trick I described to cook up a theorem with an enormous proof.   </p>
<p>Last time we saw the logician Harvey Friedman was a master of enormous integers.  So it&#8217;s not surprising to me that Wikipedia says:</p>
<blockquote><p>
Harvey Friedman found some explicit natural examples of this phenomenon, giving some explicit statements in Peano arithmetic and other formal systems whose shortest proofs are ridiculously long.
</p></blockquote>
<p>However, I don&#8217;t know these statements.  I assume they&#8217;re more natural than the weird self-referential examples I&#8217;ve described.  What are they?</p>
]]></html><thumbnail_url><![CDATA[https://i2.wp.com/math.ucr.edu/home/baez/mathematical/huge_blackboard_small.jpg?fit=440%2C330]]></thumbnail_url><thumbnail_height><![CDATA[240]]></thumbnail_height><thumbnail_width><![CDATA[440]]></thumbnail_width></oembed>