See also âConfidence levels inside and outside an argumentâ
Mathematical error has been rarely examined except as a possibility and motivating reason for research into formal methods; Gaifman 2004 claims
An agent might even have beliefs that logically contradict each other. Mersenne believed that 2^{67}1 is a prime number, which was proved false in 1903, cf.Â Bell (1951). [The factorization, discovered by Cole, is: 193,707,721 Ă 761,838,257,287.]âŠNow, there is no shortage of deductive errors and of false mathematical beliefs. Mersenneâs is one of the most known in a rich history of mathematical errors, involving very prominent figures (cf.Â De Millo et al. 1979, 269270). The explosion in the number of mathematical publications and research reports has been accompanied by a similar explosion in erroneous claims; on the whole, errors are noted by small groups of experts in the area, and many go unheeded. There is nothing philosophically interesting that can be said about such failures.^{1}
Untrustworthy proofs
âBeware of bugs in the above code; I have only proved it correct, not tried it.â âDonald Knuth
In some respects, there is nothing to be said; in other respects, there is much to be said. âProbing the Improbable: Methodological Challenges for Risks with Low Probabilities and High Stakesâ discusses a basic issue with existential threats: any useful discussion will be rigorous, hopefully with physics and math proofs; but proofs themselves are empirically unreliable. Given that proofs are the most reliable form of epistemology humans know, this sets a basic upper bound on how much confidence we can put on any belief. (There are other rare risks, from mental diseases^{2} to how to deal with contradictions^{3}, but weâll look at mathematical error.)
âWhen you have eliminated the impossible, whatever remains is often more improbable than your having made a mistake in one of your impossibility proofs.â âSteven Kaas
Error distribution
This upper bound on our certainty may force us to disregard certain rare risks because the effect of error on our estimates of existential risks is asymmetric: an error will usually reduce the risk, not increase it. The errors are not distributed in any kind of symmetrical around a mean: an existential risk is, by definition, bumping up against the upper bound on possible damage. If we were trying to estimate, say, average human height, and errors were distributed like a bell curve, then we could ignore them. But if we are calculating the risk of a superasteroid impact which will kill all of humanity, an error which means the superasteroid will actually kill humanity twice over is irrelevant because itâs the same thing (we canât die twice); however, the mirror error  the superasteroid actually killing half of humanity  matters a great deal!
How big is this upper bound? Mathematicians have often made errors in proofs. But itâs rarer for ideas to be accepted for a long time and then rejected. But we can divide errors into 2 basic cases corresponding to type I and type II errors:
 Mistakes where the theorem is still true, but the proof was incorrect (type I)
 Mistakes where the theorem was false, and the proof was also necessarily incorrect (type II)
Before someone comes up with a final answer, a mathematician may have many levels of intuition in formulating & working on the problem, but weâll consider the final endproduct where the mathematician feels satisfied that he has solved it. Case 1 is perhaps the most common case, with innumerable examples; this is sometimes due to mistakes in the proof that anyone would accept is a mistake, but many of these cases are due to changing standards of proof. For example, when David Hilbert discovered errors in Euclidâs proofs which no one noticed before, the theorems were still true, and the gaps more due to Hilbert being a modern mathematician thinking in terms of formal systems (which of course Euclid did not think in). (David Hilbert himself turns out to be a useful example of the other kind of error: his famous list of 23 problems was accompanied by definite opinions on the outcome of each problem and sometimes timings, several of which were wrong or questionable^{4}.) Similarly, early calculus used âinfinitesimalsâ which were sometimes treated as being 0 and sometimes treated as an indefinitely small nonzero number; this was incoherent and strictly speaking, practically all of the calculus results were wrong because they relied on an incoherent concept  but of course the results were some of the greatest mathematical work ever conducted^{5} and when later mathematicians put calculus on a more rigorous footing, they immediately rederived those results (sometimes with important qualifications). Other cases are more straightforward, with mathematicians publishing multiple proofs/patches or covertly correcting papers^{6}. Attempts to formalize results into machinechecked proofs, or at least some sort of software form, sometimes turns up issues with accepted results^{7}^{8}, although not always important (eg the correction in Romero & Rubio 2013). PoincarĂ© points out this mathematical version of the pessimistic induction in âIntuition and Logic in Mathematicsâ:
Strange! If we read over the works of the ancients we are tempted to class them all among the intuitionalists. And yet nature is always the same; it is hardly probable that it has begun in this century to create minds devoted to logic. If we could put ourselves into the flow of ideas which reigned in their time, we should recognize that many of the old geometers were in tendency analysts. Euclid, for example, erected a scientific structure wherein his contemporaries could find no fault. In this vast construction, of which each piece however is due to intuition, we may still today, without much effort, recognize the work of a logician.
âŠ What is the cause of this evolution? It is not hard to find. Intuition can not give us rigour, nor even certainty; this has been recognized more and more. Let us cite some examples. We know there exist continuous functions lacking derivatives. Nothing is more shocking to intuition than this proposition which is imposed upon us by logic. Our fathers would not have failed to say: âIt is evident that every continuous function has a derivative, since every curve has a tangent.â How can intuition deceive us on this point?
âŠ I shall take as second example Dirichletâs principle on which rest so many theorems of mathematical physics; today we establish it by reasonings very rigorous but very long; heretofore, on the contrary, we were content with a very summary proof. A certain integral depending on an arbitrary function can never vanish. Hence it is concluded that it must have a minimum. The flaw in this reasoning strikes us immediately, since we use the abstract term function and are familiar with all the singularities functions can present when the word is understood in the most general sense. But it would not be the same had we used concrete images, had we, for example, considered this function as an electric potential; it would have been thought legitimate to affirm that electrostatic equilibrium can be attained. Yet perhaps a physical comparison would have awakened some vague distrust. But if care had been taken to translate the reasoning into the language of geometry, intermediate between that of analysis and that of physics, doubtless this distrust would not have been produced, and perhaps one might thus, even today, still deceive many readers not forewarned.
âŠA first question presents itself. Is this evolution ended? Have we finally attained absolute rigour? At each stage of the evolution our fathers also thought they had reached it. If they deceived themselves, do we not likewise cheat ourselves?
We believe that in our reasonings we no longer appeal to intuition; the philosophers will tell us this is an illusion. Pure logic could never lead us to anything but tautologies; it could create nothing new; not from it alone can any science issue. In one sense these philosophers are right; to make arithmetic, as to make geometry, or to make any science, something else than pure logic is necessary.
Type I > Type II?
Case 2 is disturbing, since it is a case in which we wind up with false beliefs and also false beliefs about our beliefs (we no longer know that we donât know). Case 2 could lead to extinction.
The prevalence of case 1 might lead us to be very pessimistic; case 1, case 2, whatâs the difference? We have demonstrated a large error rate in mathematics (and physics is probably even worse off). Except, errors do not seem to be evenly & randomly distributed between case 1 and case 2. There seem to be far more case 1s than case 2s, as already mentioned in the early calculus example: far more than 50% of the early calculus results were correct when checked more rigorously. GianCarlo Rota gives us an example with Hilbert:
Once more let me begin with Hilbert. When the Germans were planning to publish Hilbertâs collected papers and to present him with a set on the occasion of one of his later birthdays, they realized that they could not publish the papers in their original versions because they were full of errors, some of them quite serious. Thereupon they hired a young unemployed mathematician, Olga TausskyTodd, to go over Hilbertâs papers and correct all mistakes. Olga labored for three years; it turned out that all mistakes could be corrected without any major changes in the statement of the theorems. There was one exception, a paper Hilbert wrote in his old age, which could not be fixed; it was a purported proof of the continuum hypothesis, you will find it in a volume of the Mathematische Annalen of the early thirties. At last, on Hilbertâs birthday, a freshly printed set of Hilbertâs collected papers was presented to the Geheimrat. Hilbert leafed through them carefully and did not notice anything.^{9}
So only one of those papers was irreparable, while all the others were correct and fixable? Rota himself experienced this:
Now let us shift to the other end of the spectrum, and allow me to relate another personal anecdote. In the summer of 1979, while attending a philosophy meeting in Pittsburgh, I was struck with a case of detached retinas. Thanks to Joniâs prompt intervention, I managed to be operated on in the nick of time and my eyesight was saved. On the morning after the operation, while I was lying on a hospital bed with my eyes bandaged, Joni dropped in to visit. Since I was to remain in that Pittsburgh hospital for at least a week, we decided to write a paper. Joni fished a manuscript out of my suitcase, and I mentioned to her that the text had a few mistakes which she could help me fix. There followed twenty minutes of silence while she went through the draft. âWhy, it is all wrong!â she finally remarked in her youthful voice. She was right. Every statement in the manuscript had something wrong. Nevertheless, after laboring for a while, she managed to correct every mistake, and the paper was eventually published.
There are two kinds of mistakes. There are fatal mistakes that destroy a theory; but there are also contingent ones, which are useful in testing the stability of a theory.
A mathematician of my acquaintance referred me to pg118 of The Axiom of Choice, Jech 2008; he had found the sustained effect of the 5 footnotes humorous:
 The result of Problem 11 contradicts the results announced by Levy [1963b]. Unfortunately, the construction presented there cannot be completed.
 The transfer to ZF was also claimed by Marek [1966] but the outlined method appears to be unsatisfactory and has not been published.
 A contradicting result was announced and later withdrawn by Truss [1970].
 The example in Problem 22 is a counterexample to another condition of Mostowski, who conjectured its sufficiency and singled out this example as a test case.
 The independence result contradicts the claim of Felgner [1969] that the Cofinality Principle implies the Axiom of Choice. An error has been found by Morris (see Felgnerâs corrections to [1969]).
And referred me also to the entries in the index of Fourier Analysis by Tom KĂ¶rner concerning the problem of the âpointwise convergence of Fourier seriesâ:
excessive optimism
excessive pessimism
 Delambre, 4734
 general, 4, 74
 Lagrange, 473
 Tchebychev, 198
Some problems are notorious for provoking repeated false proofs. P=NP attracts countless cranks and serious attempts, of course, but also amusing is apparently the Jacobian Conjecture:
The (in)famous Jacobian Conjecture was considered a theorem since a 1939 publication by Keller (who claimed to prove it). Then Shafarevich found a new proof and published it in some conference proceedings paper (in early 1950ies). This conjecture states that any polynomial map from C^2 to C^2 is invertible if its Jacobian is nowhere zero. In 1960ies, Vitushkin found a counterexample to all the proofs known to date, by constructing a complex analytic map, not invertible and with nowhere vanishing Jacobian. It is still a main source of embarrassment for
arxiv.org
contributors, who publish about 35 false proofs yearly. Here is a funny refutation for one of the proofs: âComment on a Paper by Yucai Su On Jacobian Conjecture (Dec 30, 2005)âThe problem of Jacobian Conjecture is very hard. Perhaps it will take human being another 100 years to solve it. Your attempt is noble, Maybe the Gods of Olympus will smile on you one day. Do not be too disappointed. B. Sagre has the honor of publishing three wrong proofs and C. Chevalley mistakes a wrong proof for a correct one in the 1950âs in his Math Review comments, and I.R. Shafarevich uses Jacobian Conjecture (to him it is a theorem) as a factâŠ
This look into the proverbial sausage factory should not come as a surprise to anyone taking an Outside View: why wouldnât we expect any area of intellectual endeavour to have error rates within a few orders of magnitude as any other area? How absurd to think that the rate might be ~0%; but itâs also a little questionable to be as optimistic as Anders Sandbergâs mathematician friend: âhe responded that he thought a far smaller number [1%] of papers in math were this flawed.â
Heuristics
Other times, the correct result is known and proven, but many are unaware of the answers^{11}. The famous Millennium Problems  those that have been solved, anyway  have a long history of failed proofs (Fermat surely did not prove Fermatâs Last Theorem & may have realized this only after boasting^{12} and neither did Lindemann^{13}). What explains this? The guiding factor that keeps popping up when mathematicians make leaps seems to go under the name of âeleganceâ or mathematical beauty, which widely considered important^{14}^{15}^{16}. This imbalance suggests that mathematicians are quite correct when they say proofs are not the heart of mathematics and that they possess insight into math, a 6th sense for mathematical truth, a nose for aesthetic beauty which correlates with veracity: they disproportionately go after theorems rather than their negations.
Why this is so, I do not know.
Outright Platonism like Godel apparently believed in seems unlikely  mathematical expertise resembles a complex skill like chessplaying more than it does a sensory modality like vision. Possibly they have welldeveloped heuristics and shortcuts and they focus on the subsets of results on which those heuristics work well (the drunk searching under the spotlight), or perhaps they do run full rigorous proofs but are doing so subconsciously and merely express themselves ineptly consciously with omissions and erroneous formulations âleft as an exercise for the readerâ^{17}.
We could try to justify the heuristic paradigm by appealing to asyet poorly understood aspects of the brain, like our visual cortex: argue that what is going on is that mathematicians are subconsciously doing tremendous amounts of computation (like we do tremendous amounts of computation in a thought as ordinary as recognizing a face), which they are unable to bring up explicitly. So after prolonged introspection and some comparatively simple explicit symbol manipulation or thought, they feel that a conjecture is true and this is due to a summary of said massive computations.
Perhaps they are checking many instances? Perhaps they are whitebox testing and looking for boundaries? Could there be some sort of âlogical probabilityâ where going down possible proofpaths yield probabilistic information about the final target theorem, maybe in some sort of Monte Carlo tree search of prooftrees? Reading great mathematicians like Terence Tao discuss the heuristics they use on unsolved problems^{18}, they bear some resemblances to computer science techniques. This would be consistent with a preliminary observation about how long it takes to solve mathematical conjectures: while inference is rendered difficult by the exponential growth in the global population and of mathematicians, the distribution of timetosolution roughly matches an exponential distribution or one with a constant chance of solving it in any time period, suggesting that the limiting factor is how much time & effort has been spent on it. This idea of extensive unconscious computation neatly accords with PoincarĂ©âs account of mathematical creativity in which after long fruitless effort (preparation), he abandoned the problem for a time and engaged in ordinary activities (incubation), is suddenly struck by an answer or insight, and then verifies its correctness consciously. The existence of an incubation effect seems confirmed by psychological studies and particular the observation that incubation effects increase with the time allowed for incubation & also if the subject does not undertake demanding mental tasks during the incubation period (see Sio & Ormerod 2009), and is consistent with extensive unconscious computation. Some of this computation may happen during sleep; sleep & cognition have long been associated in a murky fashion (âsleep on itâ), but it may have to do with reviewing the events of the day & difficult tasks, with relevant memories reinforced or perhaps more thinking going on. Iâve seen more than one suggestion of this, and mathematician Richard K. Guy suggests this as well.^{19} (Itâs unclear how many results occur this way; Stanislaw Ulam mentions finding one result but never again^{20}; J Thomas mentions one success but one failure by a teacher^{21}; R. W. Thomason dreamed of a dead friend making a clearly false claim and published material based on his disproof of the ghostâs claim^{22}; and Leonard Eugene Dickson reportedly had a useful dream & an early survey of 69 mathematicians yielded 63 nulls, 5 lowquality results, and 1 hit.)
Heuristics, however, do not generalize, and fail outside their particular domain. Are we fortunate enough that the domain mathematicians work in is  deliberately or accidentally  just that domain in which their heuristics/intuition succeeds? Sandberg suggests not:
Unfortunately I suspect that the connoisseurship of mathematicians for truth might be local to their domain. I have discussed with friends about how âbrittleâ different mathematical domains are, and our consensus is that there are definitely differences between logic, geometry and calculus. Philosophers also seem to have a good nose for what works or doesnât in their domain, but it doesnât seem to carry over to other domains. Now moving outside to applied domains things get even trickier. There doesnât seem to be the same ânose for truthâ in risk assessment, perhaps because it is an interdisciplinary, messy domain. The cognitive abilities that help detect correct decisions are likely local to particular domains, trained through experience and maybe talent (i.e.Â some conformity between neural pathways and deep properties of the domain). The only thing that remains is generalpurpose intelligence, and that has its own limitations.
We can probably add software to that list: early software engineering work found that, dismayingly, bug rates seem to be simply a function of lines of code, and one would expect diseconomies of scale. So one would expect that in going from the ~4,000 lines of code of the Microsoft DOS operating system kernel to the ~50,000,000 lines of code in Windows Server 2003 (with full systems of applications and libraries being even larger: the comprehensive Debian repository in 2007 contained ~323,551,126 lines of code) that the number of active bugs at any time would beâŠ fairly large. Mathematical software is hopefully better, but practitioners still run into issues (eg DurĂĄn et al 2014) and I donât know of any research pinning down how buggy key mathematical systems like Mathematica are or how much published mathematics may be erroneous due to bugs. This general problem led to predictions of doom and spurred much research into automated proofchecking, static analysis, and functional languages^{23}.
The doom, however, did not manifest and arguably operating systems & applications are more reliable in the 2000s+ than they were in the 19801990s^{24} (eg. the general disappearance of the Blue Screen of Death). Users may not appreciate this point, but programmers who happen to think one day of just how the sausage of Gmail is made  how many interacting technologies and stacks of formats and protocols are involved  may get the shakes and wonder how it could ever work, much less be working at that moment. The answer is not really clear: it seems to be a combination of abundant computing resources driving down perline error rates by avoiding optimization, modularization reducing interactions between lines, greater use of testing invoking an adversarial attitude to oneâs code, and a light sprinkling of formal methods & static checks^{25}.
While hopeful, itâs not clear how many of these would apply to existential risks: how does one use randomized testing on theories of existential risk, or tradeoff code clarity for computing performance?
Type I vs Type II
So we might forgive case 1 errors entirely: if a community of mathematicians take an âincorrectâ proof about a particular existential risk and ratify it (either by verifying the proof subconsciously or seeing what their heuristics say), it not being written out because it would be tedious too^{26}, then we may be more confident in it^{27} than lumping the two error rates together. Case 2 errors are the problem, and they can sometimes be systematic. Most dramatically, when an entire group of papers with all their results turn out to be wrong since they made a sincedisproved assumption:
In the 1970s and 1980s, mathematicians discovered that framed manifolds with ArfKervaire invariant equal to 1  oddball manifolds not surgically related to a sphere  do in fact exist in the first five dimensions on the list: 2, 6, 14, 30 and 62. A clear pattern seemed to be established, and many mathematicians felt confident that this pattern would continue in higher dimensionsâŠResearchers developed what Ravenel calls an entire âcosmologyâ of conjectures based on the assumption that manifolds with ArfKervaire invariant equal to 1 exist in all dimensions of the form ${2}^{n}\xe2\x88\x922$. Many called the notion that these manifolds might not exist the âDoomsday Hypothesis,â as it would wipe out a large body of research. Earlier this year, Victor Snaith of the University of Sheffield in England published a book about this research, warning in the preface, ââŠthis might turn out to be a book about things which do not exist.â
Just weeks after Snaithâs book appeared, Hopkins announced on April 21 that Snaithâs worst fears were justified: that Hopkins, Hill and Ravenel had proved that no manifolds of ArfKervaire invariant equal to 1 exist in dimensions 254 and higher. Dimension 126, the only one not covered by their analysis, remains a mystery. The new finding is convincing, even though it overturns many mathematiciansâ expectations, Hovey said.^{28}
The parallel postulate is another fascinating example of mathematical error of the second kind; its history is replete with false proofs even by greats like Lagrange (on what strike the modern reader as bizarre grounds)^{29}, selfdeception, and misunderstandings  Giovanni Girolamo Saccheri developed a nonEuclidean geometry flawlessly but concluded it was flawed:
The second possibility turned out to be harder to refute. In fact he was unable to derive a logical contradiction and instead derived many nonintuitive results; for example that triangles have a maximum finite area and that there is an absolute unit of length. He finally concluded that: âthe hypothesis of the acute angle is absolutely false; because it is repugnant to the nature of straight linesâ. Today, his results are theorems of hyperbolic geometry.
We could look upon Type II errors as having a benevolent aspect: they show both that our existing methods are too weak & informal and that our intuition/heuristics break down at it  implying that all previous mathematical effort has been systematically misled in avoiding that area (as empty), and that there is much lowhanging fruit. (Consider how many scores or hundreds of key theorems were proven by the very first mathematicians to work in the nonEuclidean geometries!)
Future implications
Should such widelybelieved conjectures as Pâ NP or the Riemann hypothesis turn out be false, then because they are assumed by so many existing proofs, a far larger math holocaust would ensue^{30}  and our previous estimates of error rates will turn out to have been substantial underestimates. But it may be a cloud with a silver lining, if it doesnât come at a time of danger.
See also
External links
 An Essay on the Psychology of Invention in the Mathematical Field (Jacques Hadamard; 1945)
 âThe Unreasonable Effectiveness of Mathematics in the Natural Sciencesâ, Wigner 1960; âThe Unreasonable Effectiveness of Mathematicsâ, Richard Hamming 1980
Responses:
 âFlaws in the Perfectionâ (Anders Sandberg commentary on this essay)
 Hacker News discussion
 âBounding the impact of AGIâ
 âMathematical Proofs Improve But Donât Guarantee Security, Safety, and Friendlinessâ (Luke Muehlhauser)
 âThe probabilistic heuristic justification of the ABC conjectureâ (Terence Tao)
 âCould We Have Felt Evidence For SDP â P?â (see particularly âBad Guessesâ)
 âHave any longsuspected irrational numbers turned out to be rational?â
Appendix
Jones 1998
âA credo of sortsâ; Vaughan Jones (Truth in Mathematics, 1998), pg208209:
Proofs are indispensable, but I would say they are necessary but not sufficient for mathematical truth, at least truth as perceived by the individual.
To justify this attitude let me invoke two experiences of current mathematics, which very few mathematicians today have escaped.
The first is computer programming. To write a short program, say 100 lines of C code, is a relatively painless experience. The debugging will take longer than the writing, but it will not entail suicidal thoughts. However, should an inexperienced programmer undertake to write a slightly longer program, say 1000 lines, distressing results will follow. The debugging process becomes an emotional nightmare in which one will doubt oneâs own sanity. One will certainly insult the compiler in words that are inappropriate for this essay. The mathematician, having gone through this torture, cannot but ask: âHave I ever subjected the proofs of any of my theorems to such close scrutiny?â In my case at least the answer is surely ânoâ. So while I do not doubt that my proofs are correct (at least the significant ones), my belief in the results needs bolstering. Compare this with the debugging process. At the end of debugging we are happy with our program because of the consistency of the output it gives, not because we feel we have proved it correctafter all we did that at least twenty times while debugging and we were wrong every time. Why not a twentyfirst? In fact we are acutely aware that our poor program has only been tested with a limited set of inputs and we fully expect more bugs to manifest themselves when inputs are used which we have not yet considered. If the program is sufficiently important, it will be further debugged in the course of time until it becomes secure with respect to all inputs. (With much larger programs this will never happen.) So it is with our theorems. Although we may have proofs galore and a rich surrounding structure, if the result is at all difficult it is only the test of time that will cause acceptance of the âtruthâ of the result.
The second experience concerning the need for supplements to proof is one which I used to dislike intensely, but have come to appreciate and even search for. It is the situation where one has two watertight, welldesigned arguments that lead inexorably to opposite conclusions. Remember that research in mathematics involves a foray into the unknown. We may not know which of the two conclusions is correct or even have any feeling or guess. Proof at this point is our only arbiter. And it seems to have let us down. I have known myself to be in this situation for months on end. It induces obsessive and antisocial behaviour. Perhaps we have found an inconsistency in mathematics. But no, eventually some crack is seen in one of the arguments and it begins to look more and more shaky. Eventually we kick ourselves for being so utterly stupid and life goes on. But it was no tool of logic that saved us. The search for a chink in the armour often involved many tricks including elaborate thought experiments and perhaps computer calculations. Much structural understanding is created, which is why I now so value this process. Oneâs feeling of having obtained truth at the end is approaching the absolute. Though I should add that I have been forced to reverse the conclusion on occasionsâŠ
Citations:
 Bell, E.T.: 1951, âThe Queen of Mathematicsâ, reprinted in J. R. Newman (ed.), The World of Mathematics, Simon and Schuster (1956)
 De Milo, R. Lipton, and A. Perlis: 1979, âSocial Processes and Proofs of Theorems and Programsâ, Communication of the ACM, Vol. 22, No. 5. Reprinted in T. Tymozcko (ed.), New Directions in the Philosophy of Mathematics, Princeton University Press (1998). Page numbers refer to the book
There are various delusions (eg. Cotard delusion), false memory syndromes, compulsive lying (pseudologia fantastica), disorders provoking confabulation such as the general symptom of anosognosia; in a dramatic example of how the mind is what the brain does, some anosognosia can be temporarily cured by squirting cold water in an ear; from âThe Apologist and the Revolutionaryâ:
Take the example of the woman discussed in Lishmanâs Organic Psychiatry. After a righthemisphere stroke, she lost movement in her left arm but continuously denied it. When the doctor asked her to move her arm, and she observed it not moving, she claimed that it wasnât actually her arm, it was her daughterâs. Why was her daughterâs arm attached to her shoulder? The patient claimed her daughter had been there in the bed with her all week. Why was her wedding ring on her daughterâs hand? The patient said her daughter had borrowed it. Where was the patientâs arm? The patient âturned her head and searched in a bemused way over her left shoulderââŠIn any case, a patient who has been denying paralysis for weeks or months will, upon having cold water placed in the ear, admit to paralysis, admit to having been paralyzed the past few weeks or months, and express bewilderment at having ever denied such an obvious fact. And then the effect wears off, and the patient not only denies the paralysis but denies ever having admitted to it.
Most/all math results require their system to be consistent; but this is one particular philosophical view. Ludwig Wittgenstein, in Remarks on the Foundations of Mathematics:
If a contradiction were now actually found in arithmetic  that would only prove that an arithmetic with such a contradiction in it could render very good service; and it would be better for us to modify our concept of the certainty required, than to say it would really not yet have been a proper arithmetic.
Saul Kripke, reconstructing a Wittgensteinian skeptical argument, points out one way to react to such issues:
A skeptical solution of a philosophical problem beginsâŠ by conceding that the skepticâs negative assertions are unanswerable. Nevertheless our ordinary practice or belief is justified becausecontrary appearances notwithstandingit need not require the justification the sceptic has shown to be untenable. And much of the value of the sceptical argument consists precisely in the fact that he has shown that an ordinary practice, if it is to be defended at all, cannot be defended in a certain way.

 the transcendality of ${2}^{\sqrt{2}}$ and ${e}^{\mathrm{\xcf\x80}}$: resolved as predicted, but >78 years faster than he predicted.
 proof of the consistency of arithmetic: prediction that arithmetic was consistent and this was provable was falsified (Goedel showing it is unprovable)
One could add to this Hilbert list: the continuum hypothesis (independent); and the algorithm for solving Diophantines (impossible to give, to the surprise of Georg Kreisel who said reviewing one of the papers âWell, thatâs not the way itâs gonna go.â). From MathOverflow:
Hilbertâs 21st problem, on the existence of linear DEs with prescribed monodromy group, was for a long time thought to have been solved by Plemelj in 1908. In fact, Plemelj died in 1967 still believing he had solved the problem. However, in 1989, Bolibruch discovered a counterexample. Details are in the book The RiemannHilbert Problem by Anosov and Bolibruch (ViewegTeubner 1994), and a nice popular recounting of the story is in Ben Yandellâs The Honors Class (A K Peters 2002).
Lipton also provides as examples:
 Warren Hirschâs polytope conjecture
 Subhash Khotâs conjecture that his Unique Games problem is NPhard (not falsified but substantially weakened)
 the search for a proof of Euclidâs fifth postulate (covered already)
 George PĂłlyaâs prime factorization conjecture
 Eulerâs generalization of Fermatâs last theorem
 Virginia Ragsdaleâs combinatorial conjecture, related to a Hilbert problem
Erik Zeemanâs knottying conjecture; the resolution is too good to not quote:
After trying to prove this for almost ten years, one day he worked on the opposite direction, and solved it in hours.
 a von Neumann topological conjecture
 conventional wisdom in complexity theory âthat boundedwidth programs could not compute the majority function, and many other functionsâ
 ditto, âMost believed that nondeterministic logspace (NLOG) is not closed under complement.â
 BĂ©la Juleszâs human vision statistics conjecture
John von Neumann, âThe Mathematicianâ (1947):
That Euclidâs axiomatization does at some minor points not meet the modern requirements of absolute axiomatic rigour is of lesser importance in this respectâŠThe first formulations of the calculus were not even mathematically rigorous. An inexact, semiphysical formulation was the only one available for over a hundred and fifty years after Newton! And yet, some of the most important advances of analysis took place during this period, against this inexact, mathematically inadequate background! Some of the leading mathematical spirits of the period were clearly not rigorous, like Euler; but others, in the main, were, like Gauss or Jacobi. The development was as confused and ambiguous as can be, and its relation to empiricism was certainly not according to our present (or Euclidâs) ideas of abstraction and rigour. Yet no mathematician would want to exclude it from the fold  that period produced mathematics as firstclass as ever existed! And even after the reign of rigour was essentially reestablished with Cauchy, a very peculiar relapse into semiphysical methods took place with Riemann.
âDesperately seeking mathematical proofâ (arXiv), Melvyn B. Nathanson 2009:
The history of mathematics is full of philosophically and ethically troubling reports about bad proofs of theorems. For example, the fundamental theorem of algebra states that every polynomial of degree n with complex coefficients has exactly n complex roots. DâAlembert published a proof in 1746, and the theorem became known âDâAlembertâs theoremâ, but the proof was wrong. Gauss published his first proof of the fundamental theorem in 1799, but this, too, had gaps. Gaussâs subsequent proofs, in 1816 and 1849, were OK. It seems to have been hard to determine if a proof of the fundamental theorem of algebra was correct. Why?
PoincarĂ© was awarded a prize from King Oscar II of Sweden and Norway for a paper on the threebody problem, and his paper was published in Acta Mathematica in 1890. But the published paper was not the prizewinning paper. The paper that won the prize contained serious mistakes, and Poincare and other mathematicians, most importantly, MittagLeffler, engaged in a conspiracy to suppress the truth and to replace the erroneous paper with an extensively altered and corrected one.
The threebody problem is fascinating as it gives us an example of a bad proof by PoincarĂ© & attempt to cover it up, but also an example of a impossibility proof: Bruns & PoincarĂ© proved in 1887 that the usual approaches could not work, typically interpreted as the 3 or nbody problem being unsolvable. Except in 1906/1909, Karl F. Sundman provided an (impractical) algorithm using different techniques to solve it. See âThe Solution of the nbody Problemâ & âA Visit to the Newtonian Nbody Problem via Elementary Complex Variablesâ.â©
âComputational Discovery in Pure Mathematicsâ, Simon Colton 2007:
A more recent example was the discovery that Andrew Wilesâ original proof of Fermatâs Last Theorem was flawed (but not, as it turned out, fatally flawed, as Wiles managed to fix the problem (Singh, 1997))âŠMore recently, Larry Wos has been using Otter to find smaller proofs of theorems than the current ones. To this end, he uses Otter to find more succinct methods than those originally proposed. This often results in detecting double negations and removing unnecessary lemmas, some of which were thought to be indispensable. (Wos, 1996) presents a methodology using a strategy known as resonance to search for elegant proofs with Otter. He gives examples from mathematics and logic, and also argues that this work also implications for other fields such as circuit design.
(Fleuriot & Paulson, 1998) have studied the geometric proofs in Newtonâs Principia and investigated ways to prove them automatically with the Isabelle interactive theorem prover (Paulson, 1994). To do this, they formalized the Principia in both Euclidean geometry and nonstandard analysis. While working through one of the key results (proposition 11 of book 1, the Kepler problem) they discovered an anomaly in the reasoning. Newton was appealing to a crossmultiplication result which wasnât true for infinitesimals or infinite numbers. Isabelle could therefore not prove the result, but Fleuriot managed to derive an alternative proof of the theorem that the system found acceptable.
Colton 2007: âFor example, Heawood discovered a flaw in Kempeâs 1879 proof of the four colour theorem,2 which had been accepted for 11 years.â It would ultimately be proved with a computer in 1976  maybe.â©
âTen Lessons I wish I had been Taughtâ, GianCarlo Rota 1996â©
There are 2 20th century mathematicians, born too late to work with Faraday, and the telegraph inventor Samuel Morse who while overlapping with Faraday, has a Wikipedia entry mentioning no work in mathematics; I do not know which Morse may be meant.â©
An example of this would be âAn Enduring Errorâ, Branko GrĂŒnbaum:
Mathematical truths are immutable, but mathematicians do make errors, especially when carrying out nontrivial enumerations. Some of the errors are âinnocentâ â plain mistakes that get corrected as soon as an independent enumeration is carried out. For example, Daublebsky [14] in 1895 found that there are precisely 228 types of configurations (123), that is, collections of 12 lines and 12 points, each incident with three of the others. In fact, as found by Gropp [19] in 1990, the correct number is 229. Another example is provided by the enumeration of the uniform tilings of the 3dimensional space by Andreini [1] in 1905; he claimed that there are precisely 25 types. However, as shown [20] in 1994, the correct number is 28. Andreini listed some tilings that should not have been included, and missed several others â but again, these are simple errors easily correctedâŠ.It is surprising how errors of this type escape detection for a long time, even though there is frequent mention of the results. One example is provided by the enumeration of 4dimensional simple polytopes with 8 facets, by BrĂŒckner [7] in 1909. He replaces this enumeration by that of 3dimensional âdiagramsâ that he interpreted as Schlegel diagrams of convex 4polytopes, and claimed that the enumeration of these objects is equivalent to that of the polytopes. However, aside from several âinnocentâ mistakes in his enumeration, there is a fundamental error: While to all 4polytopes correspond 3dimensional diagrams, there is no reason to assume that every diagram arises from a polytope. At the time of BrĂŒcknerâs paper, even the corresponding fact about 3polyhedra and 2dimensional diagrams has not yet been established â this followed only from Steinitzâs characterization of complexes that determine convex polyhedra [45], [46]. In fact, in the case considered by BrĂŒckner, the assumption is not only unjustified, but actually wrong: One of BrĂŒcknerâs polytopes does not exist, see [25].
âŠPolyhedra have been studied since antiquity. It is, therefore, rather surprising that even concerning some of the polyhedra known since that time there is a lot of confusion, regarding both terminology and essence. But even more unexpected is the fact that many expositions of this topic commit serious mathematical and logical errors. Moreover, this happened not once or twice, but many times over the centuries, and continues to this day in many printed and electronic publications; the most recent case is in the second issue for 2008 of this journalâŠ.With our understandings and exclusions, there are fourteen convex polyhedra that satisfy the local criterion and should be called âArchimedeanâ, but only thirteen that satisfy the global criterion and are appropriately called âuniformâ (or âsemiregularâ). Representatives of the thirteen uniform convex polyhedra are shown in the sources mentioned above, while the fourteenth polyhedron is illustrated in Figure 1. It satisfies the local criterion but not the global one, and therefore is  in our terminology  Archimedean but not uniform. The history of the realization that the local criterion leads to fourteen polyhedra will be discussed in the next section; it is remarkable that this development occurred only in the 20th century. This implies that prior to the twentieth century all enumerations of the polyhedra satisfying the local criterion were mistaken. Unfortunately, many later enumerations make the same error.
Dana Mackinzie, The Universe in Zero Words: The Story of Mathematics as Told through Equations (as quoted by John D. Cook):
Fermat repeatedly bragged about the n = 3 and n = 4 cases and posed them as challenges to other mathematicians âŠ But he never mentioned the general case, n = 5 and higher, in any of his letters. Why such restraint? Most likely, Weil argues, because Fermat had realized that his âtruly wonderful proofâ did not work in those casesâŠEvery mathematician has had days like this. You think you have a great insight, but then you go out for a walk, or you come back to the problem the next day, and you realize that your great idea has a flaw. Sometimes you can go back and fix it. And sometimes you canât.
From MathWorld, âFermatâs Last Theoremâ:
Much additional progress was made over the next 150 years, but no completely general result had been obtained. Buoyed by false confidence after his proof that pi is transcendental, the mathematician Lindemann proceeded to publish several proofs of Fermatâs Last Theorem, all of them invalid (Bell 1937, pp.Â 464465). A prize of 100000 German marks, known as the Wolfskehl Prize, was also offered for the first valid proof (Ball and Coxeter 1987, p.Â 72; Barner 1997; Hoffman 1998, pp.Â 193194 and 199).
A recent false alarm for a general proof was raised by Y. Miyaoka (Cipra 1988) whose proof, however, turned out to be flawed. Other attempted proofs among both professional and amateur mathematicians are discussed by vos Savant (1993), although vos Savant erroneously claims that work on the problem by Wiles (discussed below) is invalid.
To take a random example (which could be multiplied indefinitely); from GĂ¶del and the Nature of Mathematical Truth: A Talk with Rebecca Goldstein (6.8.2005):
Einstein told the philosopher of science Hans Reichenbach that heâd known even before the solar eclipse of 1918 supported his general theory of relativity that the theory must be true because it was so beautiful. And Hermann Weyl, who worked on both relativity theory and quantum mechanics, said âMy work always tried to unite the true with the beautiful, but when I had to choose one or the other, I usually chose the beautiful.ââŠMathematics seems to be the one place where you donât have to choose, where truth and beauty are always united. One of my alltime favorite books is A Mathematicianâs Apology. G.H. Hardy tries to demonstrate to a general audience that mathematics is intimately about beauty. He gives as examples two proofs, one showing that the square root of 2 is irrational, the other showing that thereâs no largest prime number. Simple, easily graspable proofs, that stir the soul with wonder.
Nathanson 2009 claims the opposite:
Many mathematicians have the opposite opinion; they do not or cannot distinguish the beauty or importance of a theorem from its proof. A theorem that is first published with a long and difficult proof is highly regarded. Someone who, preferably many years later, finds a short proof is âbrilliant.â But if the short proof had been obtained in the beginning, the theorem might have been disparaged as an âeasy result.â ErdĆs was a genius at finding brilliantly simple proofs of deep results, but, until recently, much of his work was ignored by the mathematical establishment.
From âAesthetics as a Liberating Force in Mathematics Education?â, by Nathalie Sinclair (reprinted in The Best Writing on Mathematics 2010, ed. Mircea Pitici); pg208:
There is a long tradition in mathematics of describing proofs and theorems in aesthetic terms, often using words such as âeleganceâ and âdepthâ. Further, mathematicians have also argued that their subject is more akin to an art than it is to a science (see Hardy, 1967; Littlewood, 1986; Sullivan 1925/1956), and, like the arts, ascribe to mathematics aesthetic goals. For example, the mathematician W. Krull (1930/1987) writes: âthe primary goals of the mathematician are aesthetic, and not epistemologicalâ (p.Â 49). This statement seems contradictory with the oftcited concern of mathematics with finding or discovering truths, but it emphasises the fact that the mathematicianâs interest is in expressing truth, and in doing so in clever, simple, succinct ways.
While Krull focuses on mathematical expression, the mathematician H. Poincare (1908/1966) concerns himself with the psychology of mathematical invention, but he too underlines the aesthetic dimension of mathematics, not the logical. In Poincareâs theory, a large part of a mathematicianâs work is done at the subconscious level, where an aesthetic sensibility is responsible for alerting the mathematicians to the most fruitful and interesting of ideas. Other mathematicians have spoken of this special sensibility as well and also in terms of the way it guides mathematicians to choose certain problems. This choice is essential in mathematic given that there exists no external reality against which mathematicians can decide which problems or which branches of mathematics are important (see von Neumann, 1947 [âThe Mathematicianâ]): the choice involves human values and preference  and, indeed, these change over time, as exemplified by the dismissal of geometry by some prominent mathematicians in the early 20th century (see Whiteley, 1999).
 Littlewood, 1986: âThe mathematicianâs art of workâ; in B. Bollobas (ed.), Littlewoodâs miscellany, Cambridge University press
 Sullivan 1925/1956: âMathematics as an artâ; in J. Newman (ed.), The world of mathematics, vol 3 (p 20152021)
From pg 211212, Sinclair 2009:
The survey of mathematicians conducted by Wells (1990) provides a more empiricallybased challenge to the intrinsic view of the mathematical aesthetic. Wells obtained responses from over 80 mathematicians, who were asked to identify the most beautiful theorem from a given set of 24 theorems. (These theorems were chosen because they were âfamousâ, in the sense that Wells judged them to be wellknown by most mathematicians, and of interest to the discipline in general, rather than to a particular subfield.) Wells finds that the mathematicians varied widely in their judgments. More interestingly, in explaining their choices, the mathematicians revealed a wide range of personal responses affecting their aesthetic responses to the theorems. Wells effectively puts to rest the belief that mathematicians have some kind of secret agreement on what counts as beautiful in mathematicsâŠ.Burtonâs (2004) work focuses on the practices of mathematicians and their understanding of those practices. Based on extensive interviews with a wide range of mathematiciansâŠShe points out that mathematicians range on a continuum from unimportant to crucial in terms of their positionings on the role of the aesthetic, with only 3 of the 43 mathematicians dismissing its importance. For example, one said âBeauty doesnât matter. I have never seen a beautiful mathematical paper in my lifeâ (p.Â 65). Another mathematician was initially dismissive about mathematical beauty but later, when speaking about the review process, said: âIf it was a very elegant way of doing things, I would be inclined to forgive a lot of faultsâ (p.Â 65).
 Burton, Leone (2004): Mathematicians as enquirers: Learning about learning mathematics; Dordrecht: Kluwer Academic Publishers
Tao left a lengthy comment on a previously linked Lipton post:
It is possible to gather reasonably convincing support for a conjecture by a variety of means, long before it is actually proven, though many mathematicians are reluctant to argue too strongly based on such support due to the lack of rigour or the risk of embarrassment in hindsight. Examples of support include:
 Numerical evidence; but one has to be careful in situations where the null hypothesis would also give comparable numerical evidence. The first ten trillion zeroes of zeta on the critical line is, in my opinion, only mild evidence in favour of RH (the null hypothesis may be, for instance, that the zeroes go haywire once log log t becomes sufficiently large); but the numerical data on spacings of zeroes is quite convincing evidence for the GUE hypothesis, in my view. (It is a priori conceivable that the spacings are distributed according to GUE plus another correction that dominates when log log t (say) is large, but this begins to strain Occamâs razor.)
 Nontrivial special cases. But it depends on how ârepresentativeâ one believes the special cases to be. For instance, if one can verify lowdimensional cases of a conjecture that is true in high dimensions, this is usually only weak (but not entirely insignificant) evidence, as it is possible that there exist highdimensional pathologies that sink the conjecture but cannot be folded up into a lowdimensional situation. But if one can do all odddimensional cases, and all evendimensional cases up to dimension 8 (say), then that begins to look more convincing.
 Proofs of parallel, analogous, or similar conjectures. Particularly if these proofs were nontrivial and led to new insights and techniques. RH in function fields is a good example here; it raises the hope of some sort of grand unified approach to GRH that somehow handles all number fields (or some other general class) simultaneously.
 Converse of the conjecture is provable, and looks âoptimalâ somehow. One might be able to construct a list of all obvious examples of objects with property X, find significant difficulty extending the list, and then conjecture that this is list is complete. This is a common way to make conjectures, but can be dangerous, as one may simply have a lack of imagination. So this is thin evidence by itself (many false conjectures have arisen from this conversetaking method), but it does carry a little bit of weight once combined with other strands of evidence.
 Conjecture is ambitious and powerful, and yet is not immediately sunk by the obvious consistency checks. This is vaguely analogous to the concept of a âfalsifiable theoryâ in science. A strong conjecture could have many powerful consequences in a variety of disparate areas of mathematics  so powerful, in fact, that one would not be surprised that they could be disproven with various counterexamples. But surprisingly, when one checks the cases that one does understand quite well, the conjecture holds up. A typical example here might include a very general conjectured identity which, when specialised to various wellunderstood special cases, become a provable identity  but with the identity in each special case being provable by very different methods, and the connection between all the identities being mysterious other than via the conjecture. The general conjecture that the primes behave pseudorandomly after accounting for small moduli is an example of such a conjecture; we usually canât control how the primes behave, but when we can, the pseudorandomess heuristic lines up perfectly.
 Attempts at disproof run into interesting obstacles. This one is a bit hard to formalise, but sometimes you can get a sense that attempts to disprove a conjecture are failing not due to oneâs own lack of ability, or due to accidental contingencies, but rather due to âenemy activityâ; some lurking hidden structure to the problem, corners of which emerge every time one tries to build a counterexample. The question is then whether this âenemyâ is stupid enough to be outwitted by a sufficiently clever counterexample, or is powerful enough to block all such attempts. Identifying this enemy precisely is usually the key to resolving the conjecture (or transforming the conjecture into a stronger and better conjecture).
 Conjecture generalises to a broader conjecture that enjoys support of the types listed above. The twin prime conjecture, by itself, is difficult to support on its own; but when it comes with an asymptotic that one can then verify numerically to high accuracy and is a consequence of the much more powerful prime tuples conjecture (and more generally, the pseudorandomness heuristic for the primes) which is supported both because of its high falsifiability and also its nature as an optimallooking converse (the only structure to the primes are the âobviousâ structures), it becomes much more convincing. Another textbook example is the Poincare conjecture, which became much more convincing after being interpreted as a special case of geometrisation (which had a lot of support, e.g.Â the twodimensional analogue, Haken manifolds, lots of falsifiable predictions, etc.).
It can be fun (though a little risky, reputationwise) to debate how strong various pieces of evidence really are, but one soon reaches a point of diminishing returns, as often we are limited by our own ignorance, lack of imagination, or cognitive biases. But we are at least reasonably able to perform relative comparisons of the strength of evidence of two conjectures in the same topic (I guess complexity theory is full of instances of thisâŠ).
pg190191 of Fascinating Mathematical People, edited by Albers 2011:
Guy
: If I do any mathematics at all I think I do it in my sleep.MP
: Do you think a lot of mathematicians work that way?Guy
: I do. Yes. The human brain is a remarkable thing, and we are a long way from understanding how it works. For most mathematical problems, immediate thought and pencil and paper  the usual things one associates with solving mathematical problems  are just totally inadequate. You need to understand the problem, make a few symbols on paper and look at them. Most of us, as opposed to ErdĆs who would probably give an answer to a problem almost immediately, would then probably have to go off to bed, and, if weâre lucky, when we wake up in the morning, we would already have some insight into the problem. On those rare occasions when I have such insight, I quite often donât know that I have it, but when I come to work on the problem again, to put pencil to paper, somehow the ideas just seem to click together, and the thing goes through. It is clear to me that my brain must have gone on, in an almost combinatorial way, checking the cases or doing an enormous number of fairly trivial arithmetical computations. It seems to know the way to go. I first noticed this with chess endgames, which are indeed finite combinatorial problems. The first indication that I was interested in combinatorics  I didnât know I had the interest, and I didnât even know there was such a subject as combinatorics  was that I used to compose chess endgames. I would sit up late into the night trying to analyze a position. Eventually I would sink into slumber and wake up in the morning to realize that if I had only moved the pawns over one file the whole thing would have gone through clearly. My brain must have been checking over this finite but moderately large number of possibilities during the night. I think a lot of mathematicians must work that way.MP
: Have you talked to any other mathematicians about that?Guy
: No. But in Jacques Hadamardâs book on invention in the mathematical field, he quotes some examples there where it is fairly clear that people do that kind of thing. There was someone earlier this week who was talking about JeanPaul Serre. He said that if you ask Serre a question he either gives you the answer immediately, or, if he hesitates, and you push him in any way, he will say, âHow can I think about the question when I donât know the answer?â I thought that was a lovely remark. At a much lower level, one should think, âWhat shape should the answer be?â Then your mind can start checking whether youâre right and how to find some logical sequence to get you where you want to go.January 14, 1974, in âConversations with GianCarlo Rotaâ; as quoted on pg262 of Turingâs Cathedral (2012) by George Dyson:
Once in my life I had a mathematical dream which proved correct. I was twenty years old. I thought, my God, this is wonderful, I wonât have to work, it will all come in dreams! But it never happened again.

Once after I had spent several days trying to prove a topology theorem, I dreamed about it and woke up with as counterexample. In the dream it just constructed itself, and I could see it. I didnât have a fever then, though. Later one of my teachers, an old Polish woman, explained her experience. She kept a notebook by her bed so she could write down any insights she got in her sleep. She woke up in the night with a wonderful proof, and wrote it down, and in the morning when she looked at it it was all garbage. âYou cannot do math in your sleep. You will have to work.â
âHigher algebraic Ktheory of schemes and of derived categoriesâ, Thomason & Trobaugh 1990:
The first author must state that his coauthor and close friend, Tom Trobaugh, quite intelligent, singularly original, and inordinately generous, killed himself consequent to endogenous depression. 94 days later, in my dream, Tomâs simulacrum remarked, âThe direct limit characterization of perfect complexes shows that they extend, just as one extends a coherent sheaf.â Awaking with a start, I knew this idea had to be wrong, since some perfect complexes have a nonvanishing K_{0} obstruction to extension. I had worked on this problem for 3 years, and saw this approach to be hopeless. But Tomâs simulacrum had been so insistent, I knew he wouldnât let me sleep undisturbed until I had worked out the argument and could point to the gap. This work quickly led to the key results of this paper. To Tom, I could have explained why he must be listed as a coauthor.
âHow Did Software Get So Reliable Without Proof?â, C.A.R. Hoare 1996:
Twenty years ago it was reasonable to predict that the size and ambition of software products would be severely limited by the unreliability of their component programs. Crude estimates suggest that professionally written programs delivered to the customer can contain between one and ten independently correctable errors per thousand lines of code; and any software error in principle can have spectacular effect (or worse: a subtly misleading effect) on the behaviour of the entire system. Dire warnings have been issued..The arguments were sufficiently persuasive to trigger a significant research effort devoted to the problem of program correctness. A proportion of this research was based on the ideal of certainty achieved by mathematical proof.
Hoare 1996:
Fortunately, the problem of program correctness has turned out to be far less serious than predicted. A recent analysis by Mackenzie has shown that of several thousand deaths so far reliably attributed to dependence on computers, only ten or so can be explained by errors in the software: most of these were due to a couple of instances of incorrect dosage calculations in the treatment of cancer by radiation. Similarly predictions of collapse of software due to size have been falsified by continuous operation of realtime software systems now measured in tens of millions of lines of code, and subjected to thousands of updates per yearâŠAnd aircraft, both civil and military, are now flying with the aid of software measured in millions of lines  though not all of it is safetycritical. Compilers and operating systems of a similar size now number their satisfied customers in millions. So the questions arise: why have twenty years of pessimistic predictions been falsified? Was it due to successful application of the results of the research which was motivated by the predictions? How could that be, when clearly little software has ever has been subjected to the rigours of formal proof?
Hoare 1996:
Success in the use of mathematics for specification, design and code reviews does not require strict formalisation of all the proofs. Informal reasoning among those who are fluent in the idioms of mathematics is extremely efficient, and remarkably reliable. It is not immune from failure; for example simple misprints can be surprisingly hard to detect by eye. Fortunately, these are exactly the kind of error that can be removed by early tests. More formal calculation can be reserved for the most crucial issues, such as interrupts and recovery procedures, where bugs would be most dangerous, expensive, and most difficult to diagnose by testsâŠMany more tests should be designed than there will ever be time to conduct; they should be generated as directly as possible from the specification, preferably automatically by computer program. Random selection at the last minute will protect against the danger that under pressure of time the program will be adapted to pass the tests rather than meeting the rest of its specification. There is some evidence that early attention to a comprehensive and rigorous test strategy can improve reliability of a delivered product, even when at the last minute there was no time to conduct the tests before delivery!
The missing steps may be quite difficult to fully prove, though; Nathanson 2009:
There is a lovely but probably apocryphal anecdote about Norbert Weiner. Teaching a class at MIT, he wrote something on the blackboard and said it was âobvious.â One student had the temerity to ask for a proof. Weiner started pacing back and forth, staring at what he had written on the board and saying nothing. Finally, he left the room, walked to his office, closed the door, and worked. After a long absence he returned to the classroom. âIt is obviousâ, he told the class, and continued his lecture.
What conditions count as full scrutiny by the math community may not be too clear; Nathanson 2009 trenchantly mocks math talks:
Social pressure often hides mistakes in proofs. In a seminar lecture, for example, when a mathematician is proving a theorem, it is technically possible to interrupt the speaker in order to ask for more explanation of the argument. Sometimes the details will be forthcoming. Other times the response will be that itâs âobviousâ or âclearâ or âfollows easily from previous results.â Occasionally speakers respond to a question from the audience with a look that conveys the message that the questioner is an idiot. Thatâs why most mathematicians sit quietly through seminars, understanding very little after the introductory remarks, and applauding politely at the end of a mostly wasted hour.
âMathematicians solve 45yearold Kervaire invariant puzzleâ, Erica Klarreich 2009â©
âWhy Did Lagrange âProveâ the Parallel Postulate?â, Grabiner 2009:
It is true that Lagrange never did publish it, so he must have realized there was something wrong. In another version of the story, told by JeanBaptiste Biot, who claims to have been there (though the minutes do not list his name), everybody there could see that something was wrong, so Lagrangeâs talk was followed by a moment of complete silence [2, p.Â 84]. Still, Lagrange kept the manuscript with his papers for posterity to read.
Why work on it at all?
The historical focus on the fifth postulate came because it felt more like the kind of thing that gets proved. It is not selfevident, it requires a diagram even to explain, so it might have seemed more as though it should be a theorem. In any case, there is a tradition of attempted proofs throughout the Greek and then Islamic and then eighteenthcentury mathematical worlds. Lagrange follows many eighteenthcentury mathematicians in seeing the lack of a proof of the fifth postulate as a serious defect in Euclidâs Elements. But Lagrangeâs criticism of the postulate in his manuscript is unusual. He said that the assumptions of geometry should be demonstrable âjust by the principle of contradictionâthe same way, he said, that we know the axiom that the whole is greater than the part [32, p.Â 30R]. The theory of parallels rests on something that is not selfevident, he believed, and he wanted to do something about this.
What was the strange and alien to the modern mind approach that Lagrange used?
Recall that Lagrange said in this manuscript that axioms should follow from the principle of contradiction. But, he added, besides the principle of contradiction, âThere is another principle equally selfevident,â and that is Leibnizâs principle of sufficient reason. That is: nothing is true âunless there is a sufficient reason why it should be so and not otherwiseâ [42, p.Â 31; italics added]. This, said Lagrange, gives as solid a basis for mathematical proof as does the principle of contradiction [32, p.Â 30V]. But is it legitimate to use the principle of sufficient reason in mathematics? Lagrange said that we are justified in doing this, because it has already been done. For example, Archimedes used it to establish that equal weights at equal distances from the fulcrum of a lever balance. Lagrange added that we also use it to show that three equal forces acting on the same point along lines separated by a third of the circumference of a circle are in equilibrium [32, pp.Â 31R31V]âŠThe modern reader may object that Lagrangeâs symmetry arguments are, like the uniqueness of parallels, equivalent to Euclidâs postulate. But the logical correctness, or lack thereof, of Lagrangeâs proof is not the point. (In this manuscript, by the way, Lagrange went on to give an analogous proofalso by the principle of sufficient reasonthat between two points there is just one straight line, because if there were a second straight line on one side of the first, we could then draw a third straight line on the other side, and so on [32, pp.Â 34R34V]. Lagrange, then, clearly liked this sort of argument.)
âŠWhy did philosophers conclude that space had to be infinite, homogeneous, and the same in all directions? Effectively, because of the principle of sufficient reason. For instance, Giordano Bruno in 1600 argued that the universe must be infinite because there is no reason to stop at any point; the existence of an infinity of worlds is no less reasonable than the existence of a finite number of them. Descartes used similar reasoning in his Principles of Philosophy: âWe recognize that this world. . . has no limits in its extension. . . . Wherever we imagine such limits, we . . . imagine beyond them some indefinitely extended spaceâ [28, p.Â 104]. Similar arguments were used by other seventeenthcentury authors, including Newton. Descartes identified space and the extension of matter, so geometry was, for him, about real physical space. But geometric space, for Descartes, had to be EuclideanâŠDescartes, some 50 years before Newton published his first law of motion, was a codiscoverer of what we call linear inertia: that in the absence of external influences a moving body goes in a straight line at a constant speed. Descartes called this the first law of nature, and for him, this law follows from what we now recognize as the principle of sufficient reason. Descartes said, âNor is there any reason to think that, if [a part of matter] moves. . . and is not impeded by anything, it should ever by itself cease to move with the same forceâ [30, p.Â 75]âŠ.Leibniz, by contrast, did not believe in absolute space. He not only said that spatial relations were just the relations between bodies, he used the principle of sufficient reason to show this. If there were absolute space, there would have to be a reason to explain why two objects would be related in one way if East is in one direction and West in the opposite direction, and related in another way if East and West were reversed [24, p.Â 147]. Surely, said Leibniz, the relation between two objects is just one thing! But Leibniz did use arguments about symmetry and sufficient reasonsufficient reason was his principle, after all. Thus, although Descartes and Leibniz did not believe in empty absolute space and Newton did, they all agreed that what I am calling the Euclidean properties of space are essential to physics.
âŠIn his 1748 essay âReflections on Space and Timeâ, Euler argued that space must be real; it cannot be just the relations between bodies as the Leibnizians claim [10]. This is because of the principles of mechanicsthat is, Newtonâs first and second laws. These laws are beyond doubt, because of the âmarvelousâ agreement they have with the observed motions of bodies. The inertia of a single body, Euler said, cannot possibly depend on the behavior of other bodies. The conservation of uniform motion in the same direction makes sense, he said, only if measured with respect to immovable space, not to various other bodies. And space is not in our minds, said Euler; how can physicsreal physicsdepend on something in our minds?âŠin his Critique of Pure Reason of 1781, Kant placed space in the mind nonetheless. We order our perceptions in space, but space itself is in the mind, an intuition of the intellect. Nevertheless, Kantâs space turned out to be Euclidean too. Kant argued that we need the intuition of space to prove theorems in geometry. This is because it is in space that we make the constructions necessary to prove theorems. And what theorem did Kant use as an example? The sum of the angles of a triangle is equal to two right angles, a result whose proof requires the truth of the parallel postulate [26, âOf space,â p.Â 423]âŠ.Lagrange himself is supposed to have said that spherical trigonometry does not need Euclidâs parallel postulate [4, pp.Â 5253]. But the surface of a sphere, in the eighteenthcentury view, is not nonEuclidean; it exists in 3dimensional Euclidean space [20, p.Â 71]. The example of the sphere helps us see that the eighteenthcentury discussion of the parallel postulateâs relationship to the other postulates is not really about what is logically possible, but about what is true of real space.
The final step:
Johann Heinrich Lambert was one of the mathematicians who worked on the problem of Postulate 5. Lambert explicitly recognized that he had not been able to prove it, and considered that it might always have to remain a postulate. He even briefly suggested a possible geometry on a sphere with an imaginary radius. But Lambert also observed that the parallel postulate is related to the law of the lever [20, p.Â 75]. He said that a lever with weightless arms and with equal weights at equal distances is balanced by a force in the opposite direction at the center equal to the sum of the weights, and that all these forces are parallel. So either we are using the parallel postulate, or perhaps, Lambert thought, some day we could use this physical result to prove the parallel postulateâŠ.These men did not want to do mechanics, as, say, Newton had done. They wanted to show not only that the world was this way, but that it necessarily had to be. A modern philosophical critic, Helmut Pulte, has said that Lagrangeâs attempt to âreduceâ mechanics to analysis strikes us today as âa misplaced endeavour to mathematize. . . an empirical science, and thus to endow it with infallibilityâ [39, p.Â 220]. Lagrange would have responded, âRight! Thatâs just exactly what we are all doing.â

Much of CS theory would disappear. In my own research some of Kenâs and my âbestâ results would survive, but many would be destroyed. The KarpLipton Theorem is gone in this world. Ditto all âdichotomyâ results between P and NPcomplete, and for P = #P, JinYiâs similar work. Many barrier results, such as oracle theorems and natural proofs, lose their main motivation, while much fine structure in hardnessversusrandomness tradeoffs would be blown up. The PCP Theorem and all the related work is gone. Modern cryptography could survive if the algorithm were galactic, but otherwise would be in trouble. I am currently teaching Complexity Theory at Tech using the textbook by Sanjeev Arora and Boaz BarakâŠMost of the 573 pages of AroraBarak would be gone:
 Delete all of chapter 3 on NP.
 Delete all of chapter 5 on the polynomial hierarchy.
 Delete most of chapter 6 on circuits.
 Delete all of chapter 7 on probabilistic computation.
 Mark as dangerous chapter 9 on cryptography.
 Delete most of chapter 10 on quantum computation  who would care about Shorâs algorithm then?
 Delete all of chapter 11 on the PCP theorem.
I will stop here. Most of the initial part of the book is gone. The same for much of HomerSelman, and basically all of the âReducibility and Completenessâ CRC chapter.