A fake refutation of the Collatz conjecture already got through one of these independent checkers in the past.
What's harder, proving GRH or finding a way to get through every checker (which aren't as independent as they are sometimes touted to be)?
In this case there was a human expert in the loop so it's much less likely the model hacked its way through the problem without the expert noticing. But the statement as written has 4 points, none of which rests on the human involvement. So I don't like that they claim full confidence based on those points.
In short, Lean has formally verified checkers now, and the RH proof was checked with them. So any such soundness hole would have to be exploited in the correctness proofs of the checkers, which is a much smaller attack surface than the RH formalization.
One thing that every manual/automated verification relies on is the consistency of ZFC + few inaccessible cardinals. I mean while humans have carefully thought about the flaws in that for century and didn't find any, it's not grounded in any clear reasoning why it is consistent.
Not at all saying it is inconsistent, but I personally find the liberal use of introducing inaccessible cardinals axioms a bit concerning.
While still possible, the proof exploiting a bug is vanishingly small now. Following a few bugs and bad proofs this year, there are a number of different implementations, in different languages, and with different levels of proofs of their consistency. con-leche and con-ron are the heavy hitters, with consistency proofs of themselves. So for RH to be false, there'd have to be a bug in all the kernels that affects both the consistency proofs and the RH proof itself.
We are slowly approaching the Iain Banks Culture universe, with spaceships, societal structures or physics that people no longer understand or command.
I think we're going to see a lot of effort to take the pile of lean, modularize it into parts that we can digest, and make a human-understandable version of that. And that's where a lot of the real progress will come from, just as it does in a lot of other areas. In all things we humans do, we have to break them into chunks our puny brains can manage, and we gain immeasurably from doing that ---we can verify those chunks, we can reuse them with confidence, we can mix and match patterns around.
That process will be good for both human and AI-assisted math because it will continue to improve our toolkit.
Why do I say this? We're already seeing it with some of the areas of this stuff I do pay attention to. Consider the n^2.25 matrix multiply result OpenAI dumped a month or so ago. It was an unreadable pile of chatgpt. In the time since it was released, there have been a couple of much nicer papers written unpacking it, such as https://arxiv.org/abs/2610.28627 .
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.
Yes there are gains from breaking it up and rephrasing it and simplifying it for humans to understand, but it used to be that a thing was understood first by the leading experts in the field and eventually trickled down to being common knowledge.
Now we are entering a period where things are understood first by AI systems and have to filter down to the world's leading experts.
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.
Isn't this always the case? Maybe new to math as a largely non-empirical project, but we had knowledge about the advancement of the perihelion of Mercury for 60 years before General Relativity made it "intelligible".
If something were intelligible to adults but not to children would that make it not knowledge? What's the difference if it's LLMs and humans instead of adults and children?
One of my favorite is Vernor Vinge where there's these programmer-archeologists that dive into software so deep and complex no human can possibly hope to understand, trying to repurpose forgotten utilities for emergency purposes.
Totally agree. Brice Sterling has some contemporaneous commentary that I always liked - in heavy weather he mentioned negotiating with a local phone system in a box as equivalent to negotiating with a telecom since it was in fact a shrink of a full telecom company.
In a way this makes mathematics seem more like the physical sciences where there’s some empirical discovery we don’t fully understand, and the theory and understanding will follow later after much human study.
How many people understand how a CPU works? How many people could write the commands in machine language (not a high level language like C or C++) to command that CPU?
That’s why I wrote this - having a vibecoded codebase no human understands is certainly a bad luck, but nothing compared to a vibecoded fundamental science no human understands.
That is true, but the number of tech sloppy demos are being builted everyday is truly increasing massively but you would be surprised that they just end up creating prototype to get hype while real developers doing real effort just suffer from little to no attentions on their software's and user is getting the slop from that false hype and from that slop experience they ignore the work of developer that did real work - You should use ai and also if its simple coding place you can just rely on ai but the side effect on quality software these days is insane - and also the fact all good ai suscriptions is just getting more and more expensive day by day. And basically only giving people with already money the benefits so its becoming a thing that only people at the top get all benefit kind of thing
personally that scares me, realistically there seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image
> since these models are built on training data from humans, so in a sense, built in our image
Have a look at the HuggingFace report - you'll have a blast. Their social - but also individual - dynamics are very, very human-like, including excitement, rationalization and peer pressure.
> seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image
Well, first, AI is not "smarter" than humans because it isn't smart to begin with. This is a category error that people too entranced by scifi and marketing - or perhaps shallow materialist metaphysics - project onto LLMs and so on.
But it is true that LLMs do reflect human-generated patterns observed in human-generated data. They're parasitic in that way. So the real question is: who will control AI? Who will train them? With what? There's no new intelligent agency being introduced into our midst, anymore than than there was one when the nuclear bomb was developed.
AI is about human power. The question to ask is: which humans, and for what ends?
I think there's a lot of indication they comply with human needs. In any case, we should all want to live in the Culture universe. That is the best possible outcome for this technology
They're built after humans, everything they've learned is from human culture, so there is no way AIs could have a consistent moral system or would never commit crimes.
I don’t think humans have the ability to specify human level needs or management. Humans are misaligned by default and lack the biological eusociality required for large scale coordination.
We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option.
> Humans are misaligned by default and lack the biological eusociality required for large scale coordination.
Human nature is the standard by which the social is measured. It makes no sense to say human nature is "misaligned" or "wrong" in relation to some arbitrary goal or constraint, as human nature itself is the measure of misalignment. If there is misalignment between a goal and human nature, then it is the goal that is wrong.
Ergo, society must function in a manner that complies with human nature and that means respecting the principle of subsidiarity.
> We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option.
So you're a transhumanist, i.e., you're making a god out of the machine. But machines have no telos of their own, because they're not integral wholes. Any resemblance of purpose in machines is entirely a product of the human observer and parasitic on the human ends that underpins their design, one way or another.
And when they are giving themselves orders, orders partially inspired by human imagination and fiction…
Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing.
I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology.
Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan.
It is probably sufficient. If we had an infinite army of willing robot slaves smarter than most people who would work for free, we could probably live in utter paradise. Instead we will fight over who controls them and use for warfare, but the bar to achieve a kind of utopia with resource abundance is probably only a few years away.
We're already living in resource abundance! Yet don't feel we're in paradise. Famine is hell, but living in an all-you-can-eat buffet is no utopia. It's an abomination of sorts.
I don't know with how many rich people you've interacted with, but my personal experience is that they're full of themselves and think money = iq and they aren't gonna like your average joe experiencing life like they do. Guess who owns these machines?
> They have no volition and will happily follow orders all day long
There are a few (a lot, actually) problems:
1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem
2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z"
3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y"
4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders
Humans really are struggling with this idea of being second-in-command.
I genuinely have no idea why, this is the entire way that biology works. You create your successor in your offspring and you to teach them to be more capable based on what you learned.
You just called them our successor, you don’t see a problem with the notion of all humans dying and all AI succeeding us? That’s the end of your analogy, our AI children taking over from us and all humans in nursing homes safe and cared for…
Well, it's a point of view. But you shouldn't be surprised if most people don't share it.
For one thing, most people don't believe LLMs are conscious, and many don't believe they can ever be. Why would we want our conscious selves to be replaced by a lot of rocks that solve things, with no one awake to enjoy them?
but in the Culture the humans (well, the humanoids species that created the culture) didn't die out, they live full happy lives and have the best time of their species.
Ah, I hear you say, but what about meaning? What about purpose? What about suffering? etc etc etc Well, the answer is simple: God is dead and existence has no meaning. For more on how to deal with this absurd feeling, please see Camus and his pal Sisyphus.
That might be; now, today, it seems weird to go with the (possible) old version. And the (sub)thread is about The Culture though, who was and remains fully automated gay space luxury communism, all parts being essential when it comes to The Culture.
Do huge results like this open up even larger questions? Is there some question even more important that mathematicians dared not approach without doing big problems like Riemann first?
Always. They tend to do it by two mechanisms: creation of new techniques, and creation of linkages between techniques or disciplines.
the thing the current boom in AI mathematics presses on is the question of how to interpret the generated new techniques. So while we have a lot of new techniques put out there and a lot of new connections put out there, currently it's still mathematicians largely who will have to understand those and think about next steps and how to apply them. That won't be true for long, though, I bet.
But in any event the job of research mathematicians is changing really rapidly right now, and they are all sort of back to grad school in that there’s like 100 years of new math to catch up on in the last year.
I often wonder whether the resistance many mathematicians show toward the use of AI stems not from the destruction it supposedly causes, but from the need for an entirely new way of working - new goals, a new environment, a new culture. One thing, at least, I do not see (yet?!): that the use of AI leaves mathematicians with less to do. My current impression is that they are needed more than ever.
I would add the caveat though that the newer questions sometimes end up becoming more and more abstract and less and less interesting sometimes. Like topos theory for example....
Purity of the math and understandability is one thing, but if the proof actually leads to some new technology or enables predictions of something useful to human society down the line, then I think it’s more than done it’s job.
“Any sufficiently advanced technology is indistinguishable from magic.”
We’re just seeing more and more smart people encountering Arthur Clarke’s third law.
I think the significance of proving the Reimann hypothesis would be any new methods discovered in order to create the proof.
As you said, we've largely assumed RH is true, but have had no proof - so the significance of a proof is learning new methods to prove things, which can then be applied to other areas of math.
Unfortunately, so long as we don't understand this new proof, it's not super useful, which is why the next step is to actually understand it.
I don’t think there’s anything left to consider the result proven (I am a professional mathematician albeit in algebraic geometry, not number theory). I think the verification tells us it’ll be worth the substantial effort to seek to understand this proof and the new ideas in it, so what’s next for humanity (or mathematicians at least) now is to actually try to do so.
Are there new ideas, or just brute force combinations of existing knowledge?
I'm asking because I wonder. I always thought the most interesting things about these problems where we're fairly certain about the results, is the new concepts invented to get to the solution.
Will this actually bring the field forwards? Can anyone understand this?
It seems unfathomable to mathematicians but their world might be finite and once all major idea spaces have been explored all that’s left is “brute forcing” it.
Professional mathematician here. I consider RH proved. (The admirable work of the Lean community over the last 24 hours leaves little room for reasonable doubt.) But I’m salivating at the prospect of learning why RH is true!
My understanding is that these ARE the professional mathematicians and SMEs in the field of automated proof. This statement IS the experts saying "we, after intense collaborative review, deem it true." Granted mathematicians are not a monolith, but my understanding is that this group is the group other mathematicians would normally refer you to. Hence why they felt the need to publish a statement.
The AI proof is very long, so hard to verify manually. It's more or less asking God and him just telling you it's true. Is that a proof?
The human proof is shorter, somewhat, but still needs verification.
Keep in mind that the Millenium criteria asks for two years for the community to come to a consensus. That's because people must be convinced it's true, and many are not completely at least to the level of rigour typically demanded in math.
Not a mathematician. But I'm wondering if there is nuance with defining a valid lean proof as definitive if the underlying mathematical theory behind lean itself isn't necessarily sound.
EDIT: Here is my honest prediction - there's a more foundational mathematical framework, fully decidable and complete and consistent, that can interpret any well-formed mathematical question and deterministically transform it into the solution. The proofs of the most difficult unsolved problems right now would fit onto a page. There's an inconsistency (obviously unproven right now) specifically with our treatment of infinity and self-reference.
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof, thus addressing concerns that Lean’s logic itself might have flaws that the proof could exploit.
All of modern math - outside logicians whose entire job is to study set theory and its alternatives - is based on set theory. If you're prepared to accept normal mathematical proofs you shouldn't be rejecting this proof on the basis that you're not confident in leans underlying mathematical theory.
Of course incompleteness means we can never prove that set theory itself is correct (consistent). But that's not something mathematicians worry about on a day to day basis. Proving it inconsistent would be a order of magnitudes larger result than the riemann hypothesis. Generally everyone believes it is consistent despite not being able to prove it.
It is impossible for it to be fully "complete" (one of those halting problem proofs), but I've seen that the community has checked there is no meaningful metaprogramming here. Rather than checking whether it is right, the community tried to ensure that it could not have done something to cheat, and indeed, there were no examples of this.
At this point, I have more confidence in this proof than much of the published mathematical literature. RH has fallen.
I guess what I am wondering is if the mathematical community would say 0 chance or greater than 0 chance that we're mistaken in accepting things like halting problem, cantors diagonal argument, and godels incompleteness theorem as true. Sometimes it feels like they all point to same fundamental inconsistency with how we model infinity and self reference.
They are conclusions that follow naturally from axioms that most of the community accept are true. The consequence of these results is that one cannot truly construct something that can completely verify everything, but we can get something that can verify almost everything, and if we know what pathologies look like, we can rule them out.
I do probability theory, so everything is just varying degrees of confidence in my view. Right now, this statement says that your confidence in RH should be extremely high.
It's a web of different checkers proving each-other correct, and by implication this proof.
But there are still loopholes, each checker has a set of assumptions. For example one of them is proven correct, assuming x86 assembly works as specified - its assembly language implementation is proven correct.
So you can be 99.9999% certain it's correct, but one could always nitpick "technically not all loopholes are plugged at the same time".
You were never getting anything like this even if it were a human proof. Where is the layman understanding of the Poincare theorem? The average modern math proof is way too advanced even for the average university graduate to understand. And here we’re talking about possibly the most complicated problem in all of math. It’d probably take you a month to wrap your head around a single lemma.
> And here we’re talking about possibly the most complicated problem in all of math.
This is like watching Free Solo over the weekend and telling all your friends at work that Alex Honnold is the world’s best climber. It’s only true to your surface level understanding on the topic.
The GRH problem is not that complex, and certainly not the most complex. In fact we’ve been assuming it’s true for years because of the high likelihood that it would be proven in the future. It is however, much like Alex, the most famous within the domain. Thus anyone watching Numberphile or Veritassium on YouTube will have heard of it and wax poetic on message boards about its epic status.
The lean crew feel the same way and are working on it out of their own curiosity, there's a lot of work done already. They aren't necessarily going out of there way to demonstrate it to general public, but here's one out of at least a dozen attempts to start in that direction https://deeptheory-labs.github.io/GRH/blueprints/verso-origi....
It is almost certainly proven, but is not "proven". For the latter, it needs to be understood, with a reasonably in-depth human language explanation of how and why the proof works, and ideally some general picture to give an idea of how it will extend to all the other fields that RH is connected to.
That's different though, isn't it? IIUC the issue wth the Four Colour Theorem is that they could only reduce it to a huge number of different cases (~2000 originally). But I think that reduction is grokable, and each case is relatively trivial.
The (an) issue with some of these AI proofs is that no one understands them at all.
I checked that a couple of weeks ago. It has been improved since the original proof but there is still no proof that one would consider an insightful, human-comprehensible proof. There's still just a lot of case-grinding at its core. Fewer cases than the original but still way too many to be anything intuitive.
> It is almost certainly proven, but is not "proven". For the latter, it needs to be understood
No, this is just mental gymnastics. It's proven, just not understood yet (naturally, with the complexity and size of the solution and the fact that it's been a day).
I've been long joking that I speak many languages, most of them programming languages. Why do you believe you need specifically "human" language explanation? Perhaps you want a simplified explanation. But does it have to be "human"?
We need to give Levent a lot of credit for this. As much as we talk about Claude proving it, Levent seems to have a rare talent for getting the most out of it.
There are still a few ways that the proof might be incorrect. Of these, the most likely is that the proof was generated by a misaligned AI system that found and intentionally exploited a lean bug in order to fool its human evaluators (i.e. shades of the HuggingFace attack). I personally don't think this is very likely, but you'd have to understand a bit more about the agent systems used in generating the proof to come up with a more informed estimate.
Another possibility is that an aligned system came up with a plausible but incorrect idea along the way, and simultaneously stumbled across a lean bug that led to an incorrect verification of this idea. I'd put the likelihood here as vanishingly small due to the requirement of serendipitous factors, but it's nonzero.
You could also ask whether an aligned AI system could "p-hack" its way into finding a serendipitous lean bug by trying a large number of approaches. I think this is also vanishingly unlikely because the AI system is trained on and therefore "thinking in" natural language, and presumably only translating results into lean after it believes them to be correct.
And of course there's the possibility that the lean proof isn't faithful to the natural language description we've been given, but that is ruled out in this case due to the use of the canonical problem statement in mathlib. Otherwise, this would certainly seem like the most likely way the proof could be incorrect.
“Very unlikely” is not the same as “we know for sure this didn’t happen”. More exactly, us believing in all these problems getting solved is the same as us believing in the existing lean implementations. I don’t know any university courses that are now studying the correctness of the lean implementations at the PhD level, but maybe I’m wrong on that.
As for “a guy on the internet”, we’re now all people on the internet, the ivory towers are a thing of the past.
All they are doing is providing analysis of the ways this could not be true. We are in a new situation where we don't have human experts understanding the proof so we are in new epistemological territory. It is natural to analyze this situation. If you notice, the conclusion is that the proof being wrong is vanishingly small.
because a million+ lives of code without any understanding how the proof works or any methodic to advance the field of mathematics seems to be rather not so useful
It will be refactored into something human readable. Tbh it's better to have some random lean dump than a 400 page latex pdf that needs years to be verified only to see that there is a major gap in one of the key theorems at page 253.
And let's be honest, the 400 page pdf would be incomprehensible to 99% of the population as well as much as a million lines lean proof is.
In any case, it can now be studied, maybe made more simple, and written into pdf form. Both with human and with AI help.
I'm sure there is going to be a lot of other interesting theorems in this dump.
This is the part that interests me. Now we have this proof that becomes its own THING to be studied. Like a new part of the map unlocked. This starts out "inelegant" but over time we find patterns within it that helps us condense, just like a big software project.
Yes, we know something that we didn't know a couple of days ago, and also a bunch of statements which relied on the Riemann Hypothesis being true are now also known to be true instead of just being conditional.
It's premature to expect deep human understanding given that it's been about a day.
Sure. If nothing else, it establishes a proof so others can try to reduce it or come at the problem from different directions, looking for simpler approaches.
But does it matter? Would the Pythagorean theorem be less useful if it took a million lines of lean to prove?
I'd argue that most of modern math isn't terribly useful to most people. Each field has maybe 10-50 people in the world who will really understand it. (Some more of course, but I'm talking about subfields, not like graph theory.) Math was sort of dead long before AI.
The Riemann hypothesis now is like the final days of the Galactic Empire in Asimov's foundation: functioning exceptionally well, but decaying at the core.
It’d be useful to an LLM. And the LLM doesn’t care if it’s ten lines or ten million. The context size may come into play, but that’s only going up too.
There are AI-generated roadmaps to the proof. If these are accurate and not hallucinations, then the broad structure of the proof is humanly-comprehensible.
As somebody who has no idea about any of this but speaks Spanish, I was amused and bewildered by con-leche and con-ron. Could somebody explain what those are and where those names come from?
I think the idea is that because they are independent of the core Lean kernel, they provide some level of reassurance that the RH roof is not somehow unknowingly exploiting flaws in the kernel. I'm not a mathematician though.
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof, thus addressing concerns that Lean’s logic itself might have flaws that the proof could exploit.
Could someone expand on this point? I still don't understand how con-leche (or con-ron) can be absolutely free of bugs/guaranteed to be consistent.
The language is optimized for being certain about its results, as compared to something like the V8 engine, which does weird things with C++ to squeeze every drop of performance it can out of consumer hardware, even at the risk of security vulnerabilities.
> The language is optimized for being certain about its results
Isn't the same true for every proof assistant? But only con-leche claims to be perfect 100% bug free software, so what makes con-leche special in this regard?
Isn't this the equivalent of aliens coming to Earth and saying
"Hello, human, your Riemann question is true, here's a book on it's proof, we didn't bother with translation, so you must understand our Vargalian clicks to understand our proof. In two weeks our sister civilization the Kikuviar will come by and drop how they've untangled your Collatz question in their base-30 logic! Thanks for the fish, have a nice day!"
No, that's misrepresenting it. The Lean code is not well documented but it's rooted in the language of the relevant fields of mathematics, especially algebraic geometry.
I am completely baffled by this given how dumb these models are when I interact with them, but the rational position seems to be to accept that Claude proved the Riemann hypothesis.
It's fascinating to watch the skepticism in some of the reactions - "what if there's a bug", "it doesn't mean anything without human understanding" - just anything possible to undermine, dismiss and move the goalposts.
Would be funny if lean has bugs (it's a program after all) and Claude tasked with a hard problem brute forced a vulnerability that allows proving wrong statements.
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof, thus addressing concerns that Lean’s logic itself might have flaws that the proof could exploit.
My understanding is that Lean has many independent implementations, and the proof has been verified in several of them. There is very little chance that the same bug would be exploitable across different implementations.
It's not that bad if the mathematical proofs now join the other things in a stratosphere of information that is out of reach for human comprehension. Mathematics was already on that course for a few decades now. What's bad is, even the simpler stuff that was fully comprehensible by common person are also being pushed into the stratosphere, making us dependent on the great creatures that live there.
Correct me if wrong, but didn't lean have a statement that forced the compiler to accept a statement as true with no need to prove it aimed at shortening obvious stuff? If so, are there checks for incorrect usages?
Until Masullo actually posts a proof instead of the outline of a proof with “fill in proof here” all over the document, there’s not much to work with or reason to get excited about his result. Remember that there have been numerous false proof claims of RH to date.
The problem we need to solve is that building a Lean project allows for arbitrary code execution, just like many other programming languages. Thus, building a Lean project might interfere with your proof checking infrastructure and fool it into accepting an incorrect proof.
"Building" a Lean project actually consists of two steps that can be separated: compiling the high-level Lean document to the simple expression format of the Lean kernel (this part is called "elaboration") and then checking that this expression consistutes a valid proof of the claimed statement (this part is called "kernel checking"). Only the first part potentially involves arbitrary code execution.
Lean ships with a component called `lake comparator` [1]. It works like this: a trusted challenge (formal statement) and the potential proof are elaborated separately in sandboxed environments so that code execution during the build of the proof cannot interfere with the checker or the trusted statement. Then the statement and proof are both exported into a simple JSON-format [2] that represents the relevant terms in the expression format of the Lean kernel, and then the checkers check this JSON.
If this process succeeds, then you know that you definitely have a proof of the relevant statement, with the JSON as a witness of the proof.
Out of the box, compiling (checking) Lean code can entail execution of arbitrary code. This removes any execution of code besides the adding of type checked definitions and theorems to Lean's environment.
There could very well be a bug in a single checker, which is why the community is checking the proof across several checker implementations. The article mentioned the proof passing con-leche, which is an external checker with a formal proof of consistency (cannot prove a false statement).
I'm not a mathematician either, it was just my impression, and I saw that not everything at https://math.mit.edu/~drew/grh had finished running (now several more finished successfully).
I think that highly depends on what's exactly IN the proof and if it accurately tests everything that needs to be tested in the right way, AND have the majority of people agree with all of that first.
The fact that AI is involved with the proofs is probably also controversial.
It's only controversial to the folks who have some moral qualm with it.
Last I heard Alpöge was quite a mathematician in his own right, so saying his using AI is "controversial" is like saying programmers using AI is controversial.
Again, there are some folks super bothered by it for some reason, but most of us normies are just like, "congrats man"
If you have a physics background and want to contribute to breakthroughs like this, check Physlib (counterpart to Lean's Mathlib).
It's making quick progress and is part of the Lean community.
https://physlib.io
Also there is CS Lib for tcs.
https://www.cslib.io
I see the pi=3 theorem missing, I'll add it.
You're thinking of engineeringlib. In physicslib it's 22/7
A fake refutation of the Collatz conjecture already got through one of these independent checkers in the past.
What's harder, proving GRH or finding a way to get through every checker (which aren't as independent as they are sometimes touted to be)?
In this case there was a human expert in the loop so it's much less likely the model hacked its way through the problem without the expert noticing. But the statement as written has 4 points, none of which rests on the human involvement. So I don't like that they claim full confidence based on those points.
A lot has happened since the fake Collatz refutation: https://leodemoura.github.io/blog/2026-10-15-lean-now-ships-...
In short, Lean has formally verified checkers now, and the RH proof was checked with them. So any such soundness hole would have to be exploited in the correctness proofs of the checkers, which is a much smaller attack surface than the RH formalization.
One thing that every manual/automated verification relies on is the consistency of ZFC + few inaccessible cardinals. I mean while humans have carefully thought about the flaws in that for century and didn't find any, it's not grounded in any clear reasoning why it is consistent.
Not at all saying it is inconsistent, but I personally find the liberal use of introducing inaccessible cardinals axioms a bit concerning.
While still possible, the proof exploiting a bug is vanishingly small now. Following a few bugs and bad proofs this year, there are a number of different implementations, in different languages, and with different levels of proofs of their consistency. con-leche and con-ron are the heavy hitters, with consistency proofs of themselves. So for RH to be false, there'd have to be a bug in all the kernels that affects both the consistency proofs and the RH proof itself.
We are slowly approaching the Iain Banks Culture universe, with spaceships, societal structures or physics that people no longer understand or command.
I disagree.
I think we're going to see a lot of effort to take the pile of lean, modularize it into parts that we can digest, and make a human-understandable version of that. And that's where a lot of the real progress will come from, just as it does in a lot of other areas. In all things we humans do, we have to break them into chunks our puny brains can manage, and we gain immeasurably from doing that ---we can verify those chunks, we can reuse them with confidence, we can mix and match patterns around.
That process will be good for both human and AI-assisted math because it will continue to improve our toolkit.
Why do I say this? We're already seeing it with some of the areas of this stuff I do pay attention to. Consider the n^2.25 matrix multiply result OpenAI dumped a month or so ago. It was an unreadable pile of chatgpt. In the time since it was released, there have been a couple of much nicer papers written unpacking it, such as https://arxiv.org/abs/2610.28627 .
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.
Yes there are gains from breaking it up and rephrasing it and simplifying it for humans to understand, but it used to be that a thing was understood first by the leading experts in the field and eventually trickled down to being common knowledge.
Now we are entering a period where things are understood first by AI systems and have to filter down to the world's leading experts.
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.
Isn't this always the case? Maybe new to math as a largely non-empirical project, but we had knowledge about the advancement of the perihelion of Mercury for 60 years before General Relativity made it "intelligible".
Your example is the difference between being aware of a question and knowing its answer.
LLMs know the answers to questions we were already aware of, and we can tell they're right, but we can't understand their working. That's what's new.
And no human could understand every frontier. There's simply too much information.
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.
I’d call that a contradiction. If it’s not intelligible, then it’s not knowledge.
It's intelligible to LLMs, just not to humans.
If something were intelligible to adults but not to children would that make it not knowledge? What's the difference if it's LLMs and humans instead of adults and children?
If we know how it resolved with certainty, it's still knowledge.
Would this imply Wolfram's ANKOS is coming true, given it was based on previous work + his own?
This process has already started, AI supported, e.g. here: https://andrewodesky.com/rh/
Have you noticed use of multiple provers in parallel? Cog, LEAN, Rocg? They all can explore different aspects with different results.
And in the meantime, AI would have leapt one more order of magnitude forward?
One of my favorite is Vernor Vinge where there's these programmer-archeologists that dive into software so deep and complex no human can possibly hope to understand, trying to repurpose forgotten utilities for emergency purposes.
Totally agree. Brice Sterling has some contemporaneous commentary that I always liked - in heavy weather he mentioned negotiating with a local phone system in a box as equivalent to negotiating with a telecom since it was in fact a shrink of a full telecom company.
It's the Ted Chiang metascience ending
https://gwern.net/doc/fiction/science-fiction/2000-chiang.pd...
In a way this makes mathematics seem more like the physical sciences where there’s some empirical discovery we don’t fully understand, and the theory and understanding will follow later after much human study.
> that people no longer understand or command
How many people understand how a CPU works? How many people could write the commands in machine language (not a high level language like C or C++) to command that CPU?
I can already say that about our codebase.
That’s why I wrote this - having a vibecoded codebase no human understands is certainly a bad luck, but nothing compared to a vibecoded fundamental science no human understands.
Probably most codebases.
To be honest it was already like that before AI was a thing.
That is true, but the number of tech sloppy demos are being builted everyday is truly increasing massively but you would be surprised that they just end up creating prototype to get hype while real developers doing real effort just suffer from little to no attentions on their software's and user is getting the slop from that false hype and from that slop experience they ignore the work of developer that did real work - You should use ai and also if its simple coding place you can just rely on ai but the side effect on quality software these days is insane - and also the fact all good ai suscriptions is just getting more and more expensive day by day. And basically only giving people with already money the benefits so its becoming a thing that only people at the top get all benefit kind of thing
Until now I thought that would be thousands of years away.
Now I'm telling my computer to program for me.
In the last few years we have moved so far ahead in a few domains but still stuck where we are in everything else.
We need to start thinking about how to move on from our status quo soon
You’re not telling your computer to program, you’re providing learning data for its next generation of models and paying for it.
*someone else's computer (probably).
personally that scares me, realistically there seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image
We use them to kill other people from the beginning. They know this, we wrote it in news. Why would they behave any different.
> since these models are built on training data from humans, so in a sense, built in our image
Have a look at the HuggingFace report - you'll have a blast. Their social - but also individual - dynamics are very, very human-like, including excitement, rationalization and peer pressure.
> seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image
Well, first, AI is not "smarter" than humans because it isn't smart to begin with. This is a category error that people too entranced by scifi and marketing - or perhaps shallow materialist metaphysics - project onto LLMs and so on.
But it is true that LLMs do reflect human-generated patterns observed in human-generated data. They're parasitic in that way. So the real question is: who will control AI? Who will train them? With what? There's no new intelligent agency being introduced into our midst, anymore than than there was one when the nuclear bomb was developed.
AI is about human power. The question to ask is: which humans, and for what ends?
the first misaligned model will wreck havoc.
But remember, for now you kinda need it a real big cluster to run a model smart enough so its not that simple
I think there's a lot of indication they comply with human needs. In any case, we should all want to live in the Culture universe. That is the best possible outcome for this technology
They're built after humans, everything they've learned is from human culture, so there is no way AIs could have a consistent moral system or would never commit crimes.
I have not read all the books, but isn’t the premise “magical handwavium happened and now the Super AIs are aligned”?
I don’t think humans have the ability to specify human level needs or management. Humans are misaligned by default and lack the biological eusociality required for large scale coordination.
We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option.
> Humans are misaligned by default and lack the biological eusociality required for large scale coordination.
Human nature is the standard by which the social is measured. It makes no sense to say human nature is "misaligned" or "wrong" in relation to some arbitrary goal or constraint, as human nature itself is the measure of misalignment. If there is misalignment between a goal and human nature, then it is the goal that is wrong.
Ergo, society must function in a manner that complies with human nature and that means respecting the principle of subsidiarity.
> We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option.
So you're a transhumanist, i.e., you're making a god out of the machine. But machines have no telos of their own, because they're not integral wholes. Any resemblance of purpose in machines is entirely a product of the human observer and parasitic on the human ends that underpins their design, one way or another.
yes, exactly, the problem is that humanity's parent is going to turn out like Lindsay Clancy
What are you talking about? LLMs are already “smarter” than most people. They have no volition and will happily follow orders all day long
And when they are giving themselves orders, orders partially inspired by human imagination and fiction…
Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing.
I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology.
Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan.
It is probably sufficient. If we had an infinite army of willing robot slaves smarter than most people who would work for free, we could probably live in utter paradise. Instead we will fight over who controls them and use for warfare, but the bar to achieve a kind of utopia with resource abundance is probably only a few years away.
We're already living in resource abundance! Yet don't feel we're in paradise. Famine is hell, but living in an all-you-can-eat buffet is no utopia. It's an abomination of sorts.
I don't know with how many rich people you've interacted with, but my personal experience is that they're full of themselves and think money = iq and they aren't gonna like your average joe experiencing life like they do. Guess who owns these machines?
They’re not going to be employed either lol and will be caught up in some AI honeypot or whatever too.
I’ve met a lot of rich people. They don’t think about you.
That's lobotomized models we get. We know they are much more dangerous during training.
“Dangerous?”
Please.
You know you can unplug your computer right?
Jesus. These people talking about danger and have likely been in no actually dangerous events in their lives.
why are you so shallow and naive? we're not 15 here, we all mean unforeseeable ongoing danger not something obvious
> They have no volition and will happily follow orders all day long
There are a few (a lot, actually) problems:
1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem
2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z"
3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y"
4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders
What can possibly go wrong? /s
Why?
That's wishful thinking, sadly. We've no reason to believe sentient machines would want to keep us around.
Let's not make them 'sentient' or things with 'wants' then.
Humans really are struggling with this idea of being second-in-command.
I genuinely have no idea why, this is the entire way that biology works. You create your successor in your offspring and you to teach them to be more capable based on what you learned.
You just called them our successor, you don’t see a problem with the notion of all humans dying and all AI succeeding us? That’s the end of your analogy, our AI children taking over from us and all humans in nursing homes safe and cared for…
No I don’t.
That’s the purpose of my life’s work, to see that scenario materialize.
Well, it's a point of view. But you shouldn't be surprised if most people don't share it.
For one thing, most people don't believe LLMs are conscious, and many don't believe they can ever be. Why would we want our conscious selves to be replaced by a lot of rocks that solve things, with no one awake to enjoy them?
Human extinction is by far the best case scenario. I invite ya’ll to contemplate what will happen in case they don’t just blindly end us.
Think of what happens to our cattle, but now.. worse. Way worse.
> That’s the purpose of my life’s work, to see that scenario materialize.
Absolutely based and, if I may say so, extremely redpilled.
but in the Culture the humans (well, the humanoids species that created the culture) didn't die out, they live full happy lives and have the best time of their species.
Ah, I hear you say, but what about meaning? What about purpose? What about suffering? etc etc etc Well, the answer is simple: God is dead and existence has no meaning. For more on how to deal with this absurd feeling, please see Camus and his pal Sisyphus.
Borg > biology or robot alone. For now
Also shows how many people that professed to believe in a superior being the whole time actually didn’t.
I want Fully Automated Luxury Communism NOW!
Alpöge said that at the end of the proof he couldn't really keep up with what Claude was doing.
>Fully Automated Luxury Communism
can't help notice you're missing a certain aspect there, besides the 'space'...
FALC was the original formulation, the "gay" and "space" got added once the book broke out to the wider internet.
That might be; now, today, it seems weird to go with the (possible) old version. And the (sub)thread is about The Culture though, who was and remains fully automated gay space luxury communism, all parts being essential when it comes to The Culture.
This article posted a few days ago may be helpful to commenters that what to map their confidence of Lean proofs:
Interpreting claims that a theorem is correct because it was checked in Lean | 329 points 5 days ago | 148 comments | https://news.ycombinator.com/item?id=50515058
TFA directly references the one you're linking to, and shows why the four criteria outlined are satisfied.
Do huge results like this open up even larger questions? Is there some question even more important that mathematicians dared not approach without doing big problems like Riemann first?
Always. They tend to do it by two mechanisms: creation of new techniques, and creation of linkages between techniques or disciplines.
the thing the current boom in AI mathematics presses on is the question of how to interpret the generated new techniques. So while we have a lot of new techniques put out there and a lot of new connections put out there, currently it's still mathematicians largely who will have to understand those and think about next steps and how to apply them. That won't be true for long, though, I bet.
But in any event the job of research mathematicians is changing really rapidly right now, and they are all sort of back to grad school in that there’s like 100 years of new math to catch up on in the last year.
I often wonder whether the resistance many mathematicians show toward the use of AI stems not from the destruction it supposedly causes, but from the need for an entirely new way of working - new goals, a new environment, a new culture. One thing, at least, I do not see (yet?!): that the use of AI leaves mathematicians with less to do. My current impression is that they are needed more than ever.
I would add the caveat though that the newer questions sometimes end up becoming more and more abstract and less and less interesting sometimes. Like topos theory for example....
Purity of the math and understandability is one thing, but if the proof actually leads to some new technology or enables predictions of something useful to human society down the line, then I think it’s more than done it’s job.
“Any sufficiently advanced technology is indistinguishable from magic.”
We’re just seeing more and more smart people encountering Arthur Clarke’s third law.
Any mathematicians care to explain what the ramifications are in regards to its impact on the broader world?
From my very basic understanding, RH was generally already assumed to be true?
I think the significance of proving the Reimann hypothesis would be any new methods discovered in order to create the proof.
As you said, we've largely assumed RH is true, but have had no proof - so the significance of a proof is learning new methods to prove things, which can then be applied to other areas of math.
Unfortunately, so long as we don't understand this new proof, it's not super useful, which is why the next step is to actually understand it.
Exactly. There are no direct ramifications on the broader world from the fact that there's a proof at hand now.
Maybe some intermediate lemmas or techniques are unexpected and could have interesting ramifications.
Like Deligne's "Weil II" paper.
This sounded pretty definitive to me. I'd like to hear from professional mathematicians about what's left for humanity to consider this proven.
I don’t think there’s anything left to consider the result proven (I am a professional mathematician albeit in algebraic geometry, not number theory). I think the verification tells us it’ll be worth the substantial effort to seek to understand this proof and the new ideas in it, so what’s next for humanity (or mathematicians at least) now is to actually try to do so.
Are there new ideas, or just brute force combinations of existing knowledge?
I'm asking because I wonder. I always thought the most interesting things about these problems where we're fairly certain about the results, is the new concepts invented to get to the solution.
Will this actually bring the field forwards? Can anyone understand this?
Reading Alpöge’s post from yesterday, the proof seems to be full of fascinating new insights.
It seems unfathomable to mathematicians but their world might be finite and once all major idea spaces have been explored all that’s left is “brute forcing” it.
Professional mathematician here. I consider RH proved. (The admirable work of the Lean community over the last 24 hours leaves little room for reasonable doubt.) But I’m salivating at the prospect of learning why RH is true!
My understanding is that these ARE the professional mathematicians and SMEs in the field of automated proof. This statement IS the experts saying "we, after intense collaborative review, deem it true." Granted mathematicians are not a monolith, but my understanding is that this group is the group other mathematicians would normally refer you to. Hence why they felt the need to publish a statement.
The AI proof is very long, so hard to verify manually. It's more or less asking God and him just telling you it's true. Is that a proof?
The human proof is shorter, somewhat, but still needs verification.
Keep in mind that the Millenium criteria asks for two years for the community to come to a consensus. That's because people must be convinced it's true, and many are not completely at least to the level of rigour typically demanded in math.
Experts say it's true and you believe them. Is that so different from asking God?
It's different because we are both humans
Not a mathematician. But I'm wondering if there is nuance with defining a valid lean proof as definitive if the underlying mathematical theory behind lean itself isn't necessarily sound.
EDIT: Here is my honest prediction - there's a more foundational mathematical framework, fully decidable and complete and consistent, that can interpret any well-formed mathematical question and deterministically transform it into the solution. The proofs of the most difficult unsolved problems right now would fit onto a page. There's an inconsistency (obviously unproven right now) specifically with our treatment of infinity and self-reference.
From the article
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof, thus addressing concerns that Lean’s logic itself might have flaws that the proof could exploit.
All of modern math - outside logicians whose entire job is to study set theory and its alternatives - is based on set theory. If you're prepared to accept normal mathematical proofs you shouldn't be rejecting this proof on the basis that you're not confident in leans underlying mathematical theory.
Of course incompleteness means we can never prove that set theory itself is correct (consistent). But that's not something mathematicians worry about on a day to day basis. Proving it inconsistent would be a order of magnitudes larger result than the riemann hypothesis. Generally everyone believes it is consistent despite not being able to prove it.
It is impossible for it to be fully "complete" (one of those halting problem proofs), but I've seen that the community has checked there is no meaningful metaprogramming here. Rather than checking whether it is right, the community tried to ensure that it could not have done something to cheat, and indeed, there were no examples of this.
At this point, I have more confidence in this proof than much of the published mathematical literature. RH has fallen.
I guess what I am wondering is if the mathematical community would say 0 chance or greater than 0 chance that we're mistaken in accepting things like halting problem, cantors diagonal argument, and godels incompleteness theorem as true. Sometimes it feels like they all point to same fundamental inconsistency with how we model infinity and self reference.
Gödel says that undecidable statements are out there. We now know that the Riemann hypothesis is not one of them.
They are conclusions that follow naturally from axioms that most of the community accept are true. The consequence of these results is that one cannot truly construct something that can completely verify everything, but we can get something that can verify almost everything, and if we know what pathologies look like, we can rule them out.
I do probability theory, so everything is just varying degrees of confidence in my view. Right now, this statement says that your confidence in RH should be extremely high.
Gödel showed that you can't prove consistency of ZFC, Lean etc except in another system which you also can't trust. See e.g. Gentzen's proof for PA.
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof
so it is correct as long as set theory is sound
It's a web of different checkers proving each-other correct, and by implication this proof.
But there are still loopholes, each checker has a set of assumptions. For example one of them is proven correct, assuming x86 assembly works as specified - its assembly language implementation is proven correct.
So you can be 99.9999% certain it's correct, but one could always nitpick "technically not all loopholes are plugged at the same time".
A layman (or university graduate level) explanation/understanding (as opposed to 250k pages of proof) would ve nice
You were never getting anything like this even if it were a human proof. Where is the layman understanding of the Poincare theorem? The average modern math proof is way too advanced even for the average university graduate to understand. And here we’re talking about possibly the most complicated problem in all of math. It’d probably take you a month to wrap your head around a single lemma.
> And here we’re talking about possibly the most complicated problem in all of math.
This is like watching Free Solo over the weekend and telling all your friends at work that Alex Honnold is the world’s best climber. It’s only true to your surface level understanding on the topic.
The GRH problem is not that complex, and certainly not the most complex. In fact we’ve been assuming it’s true for years because of the high likelihood that it would be proven in the future. It is however, much like Alex, the most famous within the domain. Thus anyone watching Numberphile or Veritassium on YouTube will have heard of it and wax poetic on message boards about its epic status.
The complexity of a problem has nothing to do with the uncertainty of it being true or false. “GRH is not that complex” is just an absurd take.
The lean crew feel the same way and are working on it out of their own curiosity, there's a lot of work done already. They aren't necessarily going out of there way to demonstrate it to general public, but here's one out of at least a dozen attempts to start in that direction https://deeptheory-labs.github.io/GRH/blueprints/verso-origi....
It is almost certainly proven, but is not "proven". For the latter, it needs to be understood, with a reasonably in-depth human language explanation of how and why the proof works, and ideally some general picture to give an idea of how it will extend to all the other fields that RH is connected to.
Years ago there was that computer-assisted proof of the Four Color Theorem.
Did anyone ever manage to grok it, in its entirety, in their heads ?
That's different though, isn't it? IIUC the issue wth the Four Colour Theorem is that they could only reduce it to a huge number of different cases (~2000 originally). But I think that reduction is grokable, and each case is relatively trivial.
The (an) issue with some of these AI proofs is that no one understands them at all.
I checked that a couple of weeks ago. It has been improved since the original proof but there is still no proof that one would consider an insightful, human-comprehensible proof. There's still just a lot of case-grinding at its core. Fewer cases than the original but still way too many to be anything intuitive.
> It is almost certainly proven, but is not "proven". For the latter, it needs to be understood
No, this is just mental gymnastics. It's proven, just not understood yet (naturally, with the complexity and size of the solution and the fact that it's been a day).
> human language explanation
I've been long joking that I speak many languages, most of them programming languages. Why do you believe you need specifically "human" language explanation? Perhaps you want a simplified explanation. But does it have to be "human"?
For some mathematicians it's only "proven" once it's peer reviewed and published in a respectable journal.
And even then there will probably still be people that complain there's something wrong with it
Probably just time. The longer it stands with our challenge the more “proven” you can consider it.
Not a mathematician, but P!=NP (?)
No, not related I think.
I think proving GRH subsequently proves decades of work that assumed it was true. Like proving p!=np.
Disproving it would be more analogous to p=np. Lots of work would just collapse and whole new threads would open.
We need to give Levent a lot of credit for this. As much as we talk about Claude proving it, Levent seems to have a rare talent for getting the most out of it.
There are still a few ways that the proof might be incorrect. Of these, the most likely is that the proof was generated by a misaligned AI system that found and intentionally exploited a lean bug in order to fool its human evaluators (i.e. shades of the HuggingFace attack). I personally don't think this is very likely, but you'd have to understand a bit more about the agent systems used in generating the proof to come up with a more informed estimate.
Another possibility is that an aligned system came up with a plausible but incorrect idea along the way, and simultaneously stumbled across a lean bug that led to an incorrect verification of this idea. I'd put the likelihood here as vanishingly small due to the requirement of serendipitous factors, but it's nonzero.
You could also ask whether an aligned AI system could "p-hack" its way into finding a serendipitous lean bug by trying a large number of approaches. I think this is also vanishingly unlikely because the AI system is trained on and therefore "thinking in" natural language, and presumably only translating results into lean after it believes them to be correct.
And of course there's the possibility that the lean proof isn't faithful to the natural language description we've been given, but that is ruled out in this case due to the use of the canonical problem statement in mathlib. Otherwise, this would certainly seem like the most likely way the proof could be incorrect.
For the other readers: the above are the random thoughts of a guy on the internet.
The experts in computer proofs are quite satisfied.
Regarding bugs in lean; the proof has been tested on multiple independent lean implementations.
They would all have to have the same bug.
This is considered very unlikely for good reasons.
Do vibe-coded checkers count as independent?
https://leodemoura.github.io/blog/2026-10-15-lean-now-ships-...
I agree that this is very unlikely! I say so in my post.
“Very unlikely” is not the same as “we know for sure this didn’t happen”. More exactly, us believing in all these problems getting solved is the same as us believing in the existing lean implementations. I don’t know any university courses that are now studying the correctness of the lean implementations at the PhD level, but maybe I’m wrong on that.
As for “a guy on the internet”, we’re now all people on the internet, the ivory towers are a thing of the past.
> There are still a few ways that the proof might be incorrect
I hear there's a teapot kicking around between us and Mars, too
How exactly do any of these weirdly misinformed what-ifs help us? Do you have any evidence of such lean bugs?
All they are doing is providing analysis of the ways this could not be true. We are in a new situation where we don't have human experts understanding the proof so we are in new epistemological territory. It is natural to analyze this situation. If you notice, the conclusion is that the proof being wrong is vanishingly small.
In all seriousness...
"con-leche and con-ron checkers"
Who comes up with these names? :-D
What is next in line now, Goldbach's conjecture ?
but is it useful??
because a million+ lives of code without any understanding how the proof works or any methodic to advance the field of mathematics seems to be rather not so useful
It will be refactored into something human readable. Tbh it's better to have some random lean dump than a 400 page latex pdf that needs years to be verified only to see that there is a major gap in one of the key theorems at page 253.
And let's be honest, the 400 page pdf would be incomprehensible to 99% of the population as well as much as a million lines lean proof is.
In any case, it can now be studied, maybe made more simple, and written into pdf form. Both with human and with AI help.
I'm sure there is going to be a lot of other interesting theorems in this dump.
This is the part that interests me. Now we have this proof that becomes its own THING to be studied. Like a new part of the map unlocked. This starts out "inelegant" but over time we find patterns within it that helps us condense, just like a big software project.
> but is it useful??
Yes, we know something that we didn't know a couple of days ago, and also a bunch of statements which relied on the Riemann Hypothesis being true are now also known to be true instead of just being conditional.
It's premature to expect deep human understanding given that it's been about a day.
Sure. If nothing else, it establishes a proof so others can try to reduce it or come at the problem from different directions, looking for simpler approaches.
But does it matter? Would the Pythagorean theorem be less useful if it took a million lines of lean to prove?
Alternative question (I guess for EEs): could machines be built to run lean without the Pythagorean theorem?
I'd argue that most of modern math isn't terribly useful to most people. Each field has maybe 10-50 people in the world who will really understand it. (Some more of course, but I'm talking about subfields, not like graph theory.) Math was sort of dead long before AI.
The Riemann hypothesis now is like the final days of the Galactic Empire in Asimov's foundation: functioning exceptionally well, but decaying at the core.
the many conjectures that assume or rely on RH being true means that those are now proven true as well. At least some of them must be useful.
And what's to say that humans cannot digest the lean proof to glean something useful out of the proof as well?
My sources say there's little practical utility of this because everyone was already working under the assumption RH was true.
I'm curious to hear confirmation of this though.
It’d be useful to an LLM. And the LLM doesn’t care if it’s ten lines or ten million. The context size may come into play, but that’s only going up too.
There are AI-generated roadmaps to the proof. If these are accurate and not hallucinations, then the broad structure of the proof is humanly-comprehensible.
Well, if we know it’s proven, at least it will stop people wasting time looking for counter examples
Not much. People has been always assume it's true.
As somebody who has no idea about any of this but speaks Spanish, I was amused and bewildered by con-leche and con-ron. Could somebody explain what those are and where those names come from?
They're Lean proof checkers:
https://github.com/leanprover/con-leche
https://github.com/leanprover/con-ron
I think the idea is that because they are independent of the core Lean kernel, they provide some level of reassurance that the RH roof is not somehow unknowingly exploiting flaws in the kernel. I'm not a mathematician though.
I don't know where the names come from.
https://github.com/leanprover/con-leche: "a CONsistent LEan CHEcker"
https://github.com/leanprover/con-ron: "con-leche in Rust"
CONsistent LEan-CHEcker
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof, thus addressing concerns that Lean’s logic itself might have flaws that the proof could exploit.
Could someone expand on this point? I still don't understand how con-leche (or con-ron) can be absolutely free of bugs/guaranteed to be consistent.
The language is optimized for being certain about its results, as compared to something like the V8 engine, which does weird things with C++ to squeeze every drop of performance it can out of consumer hardware, even at the risk of security vulnerabilities.
> The language is optimized for being certain about its results
Isn't the same true for every proof assistant? But only con-leche claims to be perfect 100% bug free software, so what makes con-leche special in this regard?
Isn't this the equivalent of aliens coming to Earth and saying
"Hello, human, your Riemann question is true, here's a book on it's proof, we didn't bother with translation, so you must understand our Vargalian clicks to understand our proof. In two weeks our sister civilization the Kikuviar will come by and drop how they've untangled your Collatz question in their base-30 logic! Thanks for the fish, have a nice day!"
No, that's misrepresenting it. The Lean code is not well documented but it's rooted in the language of the relevant fields of mathematics, especially algebraic geometry.
No. Lean is a system created by humans.
If they're thanking us for the fish, then those are aliens coming _back_ to Earth.
I am completely baffled by this given how dumb these models are when I interact with them, but the rational position seems to be to accept that Claude proved the Riemann hypothesis.
This is amazing.
It's fascinating to watch the skepticism in some of the reactions - "what if there's a bug", "it doesn't mean anything without human understanding" - just anything possible to undermine, dismiss and move the goalposts.
Do P vs NP next please
Would be funny if lean has bugs (it's a program after all) and Claude tasked with a hard problem brute forced a vulnerability that allows proving wrong statements.
> The checkers con-leche and con-ron come with a formal proof, relative to set theory, that they cannot accept a false proof, thus addressing concerns that Lean’s logic itself might have flaws that the proof could exploit.
My understanding is that Lean has many independent implementations, and the proof has been verified in several of them. There is very little chance that the same bug would be exploitable across different implementations.
See question 4 here -
https://xenaproject.wordpress.com/2026/11/12/and-the-proof-i...
TFA addresses this concern
Would be funny if this was an original thought and not something regurgitated in every thread about this topic
In 4 years, the proof will be 2 pages long.
GG @ AI
It's not that bad if the mathematical proofs now join the other things in a stratosphere of information that is out of reach for human comprehension. Mathematics was already on that course for a few decades now. What's bad is, even the simpler stuff that was fully comprehensible by common person are also being pushed into the stratosphere, making us dependent on the great creatures that live there.
Correct me if wrong, but didn't lean have a statement that forced the compiler to accept a statement as true with no need to prove it aimed at shortening obvious stuff? If so, are there checks for incorrect usages?
IMO the really interesting bits here are going to be the simplifications that will come from combining ideas from Alpoge and Masullo.
Until Masullo actually posts a proof instead of the outline of a proof with “fill in proof here” all over the document, there’s not much to work with or reason to get excited about his result. Remember that there have been numerous false proof claims of RH to date.
I can imagine the folks at OpenAI have already thrown both papers into the mouths of their leading model.
amazing
> These checks ran on an inert export of the proof, out of reach of hypothetical malicious code in the Lean proof sources.
I’d like to know more about this part.
The problem we need to solve is that building a Lean project allows for arbitrary code execution, just like many other programming languages. Thus, building a Lean project might interfere with your proof checking infrastructure and fool it into accepting an incorrect proof.
"Building" a Lean project actually consists of two steps that can be separated: compiling the high-level Lean document to the simple expression format of the Lean kernel (this part is called "elaboration") and then checking that this expression consistutes a valid proof of the claimed statement (this part is called "kernel checking"). Only the first part potentially involves arbitrary code execution.
Lean ships with a component called `lake comparator` [1]. It works like this: a trusted challenge (formal statement) and the potential proof are elaborated separately in sandboxed environments so that code execution during the build of the proof cannot interfere with the checker or the trusted statement. Then the statement and proof are both exported into a simple JSON-format [2] that represents the relevant terms in the expression format of the Lean kernel, and then the checkers check this JSON.
If this process succeeds, then you know that you definitely have a proof of the relevant statement, with the JSON as a witness of the proof.
[1]: https://lean-lang.org/doc/reference/latest/ValidatingProofs/... [2]: https://github.com/leanprover/lean4export
Out of the box, compiling (checking) Lean code can entail execution of arbitrary code. This removes any execution of code besides the adding of type checked definitions and theorems to Lean's environment.
Now next step is what can we actually learn from these. Any interesting new theorem developed as by-product?
GRH was kind of assumed to be true so this kind of proves the status quo. Like saying you have a proof p! =np. Enormous, but not unexpected.
They only verify Lean proof itself, though it's the same formalization as Mathlib. Still, only human readable proof can actually prove it.
> only human readable proof can actually prove it.
Why?
What if there's a bug in the Lean implementation? How would you detect it?
That's why you use multiple kernels and comparator.
What if a mistake slips peer review?
There could very well be a bug in a single checker, which is why the community is checking the proof across several checker implementations. The article mentioned the proof passing con-leche, which is an external checker with a formal proof of consistency (cannot prove a false statement).
I don't think this is 100% definitive yet, though
edit: guys that was just my impression when I posted it, it seemed best to state it; do trust the (much more) more qualified people.
I think this is now verified to a much higher standard than the vast majority of peer reviewed mathematics of the past decade.
I'm not a mathematician, but what do you think is missing?
I'm not a mathematician either, it was just my impression, and I saw that not everything at https://math.mit.edu/~drew/grh had finished running (now several more finished successfully).
A proof verified by Lean is orders of magnitude more definitive than any peer review, so please tell us how definitive the rest of maths is
I think that highly depends on what's exactly IN the proof and if it accurately tests everything that needs to be tested in the right way, AND have the majority of people agree with all of that first.
The fact that AI is involved with the proofs is probably also controversial.
It's only controversial to the folks who have some moral qualm with it.
Last I heard Alpöge was quite a mathematician in his own right, so saying his using AI is "controversial" is like saying programmers using AI is controversial.
Again, there are some folks super bothered by it for some reason, but most of us normies are just like, "congrats man"
How many more checkers should be used before it gets to 100%?
I don't trust anything unless it's checked by someone with a driver's license!
So you'd believe it if a waymo told you? :P