Something I don’t quite know, maybe someone closer to math can answer this question<p>It seems we’re making tremendous progress on the back of existing abstractions and concepts with the brute force ability to generate language and verify proofs.<p>For example, Tao says about the Riemann proof:<p>> appears to use the full power of modern developments on the Langlands program and arithmetic geometry<p>What I wonder: how do we create new abstractions and concepts? Like whatever “Langlands program” is? That then feedback into the system, and allow for even more sophisticated mathematics.<p>Are we assuming AI will do this? Or does this still need to be something at least agreed-upon by a mathematics community - in the same way programmers talk about a “linked list” without having an hour long conversation to define it axiomatically? And without that social aspect, without breaking down long proofs into Lego block common abstractions, math may plateau? In part because we lose the ability to ask meaningful questions?
This has been ambiguous so far. Most people guessed "the AI can't build new theory yet, but can do insane brute-force, which turns out to be surprisingly powerful, and probably the theory building will get there eventually". I think that in the next 14 days, as this gets processed and understood, there's a good chance we finally settle this.<p>Compare Elliot Glazer a month-ish ago:<p>> I occasionally talk to experts on all the MP's. Their rough summaries on what is needed to solve them usually go:<p>> Hodge: not a clue<p>> BSD: not a clue<p>> RH: not a clue<p>> P vs NP: not a clue<p>> Yang-Mills: "Well..."<p><a href="https://news.ycombinator.com/item?id=50252673">https://news.ycombinator.com/item?id=50252673</a><p>So if we're in "not a clue" territory, maybe that's that.<p>I fear that it gets muddled again with e.g. the concurrent human announcement and that in retrospect RH turns out to be easier than expected, like many other problems before.<p>Math is hard, but how hard math is is also hard...
> <i>I fear that it gets muddled again with e.g. the concurrent human announcement and that in retrospect RH turns out to be easier than expected, like many other problems before.</i><p>The proof in the human announcement is until unverified. I don't expect it to hold water, but to be sure we still have to wait like a month or so to get a few AI assisted analysis. (There are a few pure AI vibe-refutation, but I want to wait until a human checks the AI objections.)<p>>> <i>the AI can't build new theory yet, but can do insane brute-force, which turns out to be surprisingly powerful, and probably the theory building will get there eventually</i><p>A lot of cutting edge math is close to brute-force search, like to throwing stuff to the wall to see what sticks. But at the high level instead of throwing bolts and nuts, you throw BMW and Ferrari.<p>For example, it's very hard to know how hard a problem is when you already know the solution. It's much easier to verify that the solution is correct than imagining how hard is guessing the tricks to solve it.<p>Usually after a big proof, parts are reused by the community to prove similar stuff and followups. After a while, the tricks get a name, perhaps lemas are upgraded to theorems, and they may get their own book or course. It's similar to refactoring in programming.<p>From Andrew Wiles:<p>> <i>Perhaps I could best describe my experience of doing mathematics in terms of entering a dark mansion. You go into the first room and it's dark, completely dark. You stumble around, bumping into the furniture. Gradually, you learn where each piece of furniture is. And finally, after six months or so, you find the light switch and turn it on. Suddenly, it's all illuminated and you can see exactly where you were. Then you enter the next dark room...</i>
I think most won't be understood in 14 days; but ofc ai can make theory now
CAVEMAN SUMMARY: AI no need theory, only people need. Fable understand OpenAI math. Fable explain well to human. People the problem, not AI.<p>I was reading a mathematician's take on a recent OpenAI proof (their area of expertise). They argued that models don't lack theory building, they just work at such a high level of abstraction that they don't need it.<p>Theory is for us, so we can understand what the models are doing. They gave the example of Fable, which understood and explained everything perfectly right away (written by OpenAI's unreleased model in terse mathematical notiations).<p>This was totally intuitive for the AI (Fable), but it took this person two weeks just to get a high-level grasp of it. And this person is one of the few people on earth who can (he is an expert in this niche of mathematics).
I imagine more semantically comprehensible proofs benefit LLMs as much as they benefit humans, from a time/energy/iq perspective.<p>Ergo, there are likely numerous deeper insights that will emerge when smarter models have the chance to go over brute forced, millions of line Lean proofs. Likely things humans have not conceived, but I believe will truly advance understanding. Post-train the existing models with that knowledge, and see them resolve these same problems with far less effort.<p>Just a hunch. I'm neither an AI researcher nor a mathematician.
Just for the benefit of others, are you referring to this?<p><a href="https://web.maths.unsw.edu.au/~davidharvey/research/subnlogn.pdf" rel="nofollow">https://web.maths.unsw.edu.au/~davidharvey/research/subnlogn...</a>
Humans experience reality, and as they do so they gradually build maps—models—that allow them to reason about it with less overhead. Those maps are hopefully useful for some purpose, but also necessarily wrong/incomplete.<p>LLMs <i>only</i> operate on our pre-existing maps in their training dataset. (The first “L” is the key: language is itself a map.) They may be useful at refining those models, but they do not experience and therefore cannot get us to the next peak over.
> This was totally intuitive for the AI (Fable)<p>I'm regularly getting replies from a Fable-related model about our code base and problem space which would suggest that it totally inuitively groks it when it confidently explains and asserts things, and more often than I'd like it turns out that it's wrong, the thing is actually different and/or more complicated than what it made it out to be, and when I point that out it apologizes and agrees with me, rinse and repeat.<p>I'd be <i>very</i> careful with such claims. LLMs have been around for long enough for us to still fall for its confidence.
This is weird, so you think letting agent loose with "solve cancer, and giving them unlimited compute, with no further guidance, will yield results??<p>People seems to have lost their sense of judgment. It was the same with Deep Blue and AlphaX, the world's problem did not end. If we are to make progress in many field, it is still people who will have to build new theories, etc.
I thought theory building WAS the process of creating powerful abstractions?
Open question - are these proofs brute forcing, or are they generating new theory at a level of abstraction and complexity we can't understand?<p>Controversial statement: I think we've always done math by generalising from concrete experience. So concepts like numbers, spaces, shapes, distances, and curvature are based on physical experiences we use as anchors before expanding them far beyond physicality and looking for patterns in the abstractions.<p>If AI is generalising from patterns in latent space, that's a different kind of abstraction, and one that's much more alien to us, because it's going to be much, much bigger - too big to fit inside even the smartest human mind.<p>So AI theories and abstractions may be valid in true/false terms, but we will never be able to comprehend them in their raw form - just as we can't experience latent space directly, and will only experience tiny slices of it as outputs to our queries.
> If AI is generalising from patterns in latent space, that's a different kind of abstraction<p>How's latent space conceptually different from neuronal activations in our brains?<p>> just as we can't experience latent space directly,<p>Your LLM also doesn't "experience" their activations in the latent space either when generating tokens.<p>I'm not saying LLMs are not conscious/sentient/etc. Just saying if you ask your LLM which activation was stronger that led to a particular solution, they won't be able to answer without using external tools to inspect it.<p>It may just be that LLMs have such a huge context window (short-term memory) compared to humans, that they can process a lot more raw data without having to compress them into theories yet.
Then It's just a case of unambiguously defining the question, and getting the model to explain the answer.<p>I swear, if it says 42, I'll be laughing.
The recent progress in AI maths I think has made it a lot more obvious and visible what maths is at its core: The study of interesting patterns that emerge from the consistent application of simple rules.<p>It's quite similar to the Game of Life and the community around it that tries to find interesting ever fancier gliders in that way.<p>The thing about maths though is that what counts as big and interesting is socially determined and chosen by the community over decades or centuries.<p>It remains to be seen whether human mathematicians will be content with also having the AI decide what's interesting.<p>One possibility I suppose is to find an objective definition of what's interesting, e.g. some sort of centrality score to a theorem within the tree of theorems it enables.
A lot of people have raised the possibility of math may plateau because humans no longer have the insights for new abstractions, but the truth is nobody knows.<p>Langlands is interesting because it is most conjectural (and not completely clear what the precise statements are -- hence "program" and not "conjecture"), but proving special cases turn out to be tremendously powerful. One special case implied Fermat's Last Theorem, for example.
I feel it is the same in computer security, it will be interesting to observe for both, if among the proofs remaining to make or new, if a human could make them whereas models weren't able to do so, and in sec what new bugs are found that models couldn't. Also it would be interesting to see if new classes of proofs or bugs resist, despite their attempted learning to the models once known. Could something resist to their learning? Is there something human could durably do that models or future models can't?
The Langlands program is as old as 1967, it translates hard problems in number theory (like primes and polynomials) into problems in geometry and harmonic analysis (like symmetries and waves), where we have other tools to solve them.<p>The Langlands program just makes sense. The best most succinct definition of the set of real numbers can be put as "a complete ordered field." We usually experience them as decimals and infinitesimals, etc but when you think about them in the context of those three meaningful, powerful words you realize harmonics and geometry make so much sense. And also how primes etc are connected to quantum
Chat is this woo?
No. It's about connecting two areas/domains of mathematics.<p>An example would be how you can specify complex numbers in multiple forms:<p>- as a (real, imaginary) pair using the definitions of operations like addition and multiplication;<p>- as a 2x2 matrix, with 1 and i having matrix representations;<p>- as a 2D vector (angle, magnitude).<p>The idea is that if you prove something in one area you can apply that proof to the other domain using the equivalence mappings without having to prove all of those in the target domain. The basic construction is:<p>- have the problem in domain A (e.g. a complex number in (re, im) form);<p>- apply mappings converting domain A to domain B (e.g. representing the complex number as a 2x2 matrix);<p>- apply the proof from domain B;<p>- apply mappings converting domain B to domain A;<p>- QED<p>In a way, the Langlands program is like a subset of Concept Theory.
Given what we've seen, I see no reason to think that AI couldn't produce meaningful abstractions like perfectoid spaces or rough paths, and even give them memorable names. The pertinent issue to me seems to be the opposite of your concern. Right now, a scenario of 'runaway math' seems conceivable, where machines produce ever more complex results about ever more complex abstractions. At a rate exceeding the capacity of the human mathematical community to comprehend (the capacity limit might also be just physical - even if every single result could still be understood by humans, there might not be enough humans who care with enough time to go through all of it). The more real constraint seems to be economical, as in who would dedicate the hardware and energy to producing the math, and why would they make the results public.
In this case, deepening our math knowledge becomes an empirical process like a physical science. We have reams and reams of 'truth' in the physical universe, but nobody knows what its or how it connects to our current understanding. Now, mathematicians exist to empirically probe and test their assumptions against this massive 'physical' edifice of endless proven, interconnected maths like trying to understand the chemistry of a human cell.<p>It's there, we can observe it, but we still need to study it / take it apart to be able to explain it.
It's highly probable that each AI proof will basically produce its own abstractions, since it doesn't need to establish a "research program" that should be "understood" by the "community".<p>Maybe we'll use AI to read through all these AI proofs and write them in a common language as "lectures" for the 3-4 people who will still be "interested" in learning new "math" (I count myself among them).<p>(Sorry for the abundance of scare quotes.)
> It's highly probable that each AI proof will basically produce its own abstractions<p>I am not looking forward to the further silo-nation of math, where even the abstractions live only in one small area.<p>I think your later comment clarifies that you see this as a negative.<p>We build abstractions to transport understanding across fields. It is plausible to me that in some huge proofs (like FLT), there could be a role for proof-specific abstractions. In general, though, a lack of abstractions that cross boundaries makes me think the abstractions are not sufficiently powerful/useful.
What? Virtually everyone who writes a math paper "produces abstractions" in the course of doing so. It's a more routine and mundane activity than perhaps you are imagining.<p>The scare quotes are indeed doing a lot of work here -- for instance, I read the ones wrapping "community" as implying there won't be a mathematics community that will need to understand new research, which is a fairly bold claim deserving some justification.<p>You should try being a bit more explicit in general. Particularly so, given that this is a domain and community that you don't seem especially familiar with. By that I mean "be explicit about what you mean, clarify your analogies -- better yet, avoid them until you understand the topic deeply -- and define important terms"
Exactly like in commercial work - dark forest, where swarms of hungry AI equipped copycats are swarming to steal and exploit any original idea anyone has, thus demotivating anyone from coming with ideas.
Nobody knows the answer to that question, we are discovering in real-time what frontier mathematicians and frontier AI are able to do to solve previously unsolved problems.<p>That being said, its probably going something akin to how experimental and theoretical physics have an interplay with each other.<p>Can we develop more and more all encompassing abstractions (theories) that explain and verify experimental results; translates to, can we come up with more and more theorems/abstractions that explain formal proofs (and perhaps provide explanations for other known proofs)? Probably yes, and likely will also be accelerated by AI.<p>How this fits into the discipline of mathematics is something we are currently finding out.
It reminds me of the old movie "Pi" (a good movie). A crazy mathematician finds a new transcendental number and people are chasing him to try to get it because it's so powerful.<p>He tells them "I could give it you, but you wouldn't know what to do with it."<p>A new proof doesn't really do anything on its own if we don't know how to make use of it. It's like handing a set of Vernier Calipers to a Chimpanzee. The growth and innovation from developing the proof is where the real value is.
Langlands program[0] was proposed by the Canadian mathematician Robert Langlands (1967, 1970) seeking to relate the structure of Galois groups in algebraic number theory to automorphic forms and, more generally...<p>[0] <a href="https://en.wikipedia.org/wiki/Langlands_program" rel="nofollow">https://en.wikipedia.org/wiki/Langlands_program</a>
> What I wonder: how do we create new abstractions and concepts?<p>By keeping mathematicians on the payroll and letting them do their jobs. It's always been their primary objective and it will continue to be.<p>> Are we assuming AI will do this?<p>It can't because it is fundamentally about asking questions about what we as humans find interesting.The machine can't know that. It could <i>suggest</i> questions and it can help answering them. But what is "interesting" is fundamentally subjective.
> What I wonder: how do we create new abstractions and concepts?<p>Mathematicians are already afraind they might not undestand all of the applications of existing concepts. When completely novel things without names start poping up they will be completely freaked out, like go players over the move 37.
My take on this is that new abstractions and concepts are sort of efficiencies you may use to tackle a problem. The more abstractions you have, the less energy you need to come up with a proof. So its like a spectrum.<p>One of the things I wanted to understand or simulate was, can we remove some abstractions and concepts and come up with a proof of some conjecture like Fermat's Last Theorem? I assume this proof involved a lot of modern abstractions. But if we can ask Claude to use only rudimentary concepts that a high school kid knows, could we come up with a proof that, while possibly huge, is correct?
LLMs are great at ‘seems’. the big question is, is it real? I’m automatically suspicious when the proof is 250k pages long.
Put these new proofs that are being made into the dataset for training the next model. Just use the bitter lesson and increase the amount of proof data.
Of Outsourcing the brute forcing the parts one struggles at leaves more space for exploring what’s left.
> Of Outsourcing the brute forcing the parts one struggles at leaves more space for exploring what’s left.<p>Except the tasks are probably not so neatly divided.<p>* Exploration and insight might be a <i>side effect</i> of a human doing "brute forcing."<p>* AI may vacuum up all the intermediate successes and quick wins that keep people motivated, making it practically impossible for a person to "create new abstractions and concepts" at the frontier.<p>* etc.
>Are we assuming AI will do this?<p>Yes.