How refreshing to read the thoughts of a human in a blog post instead of the garbage that LLMs produce. As the writer says about some of their proofs, the problem is not one of style or em-dashes, but something deeper about the writing that comes out of LLMs:<p><i>The problem is it doesn’t make any goddamned sense.</i><p>I'd probably insert a 'sometimes' in there, because many times in small doses it does make sense, it's only when you ask for long form writing/work that it becomes apparent there is no coordinating intelligence there.<p>Interesting just how much of this advice applies to programming as well as to maths:<p>--<p>Skills, agent.md and harnesses are probably a dead-end that will die off as the tools become more capable.<p>LLMs are not good at reducing complexity, however they're very good at adding it, and sometimes it is just unnecessary and he can find ways to cut it by interrogating the LLM.<p>Some people are responding to the new reality by gleefully using AI to generate lots of semi-OK-ish papers and puking them up on arXiv [this is like people producing mediocre one-shot clones of software].<p>On the other hand—with creative writing, my advice is not to use AI to write, at all. Ask questions if you want, but write every damned word yourself.<p>--<p>Definitely worth a read for the programmers here too.
"If you just waited a year, would some other AI produce that same proof independently?"<p>I had a conversation about this very problem last November, with a visiting mathematician. It's essentially signaling a deflationary spiral in intellectual work: why bother doing the work now, when it will take half as much effort a year from now?<p>This is perhaps always a possible stance, but it's exacerbated when some proportion of your own agency is handed over to, well, agents.
This is exactly how I feel. I tell everyone around me who is churning AI papers that the whole thing is pointless.<p>In 1-2 years the AI will give an instant answer to most conjectures anyway.
This might hold up for theoretical intellectual work without any economical value, but if you are researching anything that can be applied to the industry, you will instead have 1 year of market ownership and first-mover advantage.<p>I think it says more about what the value of math as intellectual work is, than about intellectual work in general.<p>Like if an Egyptian historian would come and say "let's wait one year until the methods are good enough to decrypt this language", no one would be bothered or surprised.
“if you are researching anything that can be applied to the industry, you will instead have 1 year of market ownership and first-mover advantage.”<p>I would like to disagree with you on that point. Given the very popular rise of <a href="https://rea.tools/" rel="nofollow">https://rea.tools/</a>, it appears the time to reverse engineer anything software based (up to maybe 80% or more?) could be down to minutes. With a recent example, some indie video game developers are not going to show off their video game until release as a few have been flipped and made it to market before the original developers have. Point being, a few moths of market ownership could be possible if llms can’t reverse it in any way.
First movers often lose though in the market. Relevant to today's news about DoorDash acquiring Instacart for a few billion dollars: WebVan came out a decade earlier (i.e. at the wrong time) and went bankrupt after 3 years.<p>A perhaps more relevant personal anecdote: About a year ago I told a non-technical friend that I'd help him migrate his small business website that was originally set up in WordPress (by a developer who is since long gone) to a format that would be much easier for him to manage with no dev support. I planned to move him over to one of the usual suspects like Wix or Squarespace, but this is one instance where my procrastination was a virtue. In the ~9 months since he originally had an issue with his site, AI capabilities had exploded. Turned out it was a lot easier (and cheaper) to use Claude to fully migrate his site and get it up on Cloudflare workers, and I set up everything so he could manage all the content himself. Plus, it took me less than a day to do the migration off WordPress, and most of that time was just me wanting to learn the ins and outs of Claude Code because I was new to it at the time.
I like this observation very much. Intellectual deflationary spiral is exactly how it feels at the moment and we might end up in a worse place because of it.
That's the theme of this reflection: <a href="https://proofsandprompts.com/2026/10/08/why-i-chose-to-do-math-and-how-im-grappling-with-ai-advances/" rel="nofollow">https://proofsandprompts.com/2026/10/08/why-i-chose-to-do-ma...</a>
The overselling of AI abilities is doing such a disservice to society right now. These companies don’t want to acknowledge how much human collaboration is going into their AI’s achievements because it undermines their value proposition, but I imagine there’s still quite a fair amount going into it and that’s one reason why OpenAI still won’t provide session traces of their models solving open math problems. If they were more transparent about it I think we’d see that human guidance, vision, judgement, taste, and other traits are still highly valuable and complimentary to AI abilities. It should also be a huge red flag how little of any of this output has been formally verified by third parties. I do think AI will eventually do all the things people believe it’s already doing, but I suspect there’s a fair amount of mechanical turking going on behind the scenes as you’d expect any company trying to raise a trillion dollar public offering might do.
related<p>Lex Fridman recent podcast on the AI crisis in math, <a href="https://youtu.be/ZAzWPE9CItg" rel="nofollow">https://youtu.be/ZAzWPE9CItg</a>
What's a Kofuni expansion?
These mournings of programmers and now mathemathicians will as time goes on likely continue to become a part of other fields workers routines as well.<p>I wonder how we as a society will react to this, this crisis of meaning. Not to get into existential crisis if that is to happen as well, which of course is a whole other issue.<p>I assume we will all start to look for social ways of mourning with colleagues.
Point 19, right in the feels :(
This is very similar to how I feel programming.
It’s funny how disconnected we all are from each other. This is exactly how LLMs felt a year or so to many programmers.<p>Useless toys, sometimes useful toys, ok good toys, ok.. we might have to look at this more carefully, oh god.<p>This loop however is quite tiring to watch happen over and over again. Is there really nothing we can do but just watch from the sidelines and watch our fellow men engage in their particular grief and copium filled mourning cycle?
About two years ago, I was at a coffee shop and two maths students were trying to understand a concept in the book. I suggested they might ask a language model to help them understand it. They scoffed at me, called a stochastic parrot, and said they can't do math at all.<p>I responded with, "Well, you don't even need it to do math. It can explain the concept." They scoffed again. "Those things are useless toys"