22 comments

  • hansvm1 hour ago
    Derailing slightly, a variety of HN posts (the blogs/sites they reference) have started banning me with a 403 page from nginx, including this author. My IP reputation is supposedly fine. Does anyone have any ideas where I should look next?
    • hansvm3 minutes ago
      Responding to other comments here:<p>- Mobile internet (IP 172.56.47.136)<p>- The haveibeenproxied link indicates my IP is shared (expected)<p>- This is stock android&#x2F;chrome with a DNS blocklist of advertising domains and some invasive Samsung the things I can&#x27;t fix on the device (I doubt that&#x27;s the culprit given that this is a new behavior I&#x27;m observing in the outside world after 8yrs with those settings and also because it&#x27;s be strange for nginx to be the thing to immediately report that trackers have to load for me to get a glimpse of the main page, especially as something I&#x27;m seeing across multiple sites, but that&#x27;s not impossible).<p>- No VPN<p>- I&#x27;m a &quot;normie&quot; internet user. Anything remotely questionable to even the cheapest and least aligned of LLM judges and executioners happens on non-home networks.
    • cyclotron3k38 minutes ago
      Are you using a VPN?
    • furst-blumier1 hour ago
      Depends on what you do? The site loads fine to me and you gave no indication what your originating IP space is being used for. As a residential user without anything but &quot;normie&quot; internet usage (reading blogs, watching yt) I experience no interuption. Are you a &quot;normal&quot; residential user as well? Then you might need to bring it up with your isp
    • RIMR47 minutes ago
      Check if something on your network is running malware. You might be part of a DDoS botnet, and other services might be running something like fail2ban.
      • privacyishuman41 minutes ago
        <a href="https:&#x2F;&#x2F;haveibeenproxied.com" rel="nofollow">https:&#x2F;&#x2F;haveibeenproxied.com</a> is scarily effective for checking if your IP is in a proxy network.
    • Traubenfuchs49 minutes ago
      Which browser?<p>Bidi &#x2F; remote control enabled?<p>Special plugins? AdBlock?
  • hoppp2 hours ago
    Thats a lot of lean. Can anyone comprehend how it works in it&#x27;s entirety?
    • rcxdude2 hours ago
      There&#x27;s a top level sketch of the proof in the paper from the guy who&#x27;s claiming the proof. It seems like he feels he understands it, at least.
    • abm531 hour ago
      In one sense, it doesn’t matter, as long as we comprehend enough to be sure the lean proof encodes the hypothesis and all axioms correctly.<p>But in another sense, such as whether it adds to our understanding, of course it does matter.
    • jordemort2 hours ago
      at what point does this become functionally equivalent to coming down from a mountain with a couple of stone tablets and saying &quot;God says&quot;?
      • noosphr1 hour ago
        If we can trust payroll to a database instead of insisting someone do all the calculations by hand there is no reason to expect other forms of symbolic manipulation to be vastly different.
        • wpietri44 minutes ago
          That&#x27;s actually a great example of something where we don&#x27;t and shouldn&#x27;t trust computers. E.g.: <a href="https:&#x2F;&#x2F;www.kqed.org&#x2F;news&#x2F;12051862&#x2F;sf-teachers-are-yet-again-having-payroll-issues-just-after-launch-of-costly-new-system" rel="nofollow">https:&#x2F;&#x2F;www.kqed.org&#x2F;news&#x2F;12051862&#x2F;sf-teachers-are-yet-again...</a><p>We can and should trust computers for the straightforward, boring parts. But there&#x27;s a huge gulf between the people who think, &quot;how hard could payroll be?&quot; and actually making a system that handles all the interacting complexity of real-world problems.
        • someothherguyy1 hour ago
          calculations and operations are transparent to a database, and they very easy for a human to understand and verify
          • noosphr1 hour ago
            So is natural deduction when you treat quoted expressions as first class citizens.<p>The difficulty of doing proofs in mathematics is largely due to the fact that mathematicians refused to treat symbolic expressions as data and had to invent ever more complex paradigms to deal with them.<p>Lean being the final iteration of that trend.<p>When you add quotation and quasi quotation on top of Polish notation proofs become as mechanical as long division.
            • mypalmike1 hour ago
              Can you explain this further? Can you point the interested reader at books or papers that would help understand the approach you are advocating?
              • noosphr44 minutes ago
                If I ever get the time writing a book called the structure and interpretation of mathematical logic is on my to do list.<p>There are unfortunately no books on the topic currently, because very few people take syntax seriously enough. This is rather ironic as computer science is only possible because someone took syntax seriously enough to invent place value notation.
            • catlifeonmars32 minutes ago
              A LISP for symbol manipulation? I definitely don’t hate it.
            • someothherguyy29 minutes ago
              i don&#x27;t think mathematicians have avoided proof assistants, being that they have been around for over 50 years (<a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Automath" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Automath</a>). however, as to my point, i would wager most payroll systems don&#x27;t express a single verification as 400kloc of SQL statements.<p><a href="https:&#x2F;&#x2F;principia-math.com&#x2F;projects&#x2F;d16ab288ed353bc5b10e292ace0ddbc1&#x2F;notes" rel="nofollow">https:&#x2F;&#x2F;principia-math.com&#x2F;projects&#x2F;d16ab288ed353bc5b10e292a...</a>
        • Lambdanaut1 hour ago
          Except databases are understood deterministically. The route an LLM will take, given an input, is not.
          • noosphr1 hour ago
            The post was about lean, not how the lean code was generated.
          • overboard21 hour ago
            That&#x27;s why LLMs are often made to generate proofs in Lean.
        • billyp-rva1 hour ago
          Everyone gets a line-by-line paystub every period that fits on, what, half a page? That&#x27;s a far cry from 17 million lines of code.
          • noosphr1 hour ago
            Depending on the company 17 million lines of expenses per month are either normal or a fraction of the total.
      • Lerc2 hours ago
        It does not. If after careful analysis people conclude that they cannot tell if it says what it claims to say, then then it can be considered not-a-proof until someone can demonstrate in a convincing manner that it is what it claims to be.<p>I can say god exists because 5&gt;3. No matter how valid my claim is that five is in-fact greater than three, if I can&#x27;t convince people of the connection it&#x27;s a valid proof of something, just not what I say it is.<p>It might be true that if the Riemann hypothesis is false, leaves cannot fall to the ground. That would mean a falling leaf demonstrates the truth of the hypothesis. Without showing people why it must be the case in a way they understand it falls short of a genuine proof.<p>That would make proofs subjective, and I think that is true. To many people Pythagoras has not been proved, they just believe (correctly) there is a consensus amongst those who do understand the proofs.
      • interestingsir2 hours ago
        For the rest of us it already is like that..
      • idiotsecant1 hour ago
        You not knowing how to interpret the results is not the same as nobody knowing how to interpret the results. Formal proofs with very dense lean implementations have been a thing for a long time, it wasn&#x27;t &#x27;god on the mountain&#x27; then, either.
      • twoodfin1 hour ago
        It matters a great deal in several fundamental ways that Moses didn’t also have a valid Lean formalization.
      • Jyaif2 hours ago
        It doesn&#x27;t really work because <i>we</i> are god, and the AIs are our creations.
  • elorant3 hours ago
    Wonder how many mathematicians could reach similar breakthroughs if they had near infinite compute.
    • henry20232 hours ago
      The first working transistor was invented 79 years ago, I bet we’ll consider today’s total compute trivial in another 80 years.
      • lossolo21 hour ago
        Aren&#x27;t we approaching the limits of physics, with increasingly diminishing returns each generation? I remember reading an article about quantum effects at these scales, which make everything much harder. I mean, for example, even if we double the speed at which we can travel every year, you will never get to Alpha Centauri in your lifetime
        • thombat51 minutes ago
          The overall point is sound, but in fact if we could double our speed every year then in just 23 years we&#x27;d get from 100km&#x2F;h to the speed of light
        • dist-epoch1 hour ago
          We are approaching the limits in a single chip. But we can add more chips, millions of them, billions of them. Gigawatts of compute.
          • twoodfin56 minutes ago
            Right. I’m sure at some point in the past more capital was spent on designing better airplanes than on building them &amp; the infrastructure to support them.<p>We still spend money on designing better airplanes, but the two lines on that graph crossed long ago.
      • RAWGOD2 hours ago
        &gt;I bet we’ll consider today’s total compute trivial in another 80 years.<p>Past performance is not indicative of future results. Airliners are still subsonic after a 100 years of aviation.
        • betterunix22 hours ago
          &gt; Airliners are still subsonic after a 100 years of aviation<p>That is a deliberate decision motivated primarily by economics and secondarily by environmental concerns. In fact airliners today are somewhat slower than they were a few decades ago because the lower speeds are more fuel efficient. We certainly could build fleets of supersonic airliners if it made sense to do so, it is not as if we have no idea how to do it and in fact we built supersonic passenger jets once upon a time.
          • recursive2 hours ago
            Yes and? we can make deliberate decisions motivated by economics regarding computation as well.
        • Maxatar2 hours ago
          Your example contradicts your point. Airliners are still subsonic after an extended period of time, and hence based on that past performance it&#x27;s a good indicator (although not definitive) that they will remain subsonic for an extended period into the future.<p>In general, past performance is actually indicative of future results. It&#x27;s not definitive, and some phenomenon are random, but the trajectory of technology over time is not some random fluke that just has coincidentally trended by random chance.
          • RAWGOD2 hours ago
            &gt;Your example contradicts your point. Airliners are still subsonic after an extended period of time, and hence based on that past performance it&#x27;s a good indicator (although not definitive) that they will remain subsonic for an extended period into the future.<p>There was a period in aviation development when it was widely assumed that speed will continue to rise. Just like in the development of CPUs there was such a period, quite recently.
        • szvsw2 hours ago
          But along other axes they have also improved tremendously, no? Ie rather than just time to destination, they have greatly improved efficiency (energy spent per unit of work) and throughput&#x2F;parallelism (ie simultaneous flights in the air) right?
          • RAWGOD2 hours ago
            Yes, but these axes are also not showing an unlimited growth. There is no expectation that either speed, fuel efficiency, ticket price, or total number of flights will improve by an order of magnitude in the foreseeable future, unless there&#x27;s a technological breakthrough (Nuclear turbines? Artificial photosynthesis making kerosene free? 3D printing the entire plane? These are currently all sci-fi ideas).
          • cyanydeez2 hours ago
            but it&#x27;s still just people in a tube.<p>Sure you&#x27;re going to get a lot of math problems solved, but food distribution is still going to be stuck by warlords and oligarchies.<p>Think of it like highway designers and the &quot;one more lane&quot; gridlock delusion. In this case, it&#x27;s more will smith eating speghetti than cheap, low cost cancer cures.
        • bartread2 hours ago
          &gt; Airliners are still subsonic after a 100 years of aviation.<p>Yeah, but that&#x27;s a choice made for very good reasons:<p>- Noise reduction<p>- Fuel efficiency<p>- Reduced pollution and lower environment impact<p>- Reduced cost of materials, equipment, and maintenance<p>- Passenger affordability<p>It&#x27;s not that we can&#x27;t make supersonic airliners or that the fact we don’t illustrates a lack of progress or performance: it&#x27;s that it doesn&#x27;t make economic or environmental sense to.<p>Gulfstream and Sukhoi even had a partnership to develop a supersonic business jet (which, if you look at the mockups, might be one of the coolest looking planes ever conceived) but they gave up after spending a fairly enormous amount of money already because it was going to cost an absolute fortune to bring to market... and there was no real market for it.<p>EDIT: the responses I’m getting are a bit weird. People are putting words in my mouth but all I was actually doing was pointing out the the example used wasn’t a great illustration of the point the person I was responding to was making. This isn’t Reddit so maybe we could reign it in a bit, please?
          • rafaelmn1 hour ago
            That&#x27;s kinda the point I think ? It&#x27;s not like we can&#x27;t turn half of global energy production or GDP to compute - it&#x27;s more about does it make sense to. As much as I&#x27;m getting value out of this technology daily - the level of investment made to get this far is astronomical compared to the value I&#x27;m seeing created, even less captured by these companies. And because the progress is so good in some domains it&#x27;s easy to believe that these things are magically reaching some intelligence generalization threshold. But then you leave the training distribution and you get disturbed by how poor the performance is and how obviously equivalent things don&#x27;t automatically transfer at all. Given the recent market trends I would not be surprised we see a correction in level of compute investment going forward.
            • FloorEgg1 hour ago
              The universe seems to be set up such that it wants entropy to increase. Any living thing that doesn&#x27;t profit from converting low entropy energy to high entropy energy dies.<p>So the question is whether more intelligence will lead to faster increase in entropy. My guess is it will. Whatever recent market trends are, they are irrelevant. Whether the AI can or can&#x27;t do x thing is irrelevant. What matters is whether the companies that make AI profit from making AI, and if you look closely at what&#x27;s going on it sure seems like they do. If you think otherwise it may be because you&#x27;re reading headlines and propaganda articles and not digging into the fundamentals.<p>So maybe we have a temporary correction&#x2F;slow down, because these companies took on too much leverage and grew artificially too fast. That&#x27;s very possible. In the big picture long term it will be a blip. The universe seems biased to increasing the volume of intelligence and I have never heard a compelling case for why this wouldn&#x27;t continue for a long long time.
            • pixl971 hour ago
              &gt;It&#x27;s not like we can&#x27;t turn half of global energy production or GDP to compute<p>That depends which part of &#x27;we&#x27; is running the economy. Just imagine an economy that makes mass massive amounts of money but doesn&#x27;t align with human needs.
          • bayindirh2 hours ago
            I can argue all of the reasons are valid for keeping compute at a certain speed range, or power consumption envelope.<p>It&#x27;s not we can&#x27;t make compute much more denser, there&#x27;s a new standard informally called as megawatt racks. But deploying them at gigantic scales bring in massive problems as well, so we can keep total energy envelope at a fixed range.<p>...for the sake of the reasons you outlined.
        • ThrowawayTestr2 hours ago
          We can build supersonic passenger planes, no one wants them.
          • twoodfin53 minutes ago
            We could build gallium-arsenide chips, same problem.<p>Instead we just build more of the more economical thing.
          • kibwen2 hours ago
            Rather, nobody wants them at the price point necessary to make them economically viable. In the context of tech, the cost to develop a next-gen fab doubles every four years; absent some major breakthrough, we have about 20 years before even the most advanced economies balk at spending $1T, $2T, $4T, $8T on a single fab, causing hardware to settle down like airline speeds have.
    • fantasizr2 hours ago
      the best computing power used to be located at the universities and national laboratories. Now you need access - employee or otherwise - to a nasdaq listed startup. Hard not to think it&#x27;s the shareholders who benefit in the short term in this new alignment.
    • contubernio2 hours ago
      I could. I mean that. But I work in Spain and have a run if the mill desktop computer and pay for ai out of pocket.
    • hyperhello2 hours ago
      Maybe we should ask how many compute installations could reach similar breakthroughs if they had a mathematician.
    • ImHereToVote2 hours ago
      This is top shelf copium. Who is your copium guy?
  • jstummbillig1 hour ago
    I wonder he good we will be at not understanding anything to an ever increasing degree, with absolutely no hope of ever catching up. We will be super bad at absolutely everything within sciences and engineering and completely unable to contribute anything of substance, outside our own moods and quirks.<p>Can humans be okay with that? Can we be happy cats?
    • mapontosevenths37 minutes ago
      &gt; Can humans be okay with that? Can we be happy cats?<p>Sometime in your youth you decided what was important to you, and how to define your worth as a person.<p>Many of us here decided that science, creation, and discovery were among the noblest of values... And consequently came to believe that those who did not engage in those things were therfore of lower value.<p>We were wrong, and maybe now we have to learn that we were... It might hurt.<p>Similarly the looming robotics boom means that those who define themselves by the very strange, but very deeply ingrained, protestant work ethic will come to find themselves in want of purpose... And a new means by which to judge the worth of others.<p>The only thing I can really promise is that nobody will learn anything meaningful, and that we will simply replace our existing fallacies with new ones.
      • Paul-E16 minutes ago
        &gt; Many of us here decided that science, creation, and discovery were among the noblest of values... And consequently came to believe that those who did not engage in those things were therfore of lower value.<p>The nobility of old felt that they inherited &quot;noble&quot; qualities from their ancestors, and this justified their privileges and their elevated status as moral subjects. I can&#x27;t help but see the parallels with the culture tech has built around intelligence and merit. It forms much our basis for identity and moral status. When AI exceeds us, does it take away our moral status, or does it challenge our value system based on intelligence and merit?
      • mbowcut230 minutes ago
        &gt; Many of us here decided that science, creation, and discovery were among the noblest of values... And consequently came to believe that those who did not engage in those things were therfore of lower value. We were wrong, and maybe now we have to learn that we were... It might hurt.<p>I have this feeling like we&#x27;re all being pushed toward art. We&#x27;ll be either poets or slaves.
      • jdndhxjxnxbzhxh27 minutes ago
        [dead]
    • yen2231 hour ago
      You and I are already bad at 99.99% of things that can be done. This is just one more thing we are bad at.
      • reasonableklout1 hour ago
        But before, you were still able to contribute to the 0.01% of things that you were good at. And by working together with other people that you trusted, you were able to collectively advance human scientific understanding.<p>Now we have to trust the models. How do we build and maintain that trust, especially over the next decades as generations of people grow up without having to build the same intellectual muscles?
        • yen22340 minutes ago
          You are free to do maths the old-fashioned way. Nothing about the presence of LLMs prevents that.
        • xiphias257 minutes ago
          Just like how I trust the house I am in to not fall down.<p>It&#x27;s simple: we have no choice.
    • sl0wbrainRot26 minutes ago
      We moved on from manual labor to knowledge work despite a lot of people complaining about loss of hands on skills<p>And if we meet the moment while generational churn replaces politicians we could draw a line in the sand... limit the AI at the hardware level from ever conjuring certain geometric patterns that lead it to certain tasks[1]; presumably &quot;launch the nukes&quot; and &quot;add 1+1&quot; are vastly different electrical geometry or &quot;namespace collisions&quot; occur in electrical state; but caveat being it&#x27;s been a while since my hardware eng days so ...i could be way off being out of touch with the principles<p>So restrain it to never being able to consider &quot;fully autonomous no humans in the loop&quot; geometry by short circuiting geometry that approaches certain shapes; like grounding a car; circuit breaker is not encoded as ephemeral state but manufactured in<p>For utilitarian sake then, limit it to filling joann fabric and home depot and we all can be busy noodling local edge case solutions and keep up skills Norm Abrams-style in the event of systemic problems, writing zines and crafting mix tapes<p>Can still make art and play instruments away from a computer. Can still watch the night sky, start a campfire and cook smores. Doing it all on a laptop everyday is a recent diversion from millions of years of homo-this-n-that evolution<p>It&#x27;s all resolvable socially and tech wise if we put in the effort. We got to the moon within a decade through similar collectivism<p>Media propaganda since Reagan been keeping people apart but everyone who was around for it keeps saying we were happier 25-30 years ago so maybe that&#x27;s the social peak we aim for and let the robots do the mining and repetitive stress injury stuff<p>[1] <a href="https:&#x2F;&#x2F;iopscience.iop.org&#x2F;article&#x2F;10.1088&#x2F;1742-6596&#x2F;2987&#x2F;1&#x2F;012001" rel="nofollow">https:&#x2F;&#x2F;iopscience.iop.org&#x2F;article&#x2F;10.1088&#x2F;1742-6596&#x2F;2987&#x2F;1&#x2F;...</a>
    • ludwigschubert1 hour ago
      <a href="https:&#x2F;&#x2F;gwern.net&#x2F;doc&#x2F;fiction&#x2F;science-fiction&#x2F;2000-chiang.pdf" rel="nofollow">https:&#x2F;&#x2F;gwern.net&#x2F;doc&#x2F;fiction&#x2F;science-fiction&#x2F;2000-chiang.pd...</a>
      • nozzlegear39 minutes ago
        Somewhat related: Chiang&#x27;s short story about mathematicians discovering that dividing by zero is legal and makes any number provably equal (or something like that, I can&#x27;t remember exactly), introducing a crisis in mathematics. Fair warning, it&#x27;s kind of a depressing story.<p><a href="https:&#x2F;&#x2F;fantasticmetropolis.com&#x2F;i&#x2F;division&#x2F;" rel="nofollow">https:&#x2F;&#x2F;fantasticmetropolis.com&#x2F;i&#x2F;division&#x2F;</a>
    • chr11 hour ago
      If machines become that good, then they also should be able to invent ways to make us smarter.<p>It would be entirely ok if finding very complicated proofs becomes an activity for large machines, much like adding big numbers is. After all a proof is merely a path in an enormously large graph of repeatedly applied axioms. The interesting part is seeing how ideas are connected.<p>It would be really nice, if it turns out to be possible to make cats a bit smarter too, while keeping heir &quot;catiness&quot;.
    • archagon13 minutes ago
      “We” is excluding the non-trivial contingent of humanity that will continue to do things with their own meat brains for the love of the game, or in anger.<p>And I suspect all future progress will actually rest on <i>their</i> shoulders, to the great consternation of the now-deskilled AI boosters.
    • drivebyhooting25 minutes ago
      Didn’t EY have some raving essays about catgirl paradise. I’m sure one can trawl it out of the LW archives.<p>Soma is the endgame for 99% of humans.
    • catlifeonmars39 minutes ago
      Always have been. As an aside, cats likely run the world (or at least my household) so that may be a poor metaphor ;)
    • ChrisGreenHeur1 hour ago
      Luckily humans have the ability to abstract and simplify. Which is what we will now do.
      • olalonde19 minutes ago
        You believe AI won&#x27;t eventually surpass us there as well?
    • 0xbadcafebee21 minutes ago
      There is no logical reason that human beings would no longer be able to understand how things work. If you can understand the machine that created it, then you can understand what that machine creates. As far as anyone knows, there is nothing we can&#x27;t eventually understand. It just might take more than 30 seconds of effort.<p>Let&#x27;s take this one thing as an example. So, this one dumb machine created millions of pages of crap to try to prove a theorem. That doesn&#x27;t mean a human being can&#x27;t understand the proof. It just means this one proof is hard to understand. Hard - not impossible.<p>Hard doesn&#x27;t mean we can&#x27;t simplify the proof. Hard doesn&#x27;t mean we can&#x27;t break the proof up into bite-sized chunks and prove individual pieces of it. Hard doesn&#x27;t mean that someone else won&#x27;t find a much simpler proof. Hard doesn&#x27;t mean we can&#x27;t follow chains of logic to determine meaning. All it means is this one stupid machine in this one instance created a big stupid mess. A mess we can understand, if we try.
    • Tadpole91811 hour ago
      That&#x27;s the vast majority of people who have ever lived. Of course we can.
      • bluefirebrand1 hour ago
        ... Have the vast majority of people who have ever lived, had good lives? Were they happy?<p>I&#x27;m genuinely curious where the median human&#x27;s experience falls throughout history. Mostly happy?<p>I suspect probably not
        • nomel58 minutes ago
          To continue the absurdity, are cats happier in the wild or captivity? My cat was eaten by a coyote. Do we only count the time it was alive, or weight it somehow?
      • sigmoid101 hour ago
        Yeah. The majority of humans will now be joined by the 0.001% of people who were capable of significant intellectual contributions to modern society.
    • XorNot34 minutes ago
      How much advanced mathematics do you understand today?<p>How well do you know how your car works?
  • alterom2 hours ago
    <i>&quot;We should still fix the leak&quot;</i><p>I think this approach and conclusion applies to a lot more than the immediate context of that conversation.
    • js81 hour ago
      Well, a common advice is to live your life as if every day is your last, which means, DON&#x27;T bother to fix the leak. :-)
      • saulpw1 hour ago
        Plan as though you&#x27;re going to live forever, live as though you&#x27;re going to die tomorrow. This means that you fix the leak but treat it like a precious and divine activity that you would be honored to have as your last.
  • stymaar1 hour ago
    Tangent: LLM have stopped being stochastic parrots since RLVR was introduced in their training pipeline.
    • GMoromisato23 minutes ago
      Probably right, but I think chain-of-thought has had a bigger impact on intelligence in LLMs. I.e., LLMs can reason their way to a solution instead of trying to one-shot it from training data.
  • dude2507112 hours ago
    <i>&gt; It was only a couple days ago that my wife and I had the following conversation: ...</i><p>I think robot wives are also coming - the market will be absolutely massive.
  • iLoveOncall1 hour ago
    Nobody is ever reviewing and verifying 17M lines of code. Ever.<p>This is just another hypothesis on top of the Riemann Hypothesis. We now have an Hypothetical proof of the Riemann Hypothesis, great. Breakthrough.
    • schleck81 hour ago
      You don&#x27;t need to verify 17 million lines of code, you just need to check that the hypothesis is formalized correctly (that&#x27;s a subset) and that the kernel approves it<p>Perhaps read up on the value proposition of Lean.
  • hawkice2 hours ago
    I (seemingly need to) suggest the headline is, in fact, mocking people who think modern LLMs are trained on imitation alone.
  • Betelbuddy2 hours ago
    Just a proof of the infinite monkey theorem: Give a sufficiently large number of monkeys keyboards....gently nudge them in the right direction with a few banana tokens...let them type away with just enough randomness for an infinite amount of time.<p>Eventually, they will almost surely produce any mathematical proof imaginable...
    • mbowcut22 hours ago
      I genuinely can&#x27;t tell if this is sincere or sarcastic.
      • hansvm1 hour ago
        My best guess is it&#x27;s sincere. That&#x27;s been a core observation of LLMs for awhile. Filtered random search is basically an inefficient gradient descent. If you apply even a poor-quality &quot;gradient&quot; to a lot of problems with infinite compute (with large LLM budgets), it doesn&#x27;t take that good of an LLM to accomplish great things from time to time.
        • TheOtherHobbes27 minutes ago
          We&#x27;ve graduated to <i>motivated</i> stochastic parrots.
      • qup1 hour ago
        There&#x27;s enough information available to decide.<p>Start with the title of the article
    • slyrus2 hours ago
      It was the best of times, it was the blurst of times.
  • zug_zug1 hour ago
    I mean they&#x27;re obviously not stochastic parrots, I think most of us engineers have known this for a couple years now, though I do admit I saw a pretty obnoxiously vocal minority on the point here on HN.<p>But at the same time, where&#x27;s the RSI? If the RSI is there then make the company profitable already [though I suppose that means letting go of all the staff? But if it&#x27;s improving itself, not sure what humans are in the loop for].<p>Genuinely curious when AI will be able to solve real-world problems, what would 20,000 hours of AI say on the topic of whether Epstein killed himself?
    • saulpw59 minutes ago
      RSI seems to be here? It may not be the glorious 100% autonomous RSI that sci-fi authors predicted, but 90% autonomous RSI seems to be what&#x27;s creating Claude Code and putting inference models on FPGAs and whatever happens when I say &quot;Claude, plan it. Claude, implement it. Claude, fix it. Claude, make it faster.&quot; I mean it&#x27;s not perfect but it&#x27;s remarkable how much you can just...tell it to make itself better?
      • zug_zug43 minutes ago
        I mean it&#x27;s definitely remarkable.<p>But I don&#x27;t think it&#x27;s RSI.<p>My mental model of RSI is essentially isn&#x27;t quite asymptotic but exponential. If a system can make itself 5% smarter every week then it would be 12x as smart in one year at which point it&#x27;s not clear to me if we even need governments or markets because we have a being that can direct everything.<p>In short I don&#x27;t believe there&#x27;s any world where there&#x27;s true RSI intelligence and anthropic returns green paper to &quot;shareholders&quot; so they can buy pretty cars as status symbols.
  • kittikitti58 minutes ago
    The irony is that people are repeating &quot;stochastic parrots&quot; while have meme knowledge about what stochastic means.
  • otabdeveloper42 hours ago
    Sorry bud, still not buying Anthropic stock.
  • thenatureboy2 hours ago
    [dead]
  • mbgerring1 hour ago
    “Because I am impressed and mystified by its outputs, I believe that the next token prediction machine <i>must</i> be doing something more than that, regardless of the lack of any evidence”<p>AGI is when the output of LLMs is plausible enough to fool putatively intelligent people that they are alive
    • preg_match1 hour ago
      LLMs are most definitely doing more than just predicting the next token. They can reason. This is emergent behavior. The idea is that, while one small part is doing something simple, the entire system together produces behavior that’s much more than that.<p>I kind of view it as how slime mold can solve a maze. Mold doesn’t think or see, but the system of a bunch of slime mold together has almost a rudimentary intelligence.
    • ashdksnndck40 minutes ago
      It’s like saying humans brains are just a bag of subatomic particles mechanically following the physical laws that predict the next state. Vacuously true.
  • devindotcom2 hours ago
    What an offputting title. The sneer really comes through. If I ever had any desire to read what this man wrote, this little potshot has extinguished it.
    • freehorse2 hours ago
      If the url did not read scottaaronson.blog this kind of post would have been [flagged][dead], but alas<p>I do not see what this kind of post offer here when there is already at least one thread to discuss Alpöge&#x27;s result with 1000+ comments.
    • mbowcut22 hours ago
      Not off-putting in the slightest. It&#x27;s a well-deserved jab at the earliest LLM naysayers whose &quot;criticism&quot; was just ignorance wrapped in causeless activism. They claimed that LLMs were just randomly repeating locally coherent phrases back to us and that no amount of scaling could produce real intelligence. Well, the goal posts have moved far indeed if a proof of GRH isn&#x27;t intelligence.
      • santadays1 hour ago
        I think it&#x27;s well deserved for all the people who made a name for themselves nay-saying llms&#x2F;ai. I think it&#x27;s less well deserved for people worried that their careers are shot and won&#x27;t be able to provide for their families.
      • dist-epoch1 hour ago
        &gt; the goal posts have moved<p>Indeed, it&#x27;s not fashionable anymore to say &quot;stochastic parrot&quot; or &quot;glorified auto-complete&quot;. What is fashionable today is to talk about the &quot;convex hull of human knowledge that LLMs interpolate in&quot;
    • zone4112 hours ago
      It&#x27;s good to poke fun at the AI phrase that&#x27;s aged the worst and all the news articles that promoted it as fact. It did a lot of damage to people&#x27;s understanding of AI.
    • shearerp2 hours ago
      It&#x27;s not a sneer. It&#x27;s a wisecrack about an absurdity.<p>The feeling of a sneer comes only from the absurdity of the belief being definitively revealed.<p>For anyone who feels sneered at: the problem is the absurd belief, not the reveal.<p>&quot;Don&#x27;t sneer at the Emperor for parading around with nothing on!&quot;
    • amelius2 hours ago
      The sneer towards who? The people who sneered that AI is just stochastic parrots? I think they deserve to be sneered at, honestly.
      • reducesuffering2 hours ago
        Seriously. We are less prepared for the present and future because of all the denialists and naysayers, many on HN, who have repeatedly cried &quot;stochastic parrot&quot;, &quot;it just regurgitates known things, it can&#x27;t create&quot; and &quot;marketing stunt&quot; endlessly, sometimes &gt;80% of the sentiment on threads over the past years.
        • mr_mitm2 hours ago
          The sentiment can still be found today in the other thread to the original GRH submission.
        • chihuahua54 minutes ago
          But surely, if we pooh-pooh LLMs enough, people will stop using them and it will all just go away?
    • squidmaster2 hours ago
      [dead]
    • fasterik2 hours ago
      Scott Aaronson has more intellectual chops and a better track record than 99.999% of people commenting on AI news. The sneer is a small fraction of that coming from the know-nothings who have been using phrases like &quot;stochastic parrot&quot;, &quot;fancy autocomplete&quot;, etc. for many years now. The parrots are coming home to roost, as they say.
    • dead_hn_theory2 hours ago
      [flagged]
  • 12399827163 hours ago
    Why the snarky headline? If parrots can generate statistically plausible proof snippets, and they are backed <i>by a combination of Lean, other proof techniques stolen from ACL2 and a human mathematician</i> they can still be stochastic parrots.<p>Aaronson is too close to the &quot;rationalist&quot; cult. Maybe he should sit down with ACL2 and get a clue. Emily Bender didn&#x27;t speak about all that augmentation when coining the phrase.
    • zone4112 hours ago
      How do Emily Bender and this toxic circle still have an audience in 2026? How wrong do they have to be before people stop taking them seriously?
      • asht1252 hours ago
        BENDER IS TALKING ABOUT LLMS AND NOT PROPRIETARY THEOREM PROVERS THAT USE LLMS AS ONE PART.<p>Now complain about upper case, which is the most likely continuation for a human parrot. Or the new account.
        • murderfs2 hours ago
          I don&#x27;t understand what this objection is even trying to argue. LLMs aren&#x27;t intelligent, because they&#x27;re capable of tool use?! One of the few other things we use as an example of how humans are more intelligent than most other animals?
          • santadays1 hour ago
            Yea, like how much progress did modern humans make for a couple hundred thousand years without writing.
        • cma22 minutes ago
          Only like 20% of OpenAI&#x27;s 700+ math paper drop had formal lean proofs. This isn&#x27;t just theorem provers using LLMs as one part. The Navier Stokes result was proven before it was formalized, even if they did differ a bit. Find a new angle to be in denial about.
    • jmyeet2 hours ago
      Isn&#x27;t it obvious? Scott Aaronson is a theoretical computer scientist, which is essentially a mathematician. Scott is likely seeing his career prospects disappear in front of his eyes just like so many others.<p>Too many people only see the perils of something once it affects <i>them</i>.<p>The optimists think AI will be like the cotton gin where making something cheaper and more accessible actually increased the demand for slaves as the price dropped. I&#x27;m more pessimistic. A lot of jobs are going to collapse in demand in the coming years. For awhile those at or near the top will survive and possibly make a lot of money but the rising floodwaters come for everybody.
      • betterunix22 hours ago
        &gt; Scott is likely seeing his career prospects disappear in front of his eyes<p>Why would he be seeing that?<p>The combination of a mathematician and lean is powerful, and the combination of a mathematician, lean, and AI is more powerful still. Note that the mathematician is always part of that picture. That is fundamental -- no software system, no matter how big and complicated, can actually solve <i>every</i> math problem (this is a fundamental result in math that started the entire field of computer science). If you read TFA he basically tells you what he is actually worrying about here:<p>&quot;the Lean formal verification system still has issues, from kernel bugs (which have, in the past, allowed proofs of 0=1) to uncertain soundness of the underlying type theory. In my view, these issues can and should urgently be fixed! Until they are, a sufficiently motivated AI could almost certainly exploit them to prove a false statement!&quot;<p>He is worried about the proof checking system and the possibility that an AI might exploit bugs in the proof checker, not the disintegration of his entire career because AI can &quot;just figure it all out&quot; or whatever.
      • skeledrew2 hours ago
        &gt; A lot of jobs are going to collapse in demand in the coming years. For awhile those at or near the top will survive and possibly make a lot of money but the rising floodwaters come for everybody.<p>Funny, I&#x27;m actually optimistic for this. Let the flood wash away this messed up system that puts people in tiers and says people should only have access to what they can &quot;afford&quot;, not to what they need. And then allows a few to be able to afford almost anything, and many to be able to afford nothing, just by being the first to X, or acquainted with Y.
        • allturtles57 minutes ago
          Ai is going to make economic stratification much worse, not better.
          • TheOtherHobbes21 minutes ago
            That may turn out to be an optimistic take.
      • pegasus2 hours ago
        &gt; Scott is likely seeing his career prospects disappear in front of his eyes<p>...no he&#x27;s not, that&#x27;s a ridiculous statement. He is a prestigious professor with tenure at a top university.<p>Also, mathematics is much much more than just proving theorems. As the word goes, &quot;Good mathematicians prove theorems, great mathematicians make conjunctures, the greatest mathematicians build theories&quot;. Someone has to carve out domains of interest to humankind. And humans will always know better what is of interest to humans than machines. These kind of reactions are a form of AI psychosis.<p>And lastly, this result was reached by a top mathematician steering the model towards the right approaches. You might say that the next iteration of the model might not need such steering to reach this result, but that just means that the pilot seat will have shifted higher up, so to say. New frontiers of complexity will become approachable to humanity and approach we will, &quot;exploring strange new worlds and boldly going where no one has gone before&quot;.
      • squidmaster2 hours ago
        [dead]
    • Morromist2 hours ago
      Are you saying we should address llms with more respect now that their good at making lean proofs? Maybe we could call Claude Dr. Claude and Gemeni could be Professor Gemeni.
      • qwtah2 hours ago
        Scott Aaronson is an AI booster who is mocking Bender in the headline. He isn&#x27;t mocking the machines.<p>How on earth can the comment you reply to be misunderstood? It even defends Bender.
        • Morromist1 hour ago
          Ahh, I see. I took the article to be somewhat skeptical about the whole thing, even though he says he belives that the proof will hold. I personally feel like AI is a bit of a parrot hooked up to massive compute, which is the powerful part of it, and that it can solve unbelivably hard math problems but is still a parrot, so I may have read my own thinking into the headline instead of the author&#x27;s.
    • BoppreH2 hours ago
      I&#x27;m 99% sure it&#x27;s not his actual opinion, but a sarcastic remark aimed at the people who claim that LLMs are just stochastic parrots. Like &quot;your &#x27;peaceful&#x27; dog just bit me&quot;.
      • pessimizer1 hour ago
        LLMs <i>are</i> just stochastic parrots, it&#x27;s simply not an insult. It reminds me of how people during covid would yell &quot;it&#x27;s not just like a bad flu&quot; when literally the only valid historical comparisons we had were bad flus that killed millions.<p>When you&#x27;re worshiping something, anything that implies that it is comparable to anything else is an insult to its divinity.<p>The title doesn&#x27;t imply that sort of thinking on Aaronsom&#x27;s part at all, though. Some simple dumb thing blowing through math problems thought maybe unsolvable is a hilarious contrast.
        • cma20 minutes ago
          Computing a distribution and sampling from it isn&#x27;t the same thing as sampling from a distribution.
    • sph2 hours ago
      &gt; Why the snarky headline?<p>The boosters are out in force to gloat today.
      • ModernMech2 hours ago
        I don&#x27;t think it counters the boosters to ascribe a result like this exclusively to the &quot;stochastic parrot&quot; though. There&#x27;s an army of people behind each one of these results.
        • sph2 hours ago
          It&#x27;s clearly sarcastic. The article is just another booster throwing fuel to the flames because they&#x27;re in a good mood today.
        • mkehrt51 minutes ago
          If you don’t understand the title is sarcastic, uh I don’t know what to tell you you.
      • 3498734906812 minutes ago
        I&#x27;m sorry you luddites are having a streak of bad luck since the first release of ChatGPT.
  • ml-anon1 hour ago
    [flagged]
    • redlock1 hour ago
      How did he offend you?
      • lysace36 minutes ago
        &quot;The stochastic parrots&quot;?
        • serf4 minutes ago
          so that&#x27;s offensive when it&#x27;s said glibly <i>for AI</i> , but not <i>against AI</i>?<p>either there are some double standards going on or HN is <i>filled</i> with offensive people, because nearly every LLM mention of mine for the past year has had a &quot;....buuuut stochastic parrot slot machine!&quot; comment directly replying to it.<p>..I&#x27;d hate to think HN had such offensive messaging everywhere.<p>... maybe it&#x27;s not offensive but just sort of <i>obnoxious and worthless as a statement</i> ?
      • bothers33 minutes ago
        [dead]
    • bakugo6 minutes ago
      Being obsessed with AI and being insufferable seem to go hand-in-hand.<p>After all, unlike real people, the stochastic parrots will never call you out on it.
  • dhnrunthmtu39 minutes ago
    [flagged]