4 comments

  • jey42 minutes ago
    This headline is completely wrong. The proper coding analogy is more like, the natural-language paper was the &quot;design document&quot; before coding it up, then when coding it up as Lean4 proofs, specific details were realized to be slightly off[1] and corrected while writing the implementation in code as machine-checkable proofs. Which I&#x27;m sure is an extremely relatable situation for most of us here. But the paper or &quot;design document&quot; wasn&#x27;t corrected afterwards.<p>I also think this &quot;paper then code&quot; approach is now obsolete. The modern way, in AI-assisted workflows, is to first iterate on &quot;derivation sketch &lt;-&gt; machine-checkable proof&quot; incrementally building out your result. You can of course leave `sorry` placeholders along the way and fill them in, so it&#x27;s not like you&#x27;re restricted to going entirely bottom-up. Finally, once you have a `sorry`-free proof of your top-level statements (theorems) of interest, you can then work on writing up the exposition in LaTeX based on the lean code.<p>1. See <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2610.08144" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2610.08144</a> for details, but an example they point out is that a key bound required 5 additional orders of derivatives (and stated in Lean that way), but the paper claimed that the bound held with only four more derivatives.
    • nsagent34 minutes ago
      &gt; I also think this &quot;paper then code&quot; approach is now obsolete. The modern way, in AI-assisted workflows<p>To call the approach obsolete and refer to a &quot;modern way&quot; to use an LLM seems like a stretch when critiquing the approach used by <i>a frontier lab a month ago</i>.
      • jey25 minutes ago
        Shrug. It&#x27;s how I do my research now. There were too many mathematical errors when I had agents writing LaTeX directly, even with adversarial reviews, so now I only read stuff that&#x27;s been formalized, with whatever kinks worked out along the way.
  • krackers2 hours ago
    Dupe of <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49994145">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49994145</a>
  • aaron6951 minute ago
    [dead]
  • cyanydeez2 hours ago
    Aka, no one at OPENAI is doing much to seriously vet their claims.<p>No wonder trumps moving to AI.