4 comments

  • _jayhack_2 hours ago
    Shocking to me how little interest the general public has in mechinterp given the alien capabilities demonstrated by LLMs - this and the subsequent transformer-circuits.pub publications will be seen as classic, foundational work in a few years
  • myself2486 hours ago
    Nothing about B-H curves or magnetization current, must be that other kind of transformer, in that other kind of circuit.
    • greenbit3 hours ago
      Someone should step up and rectify that, there's a lot of potential for confusion.
      • ziofill2 hours ago
        This comment is hysteresical
        • Bluestein2 hours ago
          I find it polarizing.-
          • thatspartan2 hours ago
            It can be quite eddyfying
            • pooyamo1 hour ago
              A harmonious comment about an impedance mismatch quickly spiraled into a galvanizing flow
              • greenbit18 minutes ago
                It's just that HN is currently saturated with this kind of thing
  • amelius6 hours ago
    &gt; A previous project, the Distill Circuits thread, has attempted to reverse engineer vision models, but so far there hasn’t been a comparable project for transformers or language models.<p>How successful was that?
    • Bluestein5 hours ago
      The entire thing went down:<p>- <a href="https:&#x2F;&#x2F;distill.pub&#x2F;2021&#x2F;distill-hiatus&#x2F;" rel="nofollow">https:&#x2F;&#x2F;distill.pub&#x2F;2021&#x2F;distill-hiatus&#x2F;</a><p>... and, here we are.-
  • oofbey4 hours ago
    I’ve tried reading this many times. But it’s sooooo long. Is it worth it?
    • robrenaud2 hours ago
      Neal Nanda&#x27;s walkthrough of it is pretty good.<p><a href="https:&#x2F;&#x2F;youtu.be&#x2F;KV5gbOmHbjU?is=GSiv0rSHBocNdU8l" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;KV5gbOmHbjU?is=GSiv0rSHBocNdU8l</a><p>Also long, but it&#x27;s detailed and complicated, so there is no escaping that.
      • thesz58 minutes ago
        <p><pre><code> &gt; no escaping </code></pre> &quot;There is no Royal road to ...&quot;<p><a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Royal_Road#A_metaphorical_%22Royal_Road%22_in_famous_quotations" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Royal_Road#A_metaphorical_%22R...</a>
      • Bluestein2 hours ago
        This is a gem.-
    • Bluestein3 hours ago
      Depending on your field, degree of interest, general curiosity, its a must. Its up there with word2vec.-