Intuitions for Tranformer Circuits

3 comments

• skyberrys5 hours ago
  I was glad to discover this is an analogy to electrical circuits further down the page. It's a good topic to understand, the write-up is comprehensive.
• jopolous5 hours ago
  &gt; They are the only man-made technology in history that we don’t fully understand from first principles<p>…what? What about bicycles? Ice skates? General anesthetics? I feel like there are a ton of commonly-used man-made items we don’t fully understand from a first-principles perspective.<p>Am I missing something here?
  • doctoboggan3 hours ago
    No, I don&#x27;t think you are missing anything. Only recently have engineers been inventing things from &quot;first principles&quot;. I think for the majority of human civilization we&#x27;ve mostly invented and improved through trial and error.
• openclaw016 hours ago
  [dead]