3 comments

  • FL33TW00D18 minutes ago
    Why ruin good work by letting Claude write it all? Full of em dashes, riddled with Claudisms.
    • gdiamos11 minutes ago
      I personally don&#x27;t mind letting Claude write about work.<p>You could spend 80% doing the work and 20% writing about it, or 99% doing the work and 1% copy-pasting Claude&#x27;s writeup about it into a blog.<p>There is nothing wrong with writing if you are into it, and yes you can probably do better than Claude, but I can related to engineers who just want to build.
  • gdiamos1 hour ago
    One of my lessons in using different accelerators, whether they be different NVIDIA versions, or GPU-&gt;TPU, etc is that someone needs to do this work of indexing, partitioning, mapping, scheduling, and benchmarking. That work is labor intensive.<p>In this case, google has already done it, and that will be true for high resourced accelerator companies like Google working with the most popular operations like attention.<p>As long as you use those operations, you are okay. But if you do something different, you need to be prepared to do all of this yourself.
  • refulgentis1 hour ago
    It broke my heart to have a visceral &quot;I&#x27;m being slop&#x27;d&quot; reaction reading this: it&#x27;s <i>such</i> good work, and AI&#x27;s barely used AFAICT, but there&#x27;s enough odd transitions and copy-pasta&#x27;d markdown that you get the subconcious &quot;this is AI&quot; reaction regardless.<p>Many sentences are 3x as long as it normally would be in subtle ways (to wit: &quot;My flash attention is 35x slower than the fused standard at n=4096. Not a little worse. Catastrophically worse.&quot;), it really wears on attention. (pun intended) It brings literary voice to a technical blog post, and a very difficult process-oriented technical blog post. I have to reallocate my unfortunately-limited brain cells from &quot;maintaining state of where we are in the process&quot; to &quot;is this cutesy fluff or important&quot; and I&#x27;ve never had to do that in 37 years with technical blog posts.<p>The Markdown gets <i>bad</i>. Bolding is used for important phrases (like a human would), then, all of a sudden, after the &quot;Inside a TPU chip&quot; header its being used every other sentence, on anything that is a proper noun&#x2F;would have a Wikipedia article. It got so weird that at some point I was like &quot;a human <i>definitely</i> didn&#x27;t let this through...they must be links?&quot; and tried clicking them.<p>It&#x27;s doubly bad at that point, because markdown tables start coming in hot and heavy too. So you&#x27;re left with &quot;It&#x27;s pretty apparent the LLM did it from here, and I can&#x27;t keep trying to keep the state of the process in my head while trying to figure out if the bolding is important, <i>reflexive close tab</i>