Well, damn. Jeff, Sanjay and Demis leaving all at once, it's hard not to read that as someone fucked up pretty bad.
Did the ycombinator podcast which included giving advice to startup founders just a few days ago:<p><a href="https://www.ycombinator.com/library/Vy-jeff-dean-the-1-rule-for-building-in-ai">https://www.ycombinator.com/library/Vy-jeff-dean-the-1-rule-...</a>
I wonder if Jeff Dean facts [1] (I hope people remember the reference) will carry over to the new startup.<p>[1] <a href="https://github.com/LRitzdorf/TheJeffDeanFacts" rel="nofollow">https://github.com/LRitzdorf/TheJeffDeanFacts</a>
As LLM coding agents plateau— at least for the average engineer without tens of thousands of dollars or swarms of agents to run —I’d say that, from here on it’s going to be about ASICs, specialized LoRA/or-equivalent models, or a Ruby on Rails for LLM context engineering and orchestration, which LangChain and others seems well position, including Google as they own the entire stack. LLM free lunch has been over for a while, perhaps since the ReAct loop, and has been official since Ilya mentioned it at NeurIPS.<p>I feel the most exciting development these days is self-evolving agents. Especially if you have a way to verify their outputs with a formal system, or with a system developed since the 60s by armies of PhDs.<p>DeepMinds Gnome is a good example, where they use DFT to verify outputs. Approximating NP-problems is always fun for those who dare.<p>I am also building in this space. Its a mix between HPC, AI, and hard science. Pretty fun compared to waking everyday to LLM news that seem more like marketing stunts.
Sounds like you get your news from 2024 when people thought things were plateauing after GPT4?
LLM coding isn't even close to plateauing. Right now, the major players are in a consolidation step, focusing more on economic efficiency but still not at the point where we're ready to start burning models to hardware and freezing the line.<p>They are straddling the line between pushing it forward, and justifying the business case. It's hard to do both at the same time.
we definitely haven't hit plateau yet. I think a lot of people latch on to anti-LLM narratives without really thinking things through.
To be honest, this feels more like a lifestyle business (aka hobby) than a startup. They truly deserve it, but I don't expect a huge success as a business.<p>That said, I hope they write cool papers with various peers across the industry without worrying too much about the competing dynamics. That'd be a blessing for humanity, and good for their spirit.
End of an era for Alphabet.
I've seen tiny tiny hints from the outside that Jeff Dean was dealing with too much internal BS. Two examples that come to mind: Having to deal with Timnit Gebru fiasco, and even chips in the TPU series getting marketing names (Trillium and Ironwood) before switching back to more standard numbering.
I wonder if this has anything to do with it<p><a href="https://www.lesswrong.com/posts/iKm2FhpWkuuBojm82/why-i-left-google-deepmind" rel="nofollow">https://www.lesswrong.com/posts/iKm2FhpWkuuBojm82/why-i-left...</a>
Imagine being a VC and getting to this slide on their pitch deck, "involved in creating the following":<p><a href="https://x.com/JeffDean/status/2085036253263921218" rel="nofollow">https://x.com/JeffDean/status/2085036253263921218</a>
Just remember to make sure you turn in your devices.
<a href="https://archive.ph/Pogl7" rel="nofollow">https://archive.ph/Pogl7</a>
Related:<p><i>The next chapter of our AI momentum</i><p><a href="https://news.ycombinator.com/item?id=49184755">https://news.ycombinator.com/item?id=49184755</a>
Jeff and Sanjay both leaving!
Not through conscience.
Oh wow demis and Jeff, that Ethics engineer who left GDM, and reached to both and posted on lesswrong a couple weeks [1] ago did make a difference?<p>1. <a href="https://www.lesswrong.com/posts/iKm2FhpWkuuBojm82/why-i-left-google-deepmind" rel="nofollow">https://www.lesswrong.com/posts/iKm2FhpWkuuBojm82/why-i-left...</a>
Alex Turner discusses a bit here at this timestamp:<p><a href="https://www.youtube.com/watch?v=pGlJQHVeKIA&t=14m27s" rel="nofollow">https://www.youtube.com/watch?v=pGlJQHVeKIA&t=14m27s</a>
...you think they've only been planning this for a couple weeks?
hmm not really, and it probably isnt the origin, but im glad to see him vindicated by having both C-level google leadership people who targeted to try and either stop google from doing the pentagon deal, both stepping down the same day.<p>At least it makes me feel like he reaching out might have made a difference on remembering this people killer robots are bad, and being part of it might not be on the best of their interests to go down on history for
what was the post?