7 comments

  • hypfer0 minutes ago
    Answering the Headline: Not really, no.<p>Things are the way they are not because they would be difficult but because various systemic incentives and goals fought out each other, leading to the outcomes we then saw.<p>This balance these various forces fought out relied on a bunch of undocumented assumptions about reality. Every time one of those breaks, you get disruptions. LLMs broke quite a few of them, leading to a lot of CVEs lately.
  • ssrc0 minutes ago
    Maybe for some software systems it was. For most systems, the problem was just professional immaturity caused by the eternal September state the profession is in since the beginning.
  • dgoodell16 minutes ago
    I think it was a business decision to make it too complex for humans. I don’t think fundamentals were prioritized as much as features, resulting in a fragile house of cards.<p>There’s a reason it doesn’t look like most engineering. If it was a bridge it would have collapsed long ago and killed people.
  • amelius5 minutes ago
    The always changing requirements are what make it too complex for humans.
  • ex-aws-dude1 minute ago
    I mean if you zoom out the whole lesson of ML is “we are not smart enough to design this function”<p>We aren’t smart enough to design the IsCat(image) function
  • yepyoukno3 hours ago
    Many handle it just fine.
  • AIShill1013 hours ago
    Yea I agree with the article wholly. This new era of AI assisted or driven coding is going to help us extend our capability way beyond anything humans could&#x27;ve built.
    • onion2k3 minutes ago
      <i>This new era of AI assisted or driven coding is going to help us extend our capability way beyond anything humans could&#x27;ve built.</i><p>For individuals, sure. I&#x27;m fairly sure we&#x27;re all building things that we couldn&#x27;t build ourselves if only because we don&#x27;t have the time needed. For large scale projects like building an OS from scratch or a database engine that&#x27;s a lot less likely to be true, simply because there are dozens of examples of humans doing that level of complicated work without AI already (the OSs and DB engines we have are very literal evidence of it.) They just need to work collectively. Every part of those projects is understood people a person even if no person understands the whole thing.<p>So the problem with doing the same sort of thing with AI becomes a question of whether someone can build the equivalent sort of project with AI by describing something more complex than they understand themselves. And even if they just ignore the complex details and let AI do that bit, how can they validate that the AI has actually done what they asked if they can&#x27;t understand it? It might have taken a shortcut that works until it doesn&#x27;t. I hope no one builds an aviation or a life support system by doing that.
    • dingaling91115 minutes ago
      At the moment, oversight is still heavily required.<p>Before, we used to write code and machines converted it to binary.<p>Now we will write designs and machines will convert it to code (and then to binary.)<p>There is a possibility of models taking over design for somewhat run-of-the-mill applications with minor architectural tweaks. This is the area that &quot;vibe coding&quot; is currently dominating. How many vibe coded apps, written by others, are you using? None. So that tells you something.<p>At best, models are currently at VB6 level: domain experts can do a lot of good. But they could&#x27;ve done it with VB6 as well. And MS Access. And Excel.<p>I am not sure how we would give the models an idea of taste and beauty because that is often what differentiates good&#x2F;bad from great designs.