I find that the text that AI produces is sometimes unintelligible without putting _real_ effort into reading it. It's like the AI is becoming so intelligent that it spreads the information around through different sentences in a different way than humans do. I guess if you are a transformer with thousands of tokens of lookahead, why wouldn't you ...<p>Anyway, I wish the LLMs were trained with a human-text-detector in their training loop. And they can still use a different LLM to produce code and mathematics. However, using the same LLM for both tasks, and we're going to have a hard time understanding what is happening.
I think the point should be making sure these AI codes are reviewed by developers, which is hard to do.<p>Developers write plenty of bad code and comments too, trying to detect AI just feels more like treating the symptom than the actual problem.
The more advanced the effort to detect human vs AI the more advanced the AI will be to write just like human.
I wonder if at some point it will become totally human like, and then what will be the reaction? will you accept it? will it be tuned and targetted just like ads to you so it can be eloquent and influence you?
I was curious why someone would need to classify a comment in the first place.<p>> One thing in this comment caught my mind: the small parenthetical that says “the usual case”. If that were true, it would be important information! However, this comment is generated by the llm model Claude, which has no sense of what counts as the usual case in this domain.<p>That's from the post referenced early on. I think that's the fundamental misunderstanding of what these tools are supposed to be used for. And I'm just as guilty myself at work. The problem isn't that the LLM generated that text, the problem is that a human didn't read it properly and ask what that meant and fix it before pushing.
> The problem isn't that the LLM generated that text, the problem is that a human didn't read it properly and ask what that meant and fix it before pushing.<p>The amount of garbage AI generates quickly overwhelms the human. The whole reason for computers to exist is to remove burden from humans. And yet here we are.<p>I ended up vibe-coding a comment linter for my projects that catches the garbage and forces the models to rewrite. Just look at this: <a href="https://xcancel.com/dmitriid/status/2097632371650552084#m" rel="nofollow">https://xcancel.com/dmitriid/status/2097632371650552084#m</a>
Unfortunately my naive heuristic of "if there is a comment it is written by AI" is nearly as accurate.
This is ultimately a GAN and will converge below the error rate:<p><a href="https://xkcd.com/810/" rel="nofollow">https://xkcd.com/810/</a>