The topic of an article being AI and an "AI-Generated Article" are two completely different things.
Would there be some way to see what percentage of the front page meets those qualifications? I don't browse /new very often, so I have less of an idea of how representative that is. It would be interesting to see if they trend similarly.<p>Thanks for the cool project!
Yeah, that's probably the main limitation right now. This is measuring /new, so it's every submission rather than just the stuff that makes the front page.<p>lcamtuf's survey (linked in the footer) was looking at the front page, and the number there was quite a bit higher. So there's likely some effect from voting, although I haven't dug into that yet.<p>I think Algolia has a way to filter for front-page stories, which should make it pretty easy to add. I haven't tested that yet though but will certainly look into it!
At first I thought about how many posts were written by AI
Would be curious to see how many comments are AI generated.
It's remarkable how stable 20-30% show HN concentration is after late 2022, for the extended stats.
Good. Now do what % of posts link to AI generated articles.
you could fetch the text from linked blog posts over time and run 'em through pangram, I bet >20% of blogs linked on HN today are totally LLM written
An estimated 2,000 articles per month at 2,000 words per article would result in 4,000,000 words, which costs either $200 or $2000 to process at Pangram [1]. It might make life a lot more enjoyable for many users here, though.<p>[1] <a href="https://www.pangram.com/pricing?category=developers" rel="nofollow">https://www.pangram.com/pricing?category=developers</a>
Several people have asked for this already, so I'll add it to my to-do list. I just want to be careful about flagging posts that appear to be written by AI. Perhaps I set certain thresholds of certainty to filter by. What I have currently is easily verified and matched by the words we are filtering for.<p>It is also interesting to note that I have already received 5 AI written emails to the email I linked in the footer.
Related:<p><i>How Much of HN is AI?</i> <a href="https://news.ycombinator.com/item?id=49435728">https://news.ycombinator.com/item?id=49435728</a>
it would be cool to use embeddings to categorize into like 10-20 categories and get a giant pie chart
And so comes the AI comments as many as the AI posts just saying for fun
Something to maybe track later would be /newcomments, but that would only grab the most obvious comments. People can certainly direct an AI to write in a style that sounds human, but I'm sure it'll still catch a fair amount.
If you read a lot, you start to get a feel for phone typos vs AI hiccups. I can guarantee that is post was made by a brain designed to eat berries in a cave. Almost all the another posts look a bit scary.<p>I think I misunderstood - how many posts were about AI vs how many posts were written by AI.<p>I obviously am suffering from berry fog.
Brilliant