I'd be more OK with this if Google had a good API for their search results. But they've deprecated it, and now there is no alternative. So I'll continue to use 3rd parties that scrape Google results, until they change their mind.
I agree, then need to bring back Nelson Minar’s old search API, or something like it.<p>Google does supply search grounding with Gemini API calls, and that is handy, but not general enough.
It's quite important that SERPs are scrapeable, because they keep advertising scams like ETA/ESTA sites: <a href="https://www.bbc.co.uk/news/technology-56886957" rel="nofollow">https://www.bbc.co.uk/news/technology-56886957</a>
I am somewhat confused - does this mean we can all now legally scrape Google search results?
Hypocrisy-rich.
This ruling might feel good viscerally, but it also reinforces Googles own scraping as perfectly legal. At its inception, Google probably viewed this lawsuit as win-win. Either they successfully sue a competitor into oblivion or establish a precedent that will protect themselves in the future. Google lost, but they still won.
Google has no moat anymore.<p>- Google search is on the way out. I don't know any of my peers who use it anymore.<p>- Coding models make doing extreme depth of work possible.<p>- Hoards of unemployed engineers now have access to 10x coding utilities and are looking for things to do. They will start clawing away at Google products.<p>- Just the other day, someone cloned Google Gsuite and it looked awesome<p>- Drive and Search will also be fungible products<p>- I'm itching at the chance to build my own phone operating system, and there must be thousands of others who want to do the same.<p>- Chrome can probably be replaced (Firefox gained a whole percentage point last month)<p>I don't think Google is safe anymore.<p>Two caveats that I'll give them:<p>- YouTube still has network effects and probably can't be dislodged<p>- Google cloud isn't going anywhere
> Google search is on the way out. I don't know any of my peers who use it anymore.<p>bear in mind we're on Hacker News. Google's market share is still above 90% - in almost any other market this would be a ridiculous monopoly.
> - I'm itching at the chance to build my own phone operating system, and there must be thousands of others who want to do the same.<p>Maybe look into contributing to existing alternatives like PostmarketOS.<p><a href="https://postmarketos.org/" rel="nofollow">https://postmarketos.org/</a>
> Google search is on the way out. I don't know any of my peers who use it anymore.<p>What do they use?<p>Of all my tech friends, colleagues, I'm the only one who uses Kagi. Another person uses searx. Everyone else uses Google.<p>Of my non-tech friends and colleagues, everyone uses Google.
Let me tell you about this new little-known technology that's been gaining traction in the last few years...
> Of my non-tech friends and colleagues, everyone uses Google.<p>Me, almost, too.<p>I have some friends using duckduckgo - not many and only until Google is the default again...
are your peers me, myself, and I? that is a wild claim. I'll start asking around but I don't think I could find one person that says they don't use google search anymore
If only GPT wouldn't refuse my requests to write a crawler for $site. :(
What about them taking content for their AI summaries? Have they created a system that gets content owners and creators paid in this regard yet?
“You are trying to kidnap what I have rightfully stolen, and I think it quite ungentlemanly."
Google crawling respects robots.txt and doesn't break capcha. It is easy to tell Google to piss off. SerpAPI fully relies on end-user proxies distributed like malware (in LG tv apps for instance), it has no other way it could function because it exclusively ingests data from sources that tell it to stop. If you wanted to scrape a bot friendly site, you wouldn't need SerpApi
I'm vaguely sympathetic to this argument.<p>But only vaguely. Google uses its monopoly position in advertising to basically ensure that you allow them to scrape your site (or if not you personally, the majority of revenue driving sites). They have the benefit of being allowed by default.<p>They also then scrape again at the user level for users operating chrome.<p>They also conveniently ignore global blocks for their adsbots (you have to specifically name them to block them).<p>If you're not Google, you likely don't have this luxury.<p>My preference would be that governments force search indexes to be public. The exact mechanisms for this can be debated.
This sums up every single bit of AI "progress" since 2022.
Source:<p><i>Google vs. SerpApi: The Court Granted Our Motion to Dismiss</i><p><a href="https://news.ycombinator.com/item?id=48995411">https://news.ycombinator.com/item?id=48995411</a>
[dead]