52 points slashdev 1 hour ago 29 comments

dmitrygr 50 minutes ago | parent

Those poor websites^H^H^H^Hcontent sources

asdfasgasdgasdg 49 minutes ago | parent

If Google didn’t put those there, people would be going to other LLMs to get their answers quickly. I don’t know how this ends but I strongly doubt any unilateral effort to withhold llm service by Google changes the medium term outcome.

slashdev 44 minutes ago | parent

I think it's actually wise of Google to disrupt themselves this way. If they don't the AI companies will do it for them, and they'll have no control over the process nor chance to recover lost ad income. As per the article, Google managed to pull this off without hurting ad revenue (surprise!)

Disclaimer: I wrote the blog post and submitted it

toomuchtodo 39 minutes ago | parent

Is the future of providing content hosting markdown files and images surfaced with a sitemap xml file exposed to LLM providers, or perhaps just offering an mcp?

https://github.com/gordonbrander/zim-mcp as an example reference implementation

My local search interface can then be models updated over time with diffs via torrents, plugged into mcps for grounding and context not yet in models.

https://pirateface.co/articles/pirate-face-cli

https://huggingbay.xyz/

fishfasell 6 minutes ago | parent

Exactly, people treated Google like it was AI long before the rise of LLMs. Now they actually get the answer they're looking for rather than searching through a sea of web links.

miohtama 46 minutes ago | parent

“US keywords DataForSEO tracks”

As a user, I am happy to see content spam trash to die and burn in hell.

slashdev 35 minutes ago | parent

It’s a broad representation of US search, not a spam-focused list. But it does have some biases.

They source it via Google Ads and Bing Ads services. In practice, they grow the list by asking Google’s Keyword Planner for related terms and collecting things like “related searches” from results pages. But sourcing keyword queries like this tends to skew to queries with commercial value, reflecting what advertisers care about.

Disclaimer: I wrote the article

pw378 43 minutes ago | parent

In an ironic twist, OpenAI and others are placing advertising in their AI responses.

jeanpah 37 minutes ago | parent

That sounds bad for the ad revenue

wyclif 35 minutes ago | parent

It didn't affect their ad revenue, which is what Google wanted to get out of the program:

Clicks on ads didn't change, which suggests Google takes care not to cannibalize its own revenue.

slashdev 33 minutes ago | parent

That was my guess too, but it seems like Google pulled it off so far. Clicks on ads didn't change, so Google is taking care to not cannibalize their own revenue.

Did they do unsustainable things that hurt their advertisers in order to temporarily goose ad clicks and earnings? Almost certainly, and I've heard anecdotes about that.

Disclaimer: I wrote the article

xnx 33 minutes ago | parent

Good. Searchers get the information they are looking for faster.

ceejayoz 11 minutes ago | parent

And the authors of that information get screwed, ensuring further information is less likely to be generated in the future.

pcarolan 33 minutes ago | parent

When you typed who is on snl tonight? You used to get 10 pages of clickbait that made you scroll down endlessly for the answer. The best product for most questions is to just give you the answer. That said, the death of discovery is worth mourning. I hope someone solves it but this was dying before ai came along. SEO killed the web, AI killed SEO, and so it goes…

beefsack 24 minutes ago | parent

The big thing that scares me with this is how it's driving further traffic consolidation to the big players.

It feels like the web has just become either social media or AI. There isn't any room for smaller sites to find users anymore.

tempest_ 19 minutes ago | parent

The "web" is basically 10 websites and 20 apps at this point.

rileymat2 4 minutes ago | parent

I want to argue against you, but I just can't. Beyond the hyperbole, maybe we are on the cusp of change. Stuff being posted is AI slop, but maybe it is the Geo Cities obnoxious site of 1999, when an person does it because they want it and not a content farm.

chrismarlow9 16 minutes ago | parent

The layoffs will redistribute it. Builders will build.

devindotcom 13 minutes ago | parent

well.. that really wasn't my experience. when you put "who is on snl tonight," you would get a top row of news stories related to that, probably in this case some (admittedly low effort) post saying "Catch Tom Holland on SNL this Saturday!"

that said, it's true that SEO did kill even that, because the headlines began to be "You won't believe who tonight's SNL headliner is" and they even keep the name out of the slug too.

Buttons840 3 minutes ago | parent

> and so it goes...

Is there anything after AI though? As long as we allow AI to benefit individual people, we seem headed to an ad-free custom GUI future.

As you say, it has already started with AI rewriting web results into a focused text response--a text interface.

Frontier AI models have started drawing little diagrams and creating little interactive apps that go along with whatever they're trying to demonstrate. They also extract images from--well, from somewhere, the web I assume?--and placing those images in their text responses.

I've been using AI to write custom widgets for the game Beyond All Reason (which is open source and allows custom widgets), and it's great even with this obscure API. It can turn ideas into beautiful custom graphics easily.

I don't want to see your ads, or even your webpage. I just want the information.

Maybe with AI everywhere we can finally do some sort of micropayments where the AI can distribute a fixed amount of money on my behalf. I am willing to directly pay a small amount for casual browsing.

Kuyawa 27 minutes ago | parent

If you want to win the war on AI search you just have to have a browser and an LLM answering all search queries. I don't really care who's behind the answer as long as it is right (which 99% of the time it is) so there is no loyalty at all, no need to switch, no need to try the competition, nothing. AI is the answer and it will get better with time

I use Brave, I don't know if it uses Leo (brave search) or gemini, or chatgpt, I just know the answers it gives me are the ones I am looking for and most of the time I extend the conversation with some of the options offered, hardly click on any link below the answer provided (which most of the time those links are garbage)

dboreham 27 minutes ago | parent

This is temporary. It's against their business model to provide a service that's useful to its users.

hn_throwaway_99 23 minutes ago | parent

I'm somewhat conflicted about AI overviews. On one hand, as other comments mention, if Google didn't disrupt themselves, others would. Also, and this is just a personal anecdote (but it jives with some of the data in this article), but the primary times that AI overviews keep me from clicking through is when I just want an answer with information (and sometimes I will click through if it's to a site that looks high quality). So it would appear the sites that get hurt the most are content spam or at least "content spammy" sites that try to draw you in with usually mediocre content to buy something else or show you ads.

But at that the same time, Google is now just vacuuming up all the revenue that used to go to other sites, and that feels blatantly unfair to me (remember back in the day when Larry Page said "We want to get you out of Google and to the right place as fast as possible"? My how times have changed). This is one reason why there is so much general distrust of these tech giants: they start out all "Hey, look how mutually beneficial this all is" and then ends up at "I am altering the deal. Pray I don't alter it any further."

jeffbee 22 minutes ago | parent

Google web search's goal has always been to get answers in front of eyeballs. It has never been to drive traffic to sites. Ads and Search are different product areas. But nobody believes these things.

Sparkyte 19 minutes ago | parent

Google's AI solved a fundamental flaw with old search engines. SEO broke the internet over and over. AI... LLMs being used for searching information is really a good thing.

yodsanklai 5 minutes ago | parent

Let see how this gets broken too, SEO and ads will make their way there too.

jdw64 7 minutes ago | parent

My homepage gets about 400 hits a day, but when I look into it, about 370 are scraping bots and 30 are actual people.