I also noticed it takes way more time to index sites.
When I moved bitecode.substack.com to https://bitecode.dev, I submitted the sitemap to google and was surprised that it took almost a week to even show a single page as indexed.
This used to be a couple of hours to a coupled of days.
So something definitely changed, but as usual we can only speculate until a googler come in this thread.
Just more spam and scams than they can handle. 0.5% of all the shit on the Internet is real content. And that stat is from 2015.
Their own fault for monetizing every imaginable search query.
It has provided the incentive to ever spammer and scammer on the planet to mass produce copious amount fake interlinking pages massively larger than actual Internet.
Vernor Vinge was wrong about humanity's vile offspring being stock trading bots, and the sci-fi authors were wrong about Grey Goo being a nanobot scenario. We're awash in grey goo vile offspring right now, consuming resources at an increasing rate and turning everything bad - and it's information; SEO spam and content farms and LLM waffle.
Pretty soon the only way to live will be an Encyclopaedia, text books, and cookbooks from before 2010.
Its not a static world. Things are always changing. I have some faith Google(the ad tech part) will start crumbling. Chat GPT has given them a jolt. And there are more jolts to come. Not less. From the Regulators. From the advertisers who know most of the views they get are from bots or totally worthless. And that they don't need to be spending what they are spending.
I'm not sure this fixes anything. GPT/LLM will be able to produce monumental amounts of reasonable sounding bullshit. Google may crumble and fail, but all we'll be left with is small islands of sanctuary in an ocean of bullshit.
Google contributes to the bullshit explosion by incentivizing ppl to game the rankings and results. Same with Facebooks newsfeed. And everyone else that relies on Ads to provide their "free" services. Everyone is gaming these services cause there is money to be made if u end up at the top. Including HN. The failed assumption being whatever is in top = quality. These solutions haven't solved the Info Explosion problem. They have made it worse.
Ironically the free services like search ranking/news feed/like counting etc where the initial half thought out response to the info/content explosion that the early internet produced. They just forgot that was their goal and changed the goal post from getting a handle over info explosion to making everything about rewarding attention capture/maximising engagement and other useless shit in that contributes further info pollution.
So when google/fb etc start crumbling, incentives for the spammers and scammer will start dropping too.
This seems to be a naive point of view. Google is a giant piece of shit, but to think they are the only piece of shit is a failure of imagination at the highest order.
The billions google controlls don't disappear if google does. Instead every scammer starts looking for new markets to spread spam in. And this is just marketing, we're not even talking about politics and the firehose of falsehood.
The problem may not be solvable which is concerning as we are at risk of drowning in bullshit.
I not denying that or saying everything is going to change in an instant. I am saying we are past the point, where Google and the Attention Economy they raised, keeps running the way it did in the last 20 years. We are going to see flat revenues, more layoffs, less data centers getting built, less "free services", multiple large countries bringing out legislation on how personal data, algos can be used, more huge fines etc There is even a UN report released this year talking about how the Attention Economy should really work covering issues on the social, political, ethical and cal and economic front. On top of it the Telcos worldwide are all in huge debt. they have been trapped in a cycle building/upgrading the pipes on the belief that all the data flowing is oil. But if its all sewage then how long does the cycle run? Its going to break down.
The attention economy is the old news now... welcome to the intimacy economy brought to you by AI.
And data was the oil... it was saved in lakes and used build the electronic minds we have now created, and those electronic minds are going to work as nuclear reactors that will process the data we now create, and the data they will create as they are embodied and put into the world. It is going to break down, but not in the way we all go back to a disconnected world without surveillance capitalism, no, the future is going to be far worse than you can imagine when it comes to that.
>Telcos worldwide are all in huge debt.
This has nothing really do to with the economics of selling data, this has to do with companies taking out far larger loans than they needed and using it to enrich their shareholders.
This comment is now the top and only search result for "but as usual we can only speculate until a googler come in this thread." minutes after you posted it. I don't think freshness of the index is a criticism you can credibly use against Google.
When I moved bitecode.substack.com to https://bitecode.dev, I submitted the sitemap to google and was surprised that it took almost a week to even show a single page as indexed.
This used to be a couple of hours to a coupled of days.
So something definitely changed, but as usual we can only speculate until a googler come in this thread.