Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

More than disk space I think they care about having short links, higher cache hit rates and saving RAM on their fleet.


I find even this incredibly stingy... Back of the envelope:

1043*1000000000 / (1023^3)

10 4 byte characters times 3 billion links, dividing by 1 GB of memory...

Roughly 111 GB of RAM.

Which is like nothing to a search giant.

To put that into perspective, my Desktop Computer's max Mobo memory is 128 GB, so saying it has to do with RAM is like saying they needed to shut off a couple servers...and save like maybe a thousand dollars.

This reeks of something else, if not just sheer ineptitude...


> Roughly 111 GB of RAM. Which is like nothing to a search giant.

You are forgetting job replication. A global service can easily have 100s of jobs on 10-20 datacenters. Saving 111TiB of RAM can probably pay your salary forever. I think I paid mine with fewer savings while there. During covid there was a RAM shortage too enough to have a call to prefer trading CPU to save RAM with changes to the rule of thumb resource costs.


> A global service can easily have 100s of jobs on 10-20 datacenters.

There's obviously, something in between maintaining the latency with 20 datacenter, increasing the latency a bit reducing hosting to a couple $100 worth of servers, and setting the latency to infinity, which was the original plan.


I'm guessing that they ran out of leeway with small tweaks and found that breaking inactive links was probably a better way out. We don't know the hit rates of what they call inactive nor the real cost it takes to keep them around.

A service like this is probably on maintenance mode too, so simplifying it to use fewer resources probably makes sense, and I bet the PMs are happy about shorter links, since at some point you are better off not using a link shortener and instead just use a QR code in fear of inconvenience and typos.


If they really are only purging the inactive ones, this shouldn't impact cache hit rate much.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: