I use Firefox on macOS Ventura, and here the video pages load instantly.

I do have YouTube Premium (paid for in India to reduce the cost), but also in an incognito window where I'm not logged in, the video pages load immediately.

Maybe it's because I use the extensions uBlock Origin and/or Disable Autoplay For YouTube?