I'm always pretty surprised by the disparity, I wonder if its an accent thing. Quite frequently we use our HomePod from the other room since they were too pricey (before today) to put in each room. I cant think of a time where its had an issue with us giving it commands even when we're hollering from the adjacent room.
It probably is - I live in London with a spectrum of housemates from about the place and the needed "Alexa voice" is basically RP if you want it to work at all.
Siri has gotten much better for me. It's actually useful now. With my Airpod Pros I can reliably respond to texts using my voice. Music commands are also much better.
I'm not sure if I have just adapted my commands to ones that work, if Siri is improving, or it's both.