Unfortunately it does bother me. It's so bad I must turn off or at least cover red LEDs before I can sleep. E.g. TVs. Thankfully for our bedroom TV we recently switched to a Sony TV recently which doesn't seem to have a standby LED at all – such a godsend as it can be turned off simply by pressing the remote and it turns off without a standby LED.
It's not bothering your eyes. It's bothering your brain. In a dark room a red light will not make your eyes lose their ability to quickly see in the dark like the other colors do.