But hitting someone in the face is not an act of self-defense, it is an escalation. If someone hits you and you can't get away, hitting them back is justified. But if they grope you, hitting them back is not legally justified, because a groping is not the same thing as an attack.

Just because the groper deserves to get his ass kicked doesn't mean that doing so is legal.