It certainly reduces the potential security downside for Facebook. If someone tricks you into giving up your email password, they could get all of your email but is that a valid argument against letting you download all of your contacts and emails?