"Homophobia" is an odd word for "dislike of homosexuality". None of the people that I know with a negative view of homosexuality are afraid that homosexuals will sleep with them. Rather, they think it is wrong/unnatural/icky.