You're right of course, but the "correct" amount of alcohol is still going to be much more toxic than most other foods that enter your body. Alcohol is a poison.
Methanol is a poison, far worse than ethanol, yet you've likely consumed it in small quantities from what you would think of as non-alcoholic sources. If there's no safe level alcohol consumption, you'd best stick to consuming your fruit unripened or avoiding them entirely. Again, relative toxicity is meaningless without also taking dose into account.
You could easily say the "correct" amount of oxygen is toxic, much more so than nitrogen even at sea level, and not be technically wrong. Change up the pressure and mixture and you might find the nitrogen causing more immediate (though not toxic) danger.
Now, how would you define "safe level alcohol consumption"? Are you satisfied with just still being alive the next day after you had a drink? Or do you want to avoid long term negative effects like cirrhosis, cardiovascular disease, cognitive impairment?
For me the "poison" is a substance that when ingested has a significant detrimental effect on one's health. Until recently there was a myth that moderate consumption is harmless, or even beneficial. The research like this show that even small dosages have negative effects. Moderate drinking might not kill you immediately, but still it is healthier choice to avoid alcohol completely.