If you were an African-American Southerner at the time, wouldn’t you be more worried about locals, for this sort of thing? Baldwin Lee is a Chinese-American art professor from New York, I suspect people would not be too worried that he might be a secret confederate.