Thats exactly what amazon tried to do here, but because the AI based its decisions on amazon's previous hires (that is, almost no women) and blinded the AI to gender, it instead proxied women for one of a dozen other things such as school, courses taken, etc.
So yes, it is EXTREMELY hard.
https://www.reuters.com/article/us-amazon-com-jobs-automatio...
Thats exactly what amazon tried to do here, but because the AI based its decisions on amazon's previous hires (that is, almost no women) and blinded the AI to gender, it instead proxied women for one of a dozen other things such as school, courses taken, etc.