The audio latency problem is solved with spatial audio. In VRChat you can easily follow a conversation with 10 people talking over each other, because the audio comes from the direction of their avatars and you can tune it in and out naturally like you do in real life.