Midair collisions not near an airport are vanishingly rare. The takeaway from that for me is that concentrating traffic (such as would happen when you take one degree of freedom away) would materially increase the risk.

They're also rare in absolute terms, even including the near-airport ones.