There are lots of good, simple window managers (not to mention other utilities) for xorg. Window managers in wayland have a lot more work to do, and are typically more complicated.

There are lots of utilities that aren't available in wayland yet, so you'll often end up with an x server installed anyway.