Sounds like X11 needs its own equivalent of LibreSSL, but it looks like the will is there (many supporters of X continuation), but not the manpower.

In days of yore (when Windows 3 was young), there were even commercial X servers (Hummingbird I think it was), so there's plenty of other people implemented the protocol.