Can you elaborate? I would argue that logic has even stronger token prediction characteristics than language.

As a total handwave, I would expect an LLM trained on formal logic and a huge corpus of proofs to produce pretty strong logic output.