For future readers, I found that after installing gpgOL Outlook then refused to start (and I had the same problems on multiple computers). Outlook Privacy Plugin works but has some bugs (it's still massively in beta) and the author seems responsive to bug requests posted on the github page.