I ran without any AV for years and never had any issues. Intelligent web use is generally a better protectant than AV programs. I use Defender now, grudgingly.

As you say, CFA is probably the most useful part of Windows Defender. I was very glad to see that included.