That's a good question.

In order to know whether or not the AI was wrong, you'd need to do some research. Otherwise it's about as reliable as any "fact" some random person on the internet claims to be true.

Talk about missing the point. Why should I spend my time fact checking the output of a glorified, stochastic parrot?

Because your competitors are using it, and they are going to flatten you.

Effective tool use is kind of a big deal.