Yeah, FFMPEG famously had a troubled AAC encoder for a long time. It's a bit better since FFMPEG 5.0 was released recently. There is a huge difference between AAC as a codec and the quality of file FFMPEG can generate for it.