What's often overlooked is just because you have a shit-ton of compute nodes doesn't mean you could make it to the TOP500. You might have the compute power, but the system most likely doesn't have the connectivity. E.g. on the first slide it says this is distributed over more than three locations, which essentially guarantees that the system doesn't have supercomputer-like connectivity as a whole. Worth pointing out that the networking in a supercomputer is a very significant chunk of cost and power.
And if it is tailored for AI, it might not even do 32-bit float, or only at a fraction of the "AI FLOPS".
And if it is tailored for AI, it might not even do 32-bit float, or only at a fraction of the "AI FLOPS".