There are several kinds of infinite. The kind where assuming the universe can be arbitrarily large would eventually allow you to encounter a parallel or subtly divergent Earth, with a historic Napoleon and where people speak Hindi, probably isn't the kind of universe we inhabit.
