The Romans used both north African elephants (now extinct) and Asian elephants which they got by long-distance trade.
Apparently the Asian elephants were larger; and besides I suppose India and Sri Lanka also had better infrastructure for catching and training war elephants than the Roman Empire did.
