It doesn't cost him anything, because the interest rate on the loan is virtually guaranteed to be less than the appreciation rate of the underlying asset.
Don't confuse consumer and central interest rates for discretionary loan interest rates. The ultra-rich have been taking out ultra-low interest stock-backed loans to cover their living costs and obligations for over a century, and no billionaire has ever been "wiped out" by interest loan.