>You need your card to do anything.

I have not had a physical social security card in many decades. I think it was in a wallet that got stolen in the 1970s and I've never gotten a new one and never needed one (or even been asked for one that I can remember).