A UBI should be universal, so you can't lose benefits - it's only as bad as how you become slightly less rich when your income goes up under progressive taxation.

The closest real problem I can think of is not being able to move to a $15/hr minimum wage city from a poor area because you don't have the starting capital to buy the basics there.