I tried this trick too, but What if it’s sunny/too hot for a coat?

Hello from Houston! I personally use a small backpack that I leave my keys, wallet, extra charging cords and a dedicated set of diabetes things and anything that comes out of that bag goes straight back when I'm fine with it. Works pretty well

Maybe you use an alternative like something to clip on a belt?