Fashion police always give you a hard time
I am a huge fan of the Lezyne Road Drive Mini Pump. It comes with one adapter that you can mount to the bottle holder bolts. I put the mount on my commuter (I don't wear always a jersey when commuting). When riding my other bikes, depending on how long the ride is going to be, I move the mount or just put the pump in my middle jersey pocket. I get a little worried it might fall out of my pocket but hasn't happened yet.