I tried riding fixed for a while but never warmed up. I've been riding single speed for a while and with all due respect to fixed gear riders, I personally don't understand that zen/oneness stuff. I enjoy riding my bike, it's kept me in shape and I wouldn't have it any other way.
Like most ppl here have said, get a flip flop and decide for yourself. Choose what brings you the most joy. At least you are choosing to ride a bike. Good for you.
REMEMBER just ride what makes you happy.