I commute about 25 miles a day and I like having coasting/double breaks from the single speed.

I think most of the fixed love comes from having a slightly cleaner looking bike and doing stands for fun. You do pedal more and all that but it's not any different going up a big hill (depending on the size of your cog).......which is where you get most of your workout anyways.

I'd say it depends on where you live and what you do, and what makes you comfortable.