I have done a few club rides on the fixed. In my town, there is a dedicated fixie ride on Sunday mornings that is about 30 to 40 miles, depending on the ride. Most of the riders are racer types that use fixed as part of their winter training regimen. As an aside, one guy has an amazing Calfee with track drop outs. Apparently Calfee made a handful of these at the request of Greg Lemond or some story like that.
I do have a geared road bike that I also love to ride. If the ride is especially long and has lots of climbs (there are mountain ranges where I live) I will take the geared bike. Don't fear the gears! :-)