Yes! I completely get what you mean. I ride a bicycle for fun. Sure, it is also helping me get in better physical condition. That's a really good side effect. Frankly, if it weren't fun, I wouldn't do it, evidenced by the fact that I avoided exercise and found my self rather unfit in the first place. :-)

I started commuting to work because it's a reasonable distance (11-12 mi each way), and I really like it. It's a great way to start the day.