Sounds like a good balance. Our solution so far is that I go hiking and camping with my sister or my Girl Guide group (and sometimes the leaders do a retreat without the girls), and I bike on my own* or with the cycling club. When I'm away doing this, The Boy fills the house up with geek friends and hosts LAN parties. He's happy, I'm happy, we each think the other is kind of nuts, and we get our own space.

*I like riding solo. Lots of nice quiet time to think.