For me personally, no.
If I have to (flat on the road bike) or need to (rain) ride a more difficult or less fun bike, sure, you do what you need to do. BUT, with that said, my mountain bike with slicks doesn't even compare to my Miele road bike. It's not even a night and day difference. It's a world of difference between the two and I wouldn't have it any other way!