I race my commuter bike but switch out the wheels for racing (entirely separate wheelset so don't have to change tires). Yes to the drivetrain wear and tear. But I also use my commute as cx practice by riding on grassy median strips and through grass in the parks. I used to practice dismounts at stop lights but that was a little too geeky.