It's my only "road bike" too. I ride to the track, loosen the brake cable, ride, readjust cable tension, and ride home. Roger's been cool with my set up.
I'm currently looking for a dedicated track bike so I don't have to keep switching set ups and gears around depending what I'm doing.