Are you saying you bike commute only once in a while, and you choose rougher pants for those days? Otherwise, why have newer pants?
I would rather wear shorts and change at work, unless somehow you have some kind of magic pants that have the required flexibility to not grab at the knee or bunch around the waist while cycling.
But of course, whatever is working for you, works for you -- keep it up!