Get some cycling shorts and let them take the wear.

There are more cycling shorts styles and types than just lycra... find a style you like, and change in the bathroom at work.

I just don't understand why folks insist on wearing office clothing or even blue jeans for bike riding... when cycling specific clothing exists and works quite well. Would you wear office pants when riding a horse? Do you swim in heavy twills?