I haven't worn padded shorts for years and opt for light nylon shorts with a panel sewn into the crotch to eliminate the pesky seams. I have found a regular golf or tennis shirt is much nicer looking and just as comfortable. Other than appearance, there is no reason not to wear "roadie" kit, most people do.
Marc