I don't look good in lycra. Trust me. But I wear it anyway because it's designed for biking, I don't have sores from seams and I the chamois is helpful. Surprisingly, they also don't get sweaty. I can sweat out and stink up those polyester jerseys in my 9 mile commute. But the shorts seem dry after a 40-50 mile weekend rides. I do wear underwear so that I don't have to wash shorts daily.
I just wear black shorts and solid jerseys and don't feel like a poser. The cycling clothing is more comfortable than regular clothing which sticks to you. At least get some all polyester micro-extra quick dry type shirts. Cycling jerseys with zippers are better. Shop around and you can probably find some for under $20. ebay or CL might let you find something inexpensive to try out.