Spandex shorts with a chamois that are loose can cause some chafing(minor) but if they fit correctly are far more comfortable than wearing BDU's or Dickies.
If you want comfort, get some real cycling shorts. If you are worried that others might think you are gay, then get a Humvee and a shotgun and go watch some NASCAR.