I've got a couple of pair of Aerotech shorts with relatively thin chamois that, even though intended as stand-alone bike shorts, make excellent liners under trekking shorts or even jean shorts. They are very comfortable even for long rides and reasonably priced. When I'm riding in an organized event or a group ride with lots of other spandex-clad people, I wear the cycling shorts and a jersey, but when I'm just out for a cruise around the lakes or a ride through the surrounding small towns, I'll wear light weight riding shorts under other shorts and don a tech t-shirt or mountain bike jersey (similar material to road bike jerseys but usually with only one small zippered pocket on the back or side and more of a t-shirt fit. The longer tail is nice when riding. MTB shorts are another good option for those who aren't ready for the spandex look.
No matter what you choose, get what works for you and don't worry about what others think.