If you don't want to go the spandex route, manufacturers make a spandex liner short (dont panic yet - sentence not over) that you wear under your regular clothes - gym shorts, jeans, whatever. However, both regular cycling shorts and liners are meant to act as underwear. It could be extremely uncomfortable to wear underwear under your shorts.

Also, a helmet might help you some day.

You can find less expensive jerseys in places on the internet. However be warned that if you come across nashbar.com or performancebike.com be prepared for slow shipping. You could also check your local bike shop's clearance rack. Probikekit.com is UK-based but they have extremely fast shipping (from what I've heard - not experienced yet) and US pricing. There might be a small currency conversion fee, but it's no problem. I think their shipping is free too.