Check Sheldon Brown's page about gears and cadence. I thought that having a higher gear = more effort = more exercise, but apparently, it doesn't really work that way. Find a gear that fits your natural cadence, and things will improve a lot - worked for me!
Edited to add:
http://sheldonbrown.com/gears.html