Pedals could help, make sure your saddle isn't too low as well. Best way I know to dial in the saddle height is to ride around with your heels on the pedals and check that you're getting full leg extension. My knees are really sensitive to saddle position as well.

If dialing in your position doesn't fix it, might be time to consider a multispeed for the sake of your knees.