Moving the seat back, or using a longer crankset will also lower your seat, and lower the center of gravity.

However, how many miles have you put on the bike? Go out and ride a couple of century rides (100+ miles), and you'll quickly habituate to the feel of the bike.