I've had that problem when riding fully loaded during tour. Like Cyccommute said, pressing one leg to the top tube seems to help, particularly when cornering going downhill. This is where low-center of gravity front rack and panniers can help, it seems.