Even when commuting to school at 6 in the morning when it was about 35 degrees out, the most I wore was 3/4 length pants, full fingered gloves, and a windbreaker to keep my torso warm. Granted, I was only doing about 5 miles in the mornings when it was that cold out, but if you are going longer, might want to get something a little toastier.
I am the same though as my legs always seem to be one of the last things to get cold. It is rare that I will actually need something warmer for the legs. Also, the cap is definitely nice an keeps short haired people warmer on the noggin.