Never too cold to ride. Last winter I rode a motorcycle in -15c and it wasn't that bad. You do have to watch out for black ice though! On a bicycle it should be even easier to stay warm as you are moving slower and generating more internal heat.