I don't know why people are emphasizing time over distance. Here's my take:

It's too far if you don't have time.
It's too far if you are not in shape for the distance.
It's too far if you can't keep warm that long.