If 3 miles makes you not want to ride tomorrow ride 2 miles.
+1. IMO, I think it is better to ride 2 or 3 miles at a time and be happy than to overdo it with 10 miles and be miserable for the next few days. Eventually those 2 or 3 miles start to magically grow. Also, 2 mile rides done several times a week is better than a 5 or 10 mile ride done once a week.