After about 3 miles, my muscles are just finally getting warmed up. But even still, I don't really have any problem getting up to normal speed during those first few miles of a ride.
What is your definition of a recreational ride? How far do you ride, how fast, what is your location (road vs. MUP vs. trails)? How much do you ride besides commuting? Do you eat before you make your commute? Maybe you are trying to go harder/faster than your body is conditioned for.