It sounds like you've already made up your mind to not enjoy the ride. Don't worry about it so much. If the ride is too slow, don't ride with him again.