Ride your own ride. Enjoy the pace YOU set for yourself. If you WANT to go faster, then set that as a goal. If you're just enjoying the ride, then just enjoy the ride. I'm way past needing to impress anyone or even myself. I'm getting exercise and enjoying myself. That's what it's all about. For me, to set a goal that requires real work becomes, well, "work" rather than recreation. I blow off a lot of steam and stress relief by riding. Sometimes I push, mostly I just settle into a nice comfortable pace and go as long and far as I can given that day's energy levels and time constraints.
So like I said, ride your own ride.