Listen to the old man. Wrong as he may be, he's still your Dad and that trumps everything else. Besides that, consider that the people you see pedaling with half the effort and twice your speed are probably doing so because of many more miles of riding and conditioning than you have yet.... clipless pedals do make it easier to go faster.... but not by That much.