I second upgrading to bar end shifters. They're really not that much slower than brifters. At least not enough if you're not super serious. Otherwise, if you have fun go for it!