Sounds like you've already answered some of your own questions. You need to find shorter, faster group rides. Ones that will end up dropping you for the first few weeks. Also, don't worry about your sprint just yet. And don't worry about avg speeds. Worry about going very slow to very fast, very quickly. You want to race, not do TT's, right?