I'm sure your speed will go up as you get more comfortable and adjust to riding in a bent. Every person I've talked to riding a bent tells me that they fly on a bent. I got on a bent at the Chicago Bike Show, and I was slow too, but the more I rode, the more I was able to get comfortable riding it. I was falling over all the time, but by the end of the 3 days, I was zipping around the area. It will just take time, but with time served in the saddle, I bet you'll be leading the pack by the beginning of next summer! Don't let intimidation hold you back from experiencing a great time on the bike and the chance to work with folks who will push you into becoming the faster bent rider I KNOW you can become!
Welcome to the forums, and good luck with the bent riding. Now go out there and join that cycling club!