I know there's a group that gets together for Saturday rides somewhere near Maryland, but I can't tell you how fast they are. There's a link via the Adventure Cycling page...hold on a sec.....
here it is:
http://www.ycscu.com/
I'm relatively new to road biking and not that fast yet. Looking for a group I can ride with, too, but I work in Harrisburg, making it all but impossible to be back in time for evening rides during the week.
Good luck!