Two words, Tom Boonen
Ok two more, George Hincapie
Well... just two more. Bradley Wiggins.
Now to assume cycling to be a buff muscular sport is just... inaccurate. Transfer those upperbody muscles to your legs and youll be a great sprinter. Thor husvodt is a great sprinter and he's fairly big.
It's a skinny sport but not necessarily a shortie sport. It's an endurance sport so lightness is kinda the thang ya dig. Like running or skiing.