Two things:
1. If you don't want to race, then there's no reason to care much about your weight for cycling. Even if you dropped your weightlifting bulk, you'd still be 6-foot-5 and 190 pounds -- a monster compared to all the featherweights who'd crush you in a race anyway. So ride a bike for fun, or fitness, or both, but not for racing.
2. When I finally gave up on a big bench, I switched to kettlebells, which build endurance and explosive strength. Big pecs never helped me for much outside the weight room; wiry strength from kettlebells helps with just about every sport I try, including riding a bike.