Well there's tough in the sense of skill. Like it's really f'ing hard to hit a 100 mph fastball. Then there's tough in the sense of physical toughness. Like it's really physically difficult to drag yourself over 150 miles and 4 mountain climbs. Then there's mental toughness. Chess players and race car drivers and really mentally tough.
I've played baseball and football but I've never, ever suffered like I did while racing a bicycle.