I think everyone feels it, and thinks about quitting. I know I've felt that, and I know other very strong riders who win a lot feel that way.
You're suffering, and you wonder why you do it. Why bother? You're too slow/too fat/too weak to win. It's stupid...but the draw of the race keeps you going, and keeps you coming back.
Competition is both the means, and the end.