I am coming to the opinion that most fans will not care until somebody literally pukes blood and dies going up the Alp'Duez.
This is where I draw the line with performance enhancing substances (which caffeine and creatine are). If a typically qualified rider has to risk their life or their long-term health in order to compete, then it should be banned. This is my argument to all of those blowhards who argue about weight lifting, computers, creatine, caffeine etc... Yes - I agree, these are all advantages that cyclists currently enjoy that (with the exception of caffeine and amphetamines) were not available to cyclists 40 years ago. However, I am fine with technological progress as long as it does not:
(a) Turn the sport into a farce (see UCI weight and frame design rules for this issue) or;
(b) Endanger athlete’s lives or reduce their expected life expectancy.
No one should feel they have to risk death in order to compete.