Too dangerous?
Any sport will survive as long as the participants are willing to take whatever risks are inherent to the sport (NHL for instance!). I'm glad to see that they now mandate helmets on the vast majority of the tour - Beloki could have easily died right there on the pavement without a helmet on.
If the riders didn't feel safe (enough) - I'm sure they'd voice loud enough for the organization to MAKE it more secure and safe.