To not punish any rider for any reason is pretty silly to me. It's my opinion that, in any sport, it's your duty to stick it to the competition. If you find that inspiration from their fans, your opposition itself, or any other source, it is your duty to, within legal bounds, pummel anyone who stands in your way. It's what you spend hours each day training to do. It doesn't make Lance a baby, it makes him a competitor.
I'm not even what you call a Lance fan, but I respect his unwillingness to give out gifts in the tour.