I chose not to go in 2015. It was a bit over my cost threshold, but part of that is the knowledge that I'd probably also not have much of a chance of a top ten spot. With training and improvement, the prospect of doing the race for a premium cost looks more attractive to me if I am also more confident that I will be still "in the game" all the way until the end, as opposed to just riding on the same road as the race. I can do a solo ride at home without paying or driving.
So there are a lot of variables in the choosing process. However, I don't feel there is any actual problem with charging a premium fee. There is also no problem with me not going. No problem, no complaints. No unrealistic expectations. Just life.