I had the same problem that you were talking about. Never lost a lense, but my vision was much less than I desired because of the lenses float.
I finally bit the bullet and bought prescription sun glasses. They're available with different light condition tints, etc. This might be a suggestion that is too expensive, but I can only say that it was the best investment I've made in cycling in a long time.