I do that already, but they're not supposed to fit that way and thus are not as comfortable.
I guess ill just start looking for something that sits off my face a smidge; Trifosi sit close to my face too. Doesn't seem like anyone has made good cycling specific sunglasses.