I have the same problems too..
I just try to re-adjust during the ride to get change it up...
Find glasses that have thin wires maybe? OR
Put the frame outside the helmet straps versus inside.

OR