Shim it, you'll be fine. The other problem you might run into is that you may not be able to get the headset adjusted properly. In which case you might want to look for a new frame.