If you have some extra steerer tube under the stem so that you can install a second stem, you can put a stub of handlebar in that second stem and mount the bracket to that instead. If however your steerer tube is carbon, that might be troublesome, I have no knowledge of carbon stuff.

I described this in more detail at a different post.
Racks/Bags and Interrupter Levers