OP; is the frame too small or is the stem jacked way up high to almost provide upright bars? If it is there for the second reason, then could be a good opportunity to switch to upright or one of the Randy bars.

Either way, be careful that you have the stem or the adapter inserted past the minimum mark.

/K