My only concern would be with the stem. Boring out a stem - even a little bit - could weaken it significantly. This could be very dangerous in either position. You might be OK but it could break unexpectedly at any time - soon or in the distant future. If it is going to break, it will break when under the most stress.

Be very sure this modification is OK.

I doubt that many on this forum are concerned with how your ride looks if it suits you.

Good luck & have fun.