Just realized my custom bar end idea isn't going to work unless I weld them on after attaching the bar to the stem and don't mind that it's never coming off again.
Which I don't really. Was originally going to make this stem with a bit of old steerer and just weld to the handlebar instead of making a clamp. But the original stem looked stiffer being ovalized.