A new stem with 4 bolts should not be expensive. Up to $20.
No need to replace the handlebar.
Take the bike to the shop with you to make sure you get a stem for the correct diameter handlebar.