Bolts coming loose is not uncommon. Yes indeed, tighten them up.

Is it the handlebars or the pivot on the adjustable stem that's come loose? I'd guess the latter. If the problem is not a loose bolt, that should become evident when tightening bolts doesn't fix the problem.