and you wouldn't have to file the stem to fit a larger bar.

do it, it's fine. i've done it. it's not ideal, but if you tighten it just right, nothing gets damaged.