You don't mention just now much of a change you're considering.
Up to a point the use of spacers or longer stems is OK. But when you start shopping for extreme length or want to stack a collection of spacers under the stem you really do need to stop and consider. Sure, it'll be rideable. But it won't be an optimum ride for a number of reasons if you resort to extremes on a few spots.