You'll have to adjust one brake, and it may or may not be possible to do so depending on the brake reach. The only other downside is not being able to swap tires around, so if you wanted to carry a spare you'd need two. The tubes are pretty much interchangeable.
Oh, and since the front will be higher than the rear, you'll always be riding uphill.