Yes, a more upright riding position is harder on your back. Don't mess with your saddle though. Try adjusting your handlebars to balance your weight between the front and back. A longer stem or bar end extensions can help (though bar ends do move your hands away from the brakes). Narrower handlebars can also help (you can usually hacksaw a few inches off each end). Also try lowering the handlebars.