You could try adjusting your saddle so it is level, saddle angle will affect how straight your back is.