My back pain is always related to whether my core is in shape...
If I do situps or crunches, my back is more flexible and doesn't hurt on or off the bike. If I slack off, the back feels VERY uncomfortable on the bike, and hurts after a ride.
Try doing crunches every day.
bk