Welcome to biking.

Chances are, your back will get used to cycling and the soreness will disappear. If not, you might want to consider getting a recumbent bike. No sore backs with 'bents.