Fit and saddle might be the issue but it might also be dehydration. I get terrible lower back pain when I don't drink enough.