I second experimentation. If the problem goes away without the backpack, that strongly points to the backpack being the culprit. However, if the problem continues without the backpack, you know something else is going on. You can solve this yourself.

Things that point to the backpack causing problems:
You are light
The backpack is heavy
Stuff slides around in the backpack
The backpack is loose and/or slides around on you