Looks like I have a few things to look into. I don't think its the Magnesium though, because it can start to irritate me a bit earlier on the rides too.

I'm leaning towards the bad posture, potentially with a bit of core-strength issues. But more than likely the posture.