Thanks for all the advice guys.
I've already tried tilting down the saddle, but my body just tilts along and the issue remains. Besides that I keep sliding forward when the saddle is tilted down.
So first I will be tilting it upwards, see what comes of that. If the pain remains, I will loosen the tension slightly to see what happens.
I'm sure I don't want to get rid of the saddle at all. The original saddle I used created friction in the perinial area, causing little bumps to emerge and pop open once in a while. Even with the pain the Brooks has been giving me, it's already caused all the bumps to go away and get rid of that pain, so it's quite a good buy already.