I had all sorts of back aches, knee aches and hand numbness on my bike that I thought was fit correctly. After fiddling with the seat height I gave up and went to my bike shop and had a bike fit done. They adjusted the saddle height higher and replaced the stem that's shorted and higher angle. Now my rides are pain free an comfortable. I still have to work on my core but other than that, I'm happy.
My Suggestion, go get a bike fit at your shop. It's worth the time and money.