I'm not completely sure what you meant in your situation. You're saying that you have no body fat except for in your midsection?

There is no possible way to target fat removal save surgery. Men generally carry more of their fat towards the mid section so it's the hardest to get rid of. Do you know your percent body fat? As a general rule, men do not show their "abs" unless they are under 10% body fat.

Aside from having a higher percent body fat than you would like, possibly your posture could be contributing. I've started to notice a trend where people stand in a certain slouch that actually eccentuates how large their bellies are.