It really depends on the type of steerer. If its carbon, doing what you suggest, is asking for a deformed or crushed top part of the steerer or slippage. If its steel,.... and you have a double bolt clamp on the stem, you are more likely to be OK.