Ya, for exactly this reason I leave my wheel in the deep freezer for a few hours, right before I tension the cones...

Axle and ball(bearing) shrinkage can be an embarrassing problem which is best avoided!