When replacing the tube I take it you are partly inflating the tube before inserting and then when the tube is in, pushing the valve stem into the tyre a few times to make sure it isn't trapped. Again it's worth checking that the stem is sitting centrally in the hole of the rim before inflating. Forgive me if this is already routine for you.