i would think there would be undue movement and chafing if they were really too big, and the chamois padding is made to go in a certain spot anatomically, but i wouldnt think a few pounds lost is going to effect you much either way, good luck!