Pictures, make/model would help, but is there a screw somewhere on the side not used for attaching the pads? Almost all v-brakes have a screw (sometimes Allen head) that is used to adjust the spring tension which adjusts the brake body and thus the pads in and out.