Look at your shifter from the side of the bike, you should see a screw that the shifter pivots around.(it might even be a loop of steel wire acting like a wingnut). This screw regulates the friction in the shifter. Tighten it down a bit and see if that isn't enough to persuade your bike to stay in the gear you've chosen for it.