It sounds like an adjustment but you can get a device called a dog tooth that will help prevent the chain falling off. It is a curved canine shaped piece of plastic that attaches to the down tube at about the height of the top of the inner chain ring and is a mechanical aid to keep that chain from coming too far off the teeth (it doesn't touch the chain)