It sounds like your watter bottle bolt thing (don't know the real name) is loose. It simply needs to be crimped back into place.

Frame manufacturers install those bolt things by crimping them like a rivet (in the underside). Your LBS should have a little tool tool that screws in the bolt and crimps that rivet back down. It's a small, hand-held tool that takes care of the problems in less than two minutes.