I have done that before, mostly with the Gatorade bottles because once that ice melts to room temperature it tastes horrible. I prefer carrying around a stainless thermos with a few ice cubes.