I use a small metal thermos. For something plastic I just buy a 20z bottle of something and use it a couple times, cheap enough to replace regularly. If hell bent on using those plastic bottles I would wash it out with lemon juice. It helps, but you will still get that plastic taste if you leave water in the bottle all day.