If it tastes funny, wash it with dish detergent and water, rinse well several times. Then rinse it with 1 teaspoon of bleach in a bucket of water and let it sit for a half hour. Rinse well several times again, and then let it soak with a few Tablespoons of baking soda in cold water (full) for overnight. Dump the soda, rinse a few more times with clear water, and it should be good to go without any foreign tastes.

Make sure it is washed and rinsed, and thoroughly dried, between uses.

On long, hot, rides, fill with ice and then fill with water, and use it first. Then, go to the water bottles if needed. Fill the water bottles with ice cubes as well, then water.

I find a healthy squeeze of a wedge of lemon, in water bottles, and Camelbacks, does wonders for a refreshing drink of water. You are not making lemonade, just trying to introduce a very slight flavor to the water. It also covers up any chlorine or funny tastes.