+1 anything stainless, like the Kanteens. Stainless will nuke your water in the sun, but it's as icky-free as you can get

edit: food grade stainless, like the Kanteens. Cheaper bottles may not be food grade.