It looks like the bottle is recessed so that it nests on the frame bar. That would keep the bottle from slipping off or rotating, but it looks like you could remove the bottle easily. My issues would be the strengtt of the magnet versus being able to pull the bottle out and the ease of which one could align the bottle to put it back.