A 20-25 in a 32 tire? That is a bit of a stretch! ;-)

Yeah, you can do it. You are basically going to have a thinner tube (maybe similar to a light tube?) that is stretched under more tension. I'm guessing that a leak might leak faster and easier, but if you don't put a hole in it, it should work OK.