like you said, you have a very, very small hole.

the other option would be that your stem is screwed up, but highly unlikely since it is brand new.

my guess is you have something like a staple in your tire that punctured your old tube and is puncturing this one. you need to carefully search your tire (match up the tube hole to your tire).