What you explained makes perfect sense. You will feel as though you are smelling it in the nose. It's supposed to be a strange sensation. It almost smells like a permeating smell, more than a smell as though you sniffed yourself and caught a whiff of yourself.
Not silly at all- a good question to ask.
Koffee