Getting perceived to be crazy just goes with the territory, so it's something you need to get used to.
In the winter months, I rarely encounter other cyclists -- there's nothing unusual about going a month without seeing one. When I do, I sometimes think of them as nuts even though I'm on my bike when I see them. Everyone is crazy except me.....