Sometimes the accessories make all the difference. If you're not squinting, chafing or going numb, you're free to enjoy the ride. I see no weirdness in prioritizing how you spend your money. It's not as if you're buying stuff to make you go *faster* and ignoring the bike...
But yes, we look like nerds out there.