I bought a trekking bar a few years ago, for the same reason, but I have never tried it. I think I may throw it on my back-up hybrid just to give it a try. I even have angle adjustable stems in 2 lengths, so I can obviously fiddle with positioning to get it right.

As far as what people think... unless they are the people you are building the bike for, don't sweat it. DO what makes riding your bike pleasant for you.