As a long time ebay buyer and seller, I've never had an issue of any kind. My address is not readily available on ebay. It becomes visible on Paypal if I buy something, obviously.
I never use ebay labels. I just write out my own and attach it.
I hate to say this out loud, but I think you're over-thinking a non-problem.