I usually just use the plastic plugs that come with bar tape, and I've never lost them on any of my bikes.
that said, I've used wine corks on a few bikes, including one of my own, and they work well and look kinda cool, depending on how you want the bike to be perceived