There was a company that had the basket integrated with the stem, it was just one piece, stem, handlebars and basket. But I guess they went bust, and they were about 50 euros if I remember correctly, so that wouldn't make much difference.

You might consider a basket that isn't bolt on but just hangs from the handlebars and is designed to take off and carry with you. They are not all ugly.