One thing you could do is find a small rack, a porte-paquet as the French call it, which is designed specifically to support the bottom of a handlebar bag. Nitto, Dia Compe, Velo Orange, and others make them. Here's the page for VO's racks. https://velo-orange.com/collections/front-racks