Start stretching your hamstrings now. It takes a long time to get anywhere but you'll need to be limber to be comfortable in a lower position.
You can lower the bars by using a different stem and/or swapping spacers from under the stem to on top.
Try lowering the bars 5mm or 10mm at a time. Get used to it at each stage. The more time you spend stretching the faster this process can go.