I have learned something from this thread!
I didn't know that looking down (or concentrating on the front wheel) made things harder. That is exactly what I do... I stay fixated on the front wheel and don't dare look away

I will gather up all the courage I can and stare ahead next time.