I don't think it'll matter much to anything you do with the bike as far as riding it. However since you noticed it, you should at least check that it is properly in the fork ends.

I might imagine that riding it no handed might be a infinitesimal more squirrely. And maybe your tire or tires will wear out a very few kilometers sooner. But as I said, I'm only imagining that.