Your fork is probably bent. But...

Turn the front wheel around, and see if that makes any ride quality difference. I doubt that it will, but the test is easy.

Next, have a really good and critical look at the fork. From the side, do they seem to line up with the head tube? From the front, does the wheel rims evenly split the distance between the fork blades. If no to either question, then the fork is bent.

Hope this is a help.