Sounds like bushing slop in your fork. In a cheap fork you get little option but to replace. What fork is it? Not inexpensive maintenance on a good suspension fork either, but one that just comes with the territory periodically.
PS while annoying, doubt it's much of a safety issue.
Last edited by bikinfool; 04-12-10 at 03:07 PM.