gear ratio maybe? I dont understand what you mean by "wheel swings uncontrollably to whichever side i'm on"
usually once i have my cranks parallel and my bars turned one way, the wheel stays in that direction.
are you shifting back and forth alot to correct it?