Pull the nut on the opposite of the drive side a little further back (so the wheel is angled just slightly) and tighten it. Then pull on the tire to straighten it (pull from near the seat tube), and tighten that side. Be careful doing that though, you can get the chain overly tight this way.