I'm about 3-5mm off...my freewheel is at the far left where it's supposed to be, and my crank sits as close as my chainring allows it to, just barely hitting the chainstay! I'm a few millimeters off...any sort of disaster I should expect with this setup in the long run?

When eyeballing it, the chain looks pretty straight but it obviously isn't...