As suggested, I ended up adjusting the chain to proper tension in the "tight" position. It never gets loose enough to come close to falling off, so all is good. I used a feeler gauge to measure the runout again (previously had just eyeballed it), and it's actually 0.4 mm. Thanks for the replies.