Non-drive side because it's cleaner. Mounting on the drive side the pannier is more likely to get soiled with chain lubricant and other nasty stuff kicked up by the rotating parts. And, if like me you carry your pannier into the office, you will probably transfer that black tarry sludge to your clothes.
A double legged kickstand will eliminate the lean issue.
Matt