How about a bag without a rack?
https://www.revelatedesigns.com/inde...=4&ProductID=1

I've been commuting with one for a few months, was using a backpack previously. Goes on and off, moves between bikes more easily than a rack. No problems with contacting the bag while riding, bag sway, or bike handling.