As one who has used both the only benefit for panniers is with a big load. For work clothes Panniers are overkill and invite the rider to carry more stuff. Plus the weight of the rack and bags is much heavier than the weight of a backpack. Finally a backpack is usually much cheaper than a good rack and panniers combo.

I think it's always important to point out that you don't need a bunch of special equipment to commute.