Rode for many years with panniers.
My dissenting opinion: they really do make my bike handle like a shopping cart.
Now I use a small deuter backpack in the summer, and a larger pack in the winter. If I ever do a tour, I might use the panniers again. But I'll probably just pull a trailer.