I switch back and forth a lot. I like the way the bike feels under me without rack and panniers. It moves better. Yet there are times, particularly in bad weather, when I prefer to have my body unencumbered while the bike carries the load. When I don't have much to carry, a trunk bag gives me something in the middle. I also use a small messenger bag once in a while.