At this stage of my setup, I can get away without using any side pannier if needed. I have an Escape Pod with my backpack in the pod, however I still have two pannier attached to the rack. I put the smallest and lightest pannier I can find which are made by Avenier. If I need to carry anything extra to and from work, I won't need to worry about how to transport the extra stuff. I do find myself using the extra space usually on Friday on my way home as I tend to get some take out food or even a beer run
The two pannier on my bike does make it looks like I am touring. I get some of my funniest question and conversation when I am on the train. I usually get asked how far and which state I tour from. My best answer is that I pedal all the way from Hawaii. Some times they get it, while others don't.