No its not. Depending on whether I have summer or winter clothes, zero or three meals, my lock, work papers, I bet my pannier weight fluctuates by 15lbs and I never notice it.

Also, nothing wrong with a backpack . . . until summer. Then its sweaty and gross.