I use Deuter panniers, they satisfy the sturdy (one of then got run over by a car with no damage done) and easy to remove criteria. However, the cheap aspect could be a problem. I think the best thing to do is shop around. When I bought my last set, I saved $60 by walking two blocks across Brisbane from one bike shop to another.