I hear you guys. I don't like my bike to look cluttered, either. On the other hand, I want to avoid carrying a backpack or a pannier as much as possible. I do keep a U-lock at work, but I need to carry one when I go out on a leisurely ride on the weekend.

My tools and cellphone go in my under-the-saddle bag. My wallet and keys are in my pants pockets. All I need to worry about is my U-lock. If I can attach it to my rack, that will do. That's why I ordered the brackets the OP mentioned.