I doubt it is your brake calipers. I would look at your headset and make sure it is adjusted correctly.
__________________
I'm not one for fawning over bicycles, but I do believe that our bikes communicate with us, and what this bike is saying is, "You're an idiot." BikeSnobNYC