You could dremel them off, but it won't be all that clean looking. I used a blowtorch and heated them up and they just popped right off. Faster and easier. I also took the cable guides off of the headtube and the rear stays in the same manner.