I just poked a small hole in the end of my bar mitts. It actually made them easier to get into by holding them stationary. I liked my left one so much, that I got an old mirror that I didn't use anymore and put it in the right hand side, so I can get in and out of them without them moving around.

Although the location of the hold for the mount takes a careful cut compared to your velcro method.