What material are you using? I have made the holes for a bamboo frame by using carbon as the base. The grommets were slightly oval in shape so I just drilled small hole and finessed the fit with a chainsaw sharpening file.
I'm not sure that doubling up with most materials will work very well. The groove in the grommet is not very wide.