I don't use a rivet, but rather a "drive nail" with a spiral fluted shaft. Very small sizes can be found at McMaster-Carr (mcmaster.com) , I use the 90081, plus they have pretty much every fastener you'll ever need.