I'd drill out the rivets, then tap the holes with a 2-56, 3-48, or 4-40 tap (depending on rivet hole size in head tube), then use a machine screw to reattach the head badge.

The Paramount badges are attached with small machine screws instead of rivets: