If it is spackling, you may be able to remove it with just a moist rag. If it turns out to be paint, try a rag lightly moistened with mineral spirits.

Neat and funky old saddle. Looking at that rear badge, I wonder what vintage it is?