In my experience with spray paint it's usually not really dry for weeks if not months. Did the exact same thing to a frame, tried to spot clean where something bumped it while it was drying. Use a tack cloth to clean dust off after each coat and at the end.

If you have a spray gun and can afford it buy two part automotive paint. It dries way harder but you still can't mess with it for awhile. I was told by a professional that if stick your face right next to it and you can still smell paint at all it's not dry.