You don't even have to use soapy water, just boiling them in plain jane water is enough.
That's how I've been doing it.

Also I'd assume the soapy water is why you have to wait hours till they set, I just wait for mine to cool back to room temp, which takes maybe 5-10 minutes.