You know, I use acrylics for my paint infill jobs - Tamiya acrylics from the hobby store. I've never had the paint-lifting issue you speak of here, and I use the technique you describe above (although I usually use Goof-Off vice mineral spirits).
Just a suggestion.
DD