proper gloves = rubber/latex/vinyl. Anything to keep solvents off your hands.
My highschool art teacher used to paint in oils with bare hands and would clean them with turpentine every day. One day it started to look like it was raining everywhere to him, even indoors. It got steadily worse and in a few days he went blind. He had dangerous levels of turpentine in his blood and it took over a month to get his sight back and he hasn't got a drop of solvent on his skin since.
I have worked with acetone with bare hands (never again, I had a serious deadline that could not afford time to go and get gloves) and it has made me feel absolutely terrible, with blurred vision, full body pains and a nasty headache. That stuff is deadly. Absolutely do it outside and depending on the solvent it may be a good idea to wear a mask