I clean the drive train with rags. If I need a solvent, I use kerosene or naphtha, but that's rare and I use a tiny amount. I lube the chain and derailleur pivots every 250 miles or so, but my bike stays extremely clean. The secret is to let the chain lube work it's way into the chain internals (about 30 minutes), then wipe off the excess with a rag; not paper towels, they can't conform to the the chain's outer surfaces nearly as well and they're not as absorbent. I wipe the outside of the chain after the next ride or two then every 3rd or 4th ride thereafter. I don't get any oil fling and very little buildup on the cassette. I've got 2100 miles on my current chain and it shows near zero wear, according to the chain wear tool I use.

If you lube properly and clean off the excess, you won't have oil flinging off or building up all over the place.

Neither kerosene or naphtha is corrosive and both evaporate much faster than water. The same can't be said for Simple Green. It's nearly impossible to get all the water/Simple Green out of the nooks and crannies of derailleur pivots and chain internals, so corrosion is likely, IMO.

I'm probably in the minority with regard to lubing and cleaning, but that's OK!