For cleaning chains I use Pedro's Orange Peelz and shop rags. I use nitrile mechanics gloves so I don't get it on my skin.

For cleaning the frame, rims, hubs on the bike I use water, paper towels, shop rags, old toothbrush, and a cleaning brush that sort of looks like a paint brush. For grimy spots on the frame Mr. Clean "magic erasers" work great.