Be really careful about using solvent based stuff around moving parts. Solvents can creep inside the wheel bearings, freehub seals and bottom bracket cartridge seals, and dissolve the grease.
Most of the dirt can be removed with a dry cloth, or water and detergent and a brush.
A clean chain is important, but clean cogs are purely cosmetic. Dont wreck your bearing to make you bike look pretty.
Dont forget that the rear mech pully wheels need to be greased or lubes.