I don't take off anything other than the computer and sometimes lights, but I'm lucky that the bike rack is in the parking garage and within 20 yards of the garage staff, whom I'm friendly with. I still use a u-lock + cable lock though.
If I had to lock it on the street I'd buy a commuter-specific bike so it would be less of a target, and take off or lock anything that can come off quickly.