I get yelled at so infrequently (twice over the past three years) that it does stay with me. I question my actions, ask others to justify them, and generally am unsettled on the road for a couple of weeks. :shrug:
OP - Tell your wife how her yelling makes you feel, and explain how what the cyclist did wasn't dangerous.