Good story! The road in front of our office is a long sloping hill, and we probably get 10 or so cyclist per day passing by. You can tell the electric assist ones, because they are CRUISING up the hill with a cadence around 40. It looks really weird.
To be honest, getting passed by "someone that shouldn't" bothered me when I first started riding. Probably because my perception of my athletic abilities was not in line with reality. Now, I don't care so much. I go out knowing what my purpose and goals for the ride are, and don't worry about what others do.