Videotape her doing what she's doing and then take it to the cops and see if there's anything they can do. Or talk to her directly. Or talk to the cops first and then do something direct.
The thing about doing something subtle and indirect like passing by her house so she knows this-and-that is you have no idea what she'll think, if anything. I for one do think your idea is wacko for the simple reason you think you know what effect riding by her house will have. That is pretty wacko. Someone who feels OK doing what she's doing probably isn't going to react in the way you think and probably isn't going to learn the lesson you think you'd be teaching her. I'd say leave no guess-work out of it if you really think she's a danger to you.
I seriously doubt by riding past her place she would
__________________
Lemond Zurich, Cinelli Hobootleg Geo, ICan gravel bike, Tifosi Rostra, Specialized vado turbo