I relate. Pedestrians are a scourge. At least you haven't had someone jump off the sidewalk and yell "Boo" or some such idiotic thing to try to make you jump, or worse, like a buddy of mine, some guy jumped off the sidewalk and gave him a hard right hook to the face and attempted to steal his bike.
I'd say if there is no motor traffic coming from behind, get well out into the lane. Yell something like "Hey!". Wave frantically. Anything to get their attention when you see those cues that they are likely to j-walk.