I guess the guy was being an overzealous traffic vigilante looking for trouble. There was no reason for me to signal when he was passing me the first time. I was over 50ft from the intersection, probably going slower than 12mph. He was probably going 20-25mph when I first looked back. There's no hand signal to indicate that I'm going to stay in the bike lane until he passes.