Let's turn the situation around. Suppose it had been you turning right and coming up fast on a much slower cyclist. Then suppose that just as you were about to pass he moved across to the thru lane, causing you to brake to avoid hitting him. And suppose he had done this without signalling his lane change.
What makes you think this is what happened?