Hi merlinextraligh,
Sounds OK to me as long as you didn't make a big move into the middle of the road.
Twice on Sunday, in a Masters 40+ crit, there were guys coming back into the field after punctures (free lap). On separate occasions, each of them were on the outside of a very wide road and came slashing into the middle of the field. They were going 5+ MPH slower than the field.
The second guy made his move just in front of me and I swerved further left to get around him and yelled at him as I went by. No one yelled at me for swerving so either I was OK or those behind were also busy moving around the bozo.