Thanks for the replies. It was in a parking lot of the bike shop going back and forth turning to test it out. Still I've never been a fairly serious ride up until the last 8 weeks or so and this had never happened to me on any other bike I rode casually and since I was trying it on a M frame, I thought that may have been the issue.

Quick question though, help me understand the physics of it. If it can happen at slow speeds, why can't it happen if I'm pedaling in to a deep curve at say 13mph? It is because during better speeds you don't turn the wheel as much to actually turn?