I agree with all of the above - practice in a safe environment. Rides slowly, practice stopping and starting, etc.

One other thing I'd add is to look toward where you want to go, not where you don't. Some people focus on a rock and end up hitting it because their attention is on that spot. Look at yourself when you slow down or accelerate from a stop to see where your eyes are settling. Maybe you're getting nervous and looking down?