I'm surprised nobody's mentioned it yet... but if you don't already have one, get a helmet.

You can also pick up a cheap cycling computer that tells you your speed and distance. Depending on what kind of person you are, they can make riding a lot more fun.

Have fun!