Eh, start small. I wouldn't necessarily even spend money on a helmet. Just get some platform pedals, a good floor pump, a spare tube, and a set of tire levers.
If you are going to be riding farther from home, get a portable pump and some bottle cages and water bottles.

Start cheap, and buy more as you discover what you actually need.