Keep it simple to start off. Get platform pedals, a cheap helmet, a spare tube, a pump, tire levers and learn how to fix a flat. Get out and ride then get the rest as you ride more and have a better idea what you want.

Think back to when you were a kid, what did you have then?