Save part of your budget for helmet, cycling shorts, gloves, jersey(s).

You can skip cycling clothing until you decide to stick with it. Otherwise you may ride for a month and change your mind, and have lots of surplus clothing to get rid of.

You may want cycling specific shoes at some point, but start with sneakers/trainers and cheap flat pedals.
.