One option is to go with toe clips. No fancy shoes to buy. You can also get half clips that just hold the toe in place, but don't hold the foot to the pedal.

If you like the toeclips, then you'll like clipless even better.

If you dislike toeclips, then you probably won't like clipless either.