Direct them towards used bikes.

And really all you need when starting is a pair of shorts and a helmet. And neither of those need to be expensive.