My real estate question: is it possible to buy property in Toronto to build a house without being a squillionaire?

I'm assuming not, unless you happen to luck into something, know someone or buy a lot with a burned down house or something. I have dreams of a nice modern green home (possibly pre-fab), but I don't think that will ever be realized in this city unless they change their minds about laneway homes.
also: bicycles.