At first I began by buying just the tools I needed for a given job. The first couple times I just walked into the LBS and told them what job I wanted to do, and had them pick out the tools for me, which I then bought on the spot. Then I got more comfortable in sorting that out for myself. Now I scan new bikes for any tools I might need, and buy whatever the bike might require that I don't already have.