One awesome thing (depending on where you live) is the second hand market in the UK. Some of the bikeswaps have amazing stuff and I definitely seen some very nice track/fixed gear frames at places like the Ripley meet for less than 150 bones.
I'd say the trickiest part of any conversion/build is getting the chainline right (as well as staying within budget).
Wheel building depends a lot on where you are.