Riding a bike from point a to b is cheap. Keep away from sites like this that have it all broken down by product. Just get a bike and go. I would check out ultralite camping sites for tips on what to take to keep all your gear under 10 pounds, add a patch kit and hope for the best. The real gear, which is expensive is what you get after you have slummed it a few times first and really want to specialize.
http://www.rayjardine.com/papers/treadwheel/index.htm
http://www.rayjardine.com/adventures...Bike/index.htm