Every time I've had a bike that pulled to one side, it was due to frame alignment. Folks have blogged on techniques for checking frame alignment that don't require any special tools. If it turns out that your frame or fork are crooked, then of course you have to decide if that's a problem you want to tackle on your own.