If you stick with it, you'll be rewarded with stronger legs, greater stamina, a more fluid pedal stroke (on a fixed gear or otherwise), and a better awareness of your surroundings. Learn to work with your bike, and become zen. It shouldn't take more than a couple weeks to get confident, if you ride regularly.
Of course, there is something to be said for just getting on your bike and enjoying it. People might look down on you for not riding fixed, but who cares? Fixed gear riding isn't for everyone. Ride your bike, and have fun doing it.