I actually never thought about trying it when I was younger but I tried recently and pretty much mastered it in 3 days, steering around potholes, other cyclists etc. Basically started from page 1, just kept practicing and trying. Each time using less pressure on the handlebar, using finger tips.. 5 seconds at a time, then finally letting go. Sitting up and putting the weight to the rear was the biggest thing. The gear made a difference, easier for me to do on one where I am half mashing like Darth Lefty mentioned. Try a breathing exercise, in the beginning I would always have to grab the handlebars because the wobbling was caused by me being tense. Breathing paces me while pedaling.
Then again.. it could be just the bike