at 6'1" you should probably be on a 20-21" bike, somewhere around there, depending on the bicycle company.

but why are you having a harder time? if the bike is too small, it's not horribly small, and smaller is a bit easier to handle and maneuver. you probably need a slightly larger bike, but it also sounds like you just need to work on some skills.