As far as stability, there are always the trikes.

I wrote a little summary here a couple of days ago.
Adult Tricycles

The tadpole trikes are very low, so good if you can get up and down easily. I don't know how they would interact with NYC traffic, but I am sure you could find your place. And, really hard to roll them.

And, they would still be good exercise.