On 20" inch wheels you may just get more wear than larger sizes. Simply because there's less rubber involved.

How fast you go will depend purely on gear ratios. It has nothing to do with the wheel size.

Smallers wheels are less intimidating when navigating through pedestrians.

Smaller wheels have more sensitive steering. Easier to maneuver.