badmother has it largely correct, IMO

I've used my ticket (349) on hard-packed trails like the C&O Canal with good results. But broadly speaking, besides whatever effect wheel size has -- ride quality generally gets worse for rougher surfaces as the wheel gets smaller -- the tire selection in 16" is worse than 20". But if you want/need a smaller fold, smaller wheels is the way to go.