On rough roads, the smoother ride of the larger diameter wheels is an end in itself, and I do think it improves speeds a bit as well.

It's also tougher to get lightweight road tires in 26".