The smaller wheel, all other things equal, has the advantage in every category except for rolling resistance. However, the tiny difference in rolling resistance is only of importance at low speeds. The faster you go, the better the smaller wheel will be.

This is only valid for typical wheel sizes. A two-inch wheel wouldn't be efficient, and a 200-inch wheel would be highly impractical...