If you get into low spoke count wheels, you also reduce air resistance. There is really not much difference between 32 and 36 spokes--- in any regard.

I would focus on type of spokes--- since there can be a big variation in cost between butted and unbutted.