I have had custom frames made both ways and for me, being a largish rider, the CF seatstays make for a more comfortable ride, yet the torsional stiffness was similar to the aluminum one. I haven't noticed very much difference when I'm out of the saddle and loading up the bottom bracket. As far as looks I'm a fan of the CF stays. I just think it looks sexier.

YMMV of course