The material matters here. Carbon, Alloy and Ti, as well of course the shape and how far they extend affect the ride a lot.
You can also cut a lot of weight here for not a pile of money. More in the $1/g range which is less expensive than many other parts.

If you want stiffer - go alloy.

Can you find a Roubaix seatpost?