I have an 03 Elite..I am not sure about the 04 bike because I haven't seen it, but my 03 doesn't have the elastomer into. But they may have changed that for 04.

I think with the proper fit and a good seat along with the seatpost will give you a decent ride. I have a carbon post and a seat with Ti rails, and have no problems with harshness(note that I am only 19). I think Specialzed has Cro-mo models of the Allez bikes, you might want to look into that.