Like I said, it may, or may not, be technically legal to claim an infringement on their trademark claim.
However, it is undeniably ******y. Saying that it's legal doesn't make it right.
Only someone that lacks an appreciation for cycling history would think that the name primarily belongs to Specialized. When I hear the name, "Roubaix," I think of the race first, the tires second, Fuji third, and those crappy plastic frames are somewhere further down the list....