I do believe that one movement for CX in the Oly's is pushing a change from "on snow or ice" into "winter sport" with the IOC. This would then give the IN for CX.
Personally, I don't think CX should be an Only sport. Also, probably not enough countries involved to interest the IOC.