wear em. Considering cross races are circuit based, you can start the race with them, and if you're in a pinch, you can just chuck them to the side/off course, and still have a high recovery probability. Or, you know, you can stick em in your jersey pocket, or helmet vents.
Anyway, better to have them and not need them, as opposed to needing them and not having them.