I doubt you would actually be ticketed for it, but riding a bike without front, back, and side reflectors is technically illegal in most states. Lights are required in a lot of places, too.
I say keep them, unless you ride really rough roads or off-road. They do break and fall off. Maybe take them off and use reflective tape on the fork and chainstays? There's no movement there, though. The roundy-roundy is what makes wheel reflectors effective. Makes it obvious that it's a bike, even if the reflectors are the only thing visible.