The seals are fine.
You pedal with your Feet, not your Hands.

Remove them and introduce contaminants to your bearings at your own peril.
Is the short term gratification of seeing a wheel spin in your hands worth it's long term lifespan?