Take the wheels out and turn the axles by hand. If they feel notchy or dry, or if there's lateral play, then it's probably time. As said before, with cartridge bearings you won't damage your wheels by continuing to ride them.