The £1 and 99p shops sometimes have basic mud guards, although quality is not great, I had a set that broke very easily. They are usually held in place by only a couple of screws so quick and easy to remove on fine days.
My Cycle Front And Back Mudguards