I have learned the hard way.
I wear a t-shirt underneath my riding jersey, got it from Excel. works great for coolness and a base layer.

Once you get road rash on your hip, side rib area, and shoulder, you will understand the benefits of t-shirt if you ever have a crash.