+1 on merino tops. A plain merino T shirt will do the job but make sure it is superfine grade (non itchey).
In winter you dont need to sweat on a ride and you can use the last 1/4 mile to cool down. In summer, chuck a bottle of water over your clothes during the cool-down.
You can store your clothes in a mesh bag.