Personally I disagree with those who say not to bring long sleeve shirts. My tour in May last year I wore mostly the long sleeve shirts. I was also very grateful to have an even warmer thing to pull on in the campground in the evening. I had a fleecy thing, but wool would be better. I also think you are right on with the shirts over jersey's, if they are good for riding they'll also be good for off the bike. I don't own a single jersey any more. I went with convertible pants last year (the only synthetic in my kit) and they are good if you need extra warmth, regular looking pants or shorts and could work as a form of rain gear. Bandana's were a good multipurpose item that I brought, and I second the zip-ties recommendation.

Oh and another thing, I use regular cargo shorts and wear Andiamos under them. Thus I get the advantage of padded shorts but don't have to bring both cycling shorts and normal.