The only thing I don't like stuffed in my jersey is my rain coat. It is kind of bulky and it makes my back sweat like crazy!
After looking at my gear last night I discovered that when the jacket is stuffed into its pocket the bundle has a couple of nifty straps on the outside. I used the straps to fasten the jacket to my top tube and it seems to fit pretty well. I rode this morning for a couple of hours and it didn't bother me.
So, the rest of my gear will go in my jersey pockets. Other than a few extra packets of electolyte drink for my water bottles and an extra tube, I won't be carrying anything special for the ride.