I did the clothes-in-a-stuff-sack for years. The results were mixed, from night to night, even from hour to hour. Sometimes it was comfy, but lost of times it was lumpy and I'd spend a lot of time fussing with it to try and make it comfy.
Then I got a
Thermarest pillow. Problem solved. It's always comfy, light, and rolls up into a package the size of a big burrito. I'm a side sleeper and want a certain thickness pillow. I fold my towel and put it under the Thermarest. Perfect! It has a soft fleece side. I bought the small size to save size, weight, and money. It seems to have been a good choice. Why buy a pillow that's bigger than your head?
Highly recommended.