When I first started I didn't bring a tent. My rides were usually weekenders and I wouldn't go unless the weather report said no rain. However, even for weekends, I'd bring a tent now - to get away from bugs and for some privacy.
I don't bring a warm coat. I bring two poly-pro long underwear tops - one very lightweight and one medium weight. That gives me choices - one or the other or both. I bring a fleece vest - why bring sleeves if you don't need them. When it gets really cold I put them all one with a t-shirt underneath, and put my rain jacket on top. I'm warm enough under almost any conditions. If I'm still too cold I go to bed.
If you're a minimalist a small, one-man tent might be what you want. I bought a Eureka Backcountry 1 that was very light and excellent protection against rain and bugs. However, it was too confining and I instead went with a 2-person tent in which I can stretch out and have a little room around me for my stuff.
In those early days I didn't bring a stove (I didn't have one and was too poor to buy one.) I ate tuna fish out of the can, fruit, beef jerkey, and cooked canned food over a campfire - in the can. Now I carry a backpacking stove, a couple of pots, a plate, knife, fork, and spoon, and I'm much happier.
It's kind of like that - you deprive yourself to save weight, but you make choices to bring certain things to enhance your "quality of life."