Because digital = shallow, incomplete sound reproduction compared to analog/vinyl. ... But I have had the privilege of sitting in some incredible sound rooms to hear the vinyl and CD versions of the same recordings (classical, jazz, rock) played though absolutely top-end turntables and CD players that were in turn connected to exactly the same amps, pre-amps, cables, speakers and whatever else . ... Without exception, the records sounded better.
I cannot argue against the fact that this is your experience, but as someone who has been a maniacal follower of this issue for going on 25 years, my personal assessment is this: despite the initial, restrictive bandwidth of the "Red Book" CD, the current state remains that one is not better than the other.
Red Book digital and the analog vinyl are just different. If the equipment is equal to the task, each reproduction has its respective, ascendent characteristics. The same thing that you described as being what you heard from vinyl is the same thing I can produce from my Red Book rig. My vinyl stuff comes out similarly, but with a different character. But I will admit that it took years of work, study and DIY effort to get the results on a very restrictive budget.
The same sort of argument has been thrashed to death in regards to vacuum tube and solid state amplification. In the end, each listener has to please him/her self — music reproduction is just that subjective.