I'm in the same boat as you. I actually just got my first real mountain bike in 20 years.
I only have bibs. I did order some sale baggies but the bibs with plain ol shorts seem fine.
I think the dropper may have been invented partially to allow one to wear casual looking clothes. When I'm way behind my seat, there is a little fear I'll get stuck there. Less fear though when I'm dressed like a roadie.