With jeans, I have a 34" waist, 32" inseam, I'm about 6'1".
I wear a large RS bib knicker, fit great.
They are made of very stretchy, gauze-like fabric. They may very well stretch enough for a 36" waist.. no offense.
How long is your inseam? With my 32" jeans inseam, I couldn't imagine wearing the XL's as the crotch would be too low. That's one thing you have to watch with upsizing is the length and proportions.
IMO, try the Large or order both L and XL and return whatever doesn't fit.