I have a 40 inch waist and I like the fit of PI Elite shorts. Lots of room in the 2XL size but on the pricey side. Watch for sales at Nashbar or Performance.
A friend who is larger than I am got some Hincapie shorts on Bonktown and he is happy with them. You never know what Bonktown will have.