Snug-ish. I buy about the same size that I use for shirts. An XL jersey will be more snug than an XL souvenir T-shirt, but that's because t-shirts are inherently cut a bit looser than a bike jersey.

Just as important, probably, is the length, so that you don't show your crack (less of an issue with bibs than shorts, but still...).