Lycra is made to be 'skintight', not 'brief-tight', so keep briefs and lycra separate.
That said, I haven't pulled on the lycra in a year and a half, been rolling in work clothes or casual shorts -- with the briefs beneath 'em. No commando there, I'd rather not crush the jewelry between the pistons.