I just wear lycra under normal shorts. Works great.

edit: right, you said something loose. So obviously you're going for feel as well as appearance. Personally I don't mind tight lycra. To each his own. But I know that specialty shorts are made with padding.