I agree that we may not be able to help, because comfort is so personal. I hate riding in jeans, even for a short distance, because they squeeze me. I don't even like other trousers on the bike. If I must wear something below the knee, I prefer cycling tights. But dress trousers are good enough for me. I don't have chafing or problems with seams or saddle sores.

For above the waist, I'm not so picky. Lately I'm commuting in a shirt and tie which I thought would be a problem, but it isn't.

Start your commute, and try to pay attention to the points of discomfort. Then you can solve the problems that arise.