You would actually be more comfortable 100 % of the time. There would be a slight weight increase sure, but your rolling resistance might also go down overall.

It is a complicated topic but I've been starting to lean on using as wide tires as I can possibly fit with mudguards which are also supple + comfortable. I don't really feel the downsides are at all relevant in the context of touring but there are multiple upsides.

But just to make a few downside observations:
- Wider tires obviously weigh more. A 35mm Continental Terra Speed weighs around 400 grams whereas the 45mm model weighs 535 grams, so for 10mm increase in width there's a 135 gram difference per tire which equals 270 grams total for both tires. Not a big difference in the context of touring, especially when a 45mm is starting to be the max for mudguards.
- One would assume a wider tire is less aerodynamic but apparently it actually depends. CdA does have that element of Cd. But in a general sense wider tire are typically less aerodynamic than narrower tires. Also not all that relevant in the context of touring.

But as upsides:
- Wider tires are less prone to puncture as there's less overall surface pressure per area on the tire against the ground.
- In tubeless use sealing punctures is easier because the tire pressure is lower.
- Wider tires are more comfortable because, well again the pressures are lower. That however doesn't yet explain stuff because a wider tire at the same pressure is much harder than a narrower tire so a wider tire at a lower pressure can be as hard as a narrower tire. What's really happening is that the surface tension of a wider tire is the same as that of a narrower tire at a lower pressure. A fatbike tire is rock hard at 1bar but a 23mm tire can't be ridden at 1 bar.
However you can run the wider tire at the same surface tension and still get a more comfy ride. There's more compressible air in a wider tire and there's more space for the tire to deform / soak up bumps.
-Wider tires have lower rolling resistance. At least at the same surface tension. This doesn't show up on drum test data because a drum test doesn't account for suspension losses caused by the rider. All vibration that gets transmitted to the rider which then jiggles the rider around slows down the bike. Therefore in order to reduce rider induced suspension losses, one must reduce vibrations. This is something I suspect but don't know for certain but I think wider tires also have a higher tolerance for the break point of rolling resistance, ie. the point where raising tire pressure begins to increase rolling resistance. Or perhaps the break point rolling resistance increase isn't as massively rapid as it is with narrow road tires. If I ever do buy a power meter I'll start testing this stuff because it's just so dang interesting.

There is of course a limit at some point where a wider tire becomes slower due to width, but with the oncoming new data and professional racing tire widths getting wider and wider, I don't think we've found that point yet. And that point in question is dicated by road / trail surface and system weight. My fatbike tires aren't fast on road no matter what pressure they are. However my road tires are unrideable on techincal trails.