I have 32H Mavic CXP rims with LX hubs on my LHT. So far they have held up fine even on some rough roads in Baja and some dirt tracks. I weigh 160lbs and try to keep my load fairly light.
If I was going on an around the world tour I'd build up some really tough wheels, but if your touring is likely to be only a week or two a year and you don't carry a silly amount of gear you should be fine.
Just make sure your wheels are well built and tensioned.