Trailers work fine. The biggest risk is succumbing to the temptation to load them to capacity. Make a weight budget and stick to it.
The downside? The trailer is going to be a bit heavier than panniers and the racks they require. You have to carry a unique spare tube for the trailer.
I have a BOB that I use for backcountry primitive roads in Big Bend National Park every year. It works fine. If you plan to ride very steep rough roads, one disadvantage of the trailer is that the trailer weight sits behind the bike and does not help with rear wheel traction when you are trying to climb a loose rocky hill. But, if you ride on pavement, you'll never care about that.