What is your starting point? Answers depend on that reply.
I think you could find a good ride into Pagosa. From Taos on Highway 64 into Chama is delightful. 64 is rather remote. You can get food/drink/lodging at Tierra Amarilla. The Chili Line Depot has homemade apple pine nut pie! Then it's a big push into Chama, which I find to be a charming town that meets all of my needs. There's even a steam engine train to Antonito. They do not take bicycles, but it would be a fun excursion. From Chama, it's Highway 84 into Pagosa.
Another option would be Taos north to Antonito, CO, slip back over the border to Chama, and again Highway 84 to Pagosa. This route would have more services/traffic, and less climbing than the Highway 64 choice.
I find southwestern Colorado and northwestern New Mexico delightful riding. The mountains get in the way, sometimes there's only one road, and everyone is on it. Broadly speaking, roads have been widened where possible . Hwy 160 is a good example.
Riding Wolf Creek Pass is a nice feather in your cap. From a ride quality standpoint, I enjoy Cumbres and LaManga Passes, just south of Wolf Creek (on the aforementioned route through Antonito). A similar example is Monarch Pass on Highway 50 between Gunnison and Salida, CO. It has bragging rights, but I prefer Highway 114 just to the south. It is a much quieter ride. Saguache (saw-watch) is one of my favorite hidden gems.
The last time I rode CO /NM was in 2022. It was an enjoyable trip.