Don’t know what led you to believe the GAP is paved in that area.
I can say that the Fairfield Inn there is really nice. Stayed there in 2020. You can literally ride up to the door from the C&O. (It’s located just beyond where the GAP meets the C&O.). Very bike friendly. You can take your bike in your room. It even had a laundry room. During the pandemic, the pool was closed, and there was no usual breakfast, but they gave you a sack breakfast to take with you.
Unfortunately, I was there on a Monday, so The Crabby Pig (along with many of the independent restaurants in town) was closed. Walked a ways and got good Mexican.