Oh, you must be referring to the Papa Tom Museum.

(Actually, I haven't been on the northern section in a couple of weeks, so I don't know what building you are referring to. Also, none of the path is dirt anymore. You may have caught a section of the Greenbelt Mountain Bike Trail.)