These people living along that road in their very expensive real estate are responsible for that stretch of road--I am surprised that no legal action were ever taken or any accident ever happened due to the terrible condition!
I don't think some of the locals appreciate cyclists: There used to be a hand painted sign on the fence along the road prohibiting bikes with some regulation number--that fence came down a year or two ago!