I live and ride in the area, but I struggle to keep up with C rides so I don't think it would be a good match.
Have you tried Morris Area Freewheelers (mafw.org)? When the weather is good, there are a bazillion rides posted there, with a wide variety of pace, terrain, distance, and start time. Even if there is nothing good, you can sign up to be a ride leader (if you are an experienced rider) then schedule your own rides. People will usually show up.
Also, do you ever head west into Hunterdon and Warren Counties? The roads there are much less congested and thus safer (not to mention that many of them are beautiful).