I have ridden Big Sur North to South three times during different tours; I have never had a problem.

1) I traveled North to South during the week in late summer.
2) I made sure I was visible in shaded areas or near walls (yes, I sometimes wave at cars in a polite fashion.)
3) I pulled off the road to let RVs pass if they were slowly creeping up behind me and reluctant to pass.

The ocean side (west side) of the road has larger margins and areas to pull off the road if needed. The East side is much tighter and more dangerous in my opinion. But again, I have never ridden the east side except to double back and pick up stragglers. I have found Big Sur to be some of the safest and most scenic riding during my tours. Once you get near Malibu, everything seems to get crazy.

Avoid hugging the rock walls in tight areas, swinging out to be seen is good as long as you are ready to swing in if necessary!