Zippy, some of those in your first location could be MTB'ers heading up Coal Canyon.
I've also seen reports of people parking here Off 71 Parking and staying north of the tracks and river to get to CHSP.
Apparently it's where fisherman park as well.