Sounds like your karma was off. Even if you hadn't run into that group, it sounds like you just didn't feel right. That happens, some days, everything is just off. Keep that in mind and don't give up riding the trail.
I'm lucky. When I lived in the metro D.C. area, I didn't feel comfortable riding the streets so I limited myself to trail riding. Now I live in the Northern Rockies, in the middle of a 2.2 million acre national forest. I've got scenic views and lightly-traveled forest roads all around me. I'm having great fun riding now that I've got power assist on my mountain bike to help me with the steep hills.
Also, drivers here are much more mellow and actually smile and wave at cyclists. Urban areas have just become too crowded and everyone has a bad attitude too much of the time. I don't miss that part of city living at all.
Here are a couple of photos of the type of roads I'm on everyday. (I do need to stay alert to wildlife that bound out into the road.)
