Yup, I feel the same way. I recently got my driver's license again, I let it lapse a couple of years back. Almost everyone is speeding. I don't even like being a passenger in a car because the driver will be speeding, talking on the phone, etc.. I also notice everyone is driving too close to the car in front of them. I didn't notice this when I only biked or before I gave up my license.
When I drive now, I never go above the speed limit. Cars behind me will start to tailgate. It doesn't matter what the weather is like. It could be raining, foggy and everyone is going faster than the speed limit or tailgating me. I hate driving. It does make me nervous to drive now.