Road bikes are pretty rugged. Worry less, ride more.
If you actually crash, or it has a hard fall on the drive side, then you need to make sure the rear derailleur hanger is not bent inwards. If it is, you risk shifting the derailleur into the spokes. That can be a bummer, so I have heard.