Higher speed limits = less reaction time + more injuries. So your worries are not unfounded. However chances of being smacked into are still extremely low.