I don't worry about it in town. I figure there's enough people around, someone will eventually call 911 and they'll call my wife when they find my cell phone or ID.
I normally run Strava or RidewithGPS on my phone on local country rides, and share it with my wife. I'm gradually training her not to hit the panic button. First ride with Strava (I think it was) I stopped for a snack, sitting by the river on a park bench. And had to answer the phone to tell her what I was doing, because my icon on her map was spinning around in circles.
It's a security blanket, or a bit of security theater, for her. When I go out of cell range, well, don't expect either a map update or an incident report!