I don't have any physical impediment preventing me from looking back.

A two second glance to the rear at 20 mph is a distance of 60 feet one has their eyes off the road ahead of them.
Most safety experts recommend a mirror check every 5 to 8 seconds, and that's for motor vehicle operators where speed differentials are far less.