This is the trick I was taught for safely looking back:

Place your left hand on your hip and keep you right hand on the handlebar. Turn you upper body and head to the left and look back over your shoulder.

Doing this seems to prevent me from drifting off course while looking backwards.