Riding with a cell phone is no worse than riding with music/radio in the ears, IMO. Or riding with a handbag hanging from the handlebar.
When you ride, RIDE, don't do anything else. Simple as that. If you do, expect angry looks from other people, as you almost universally will be unable to be a good and safe rider at the same time.