Call me crazy if you will, but I just, you know, pull my phone out of my pocket and answer it.
On a real bike ride I keep my phone in my saddle bag and check it after it has rung If and when I feel like pulling over. I don't like keeping too much crap in my jersey pockets.