For on the bike, I've heard good things about the Panasonic Lumix with Zeiss optics. It gives real good results for a P&S. For off the bike, I've heard good things about the Canon Rebel Xti. That might be a little outdated, though. I think the the T3i is it's successor. Can anyone confirm?
My camera knowledge is a little behind the times right now.