I don't know how the golf courses are where you live but they are horribly crowded around here. At some courses you have to get up at the crack of early just to call and make a reservation. Unless you are playing at some fancy (meaning expensive) country club you have to deal with crowded golf courses. Many courses will stick 5 guys to a group and many times you'll be standing around waiting as the groups bunch up behind a slow player.
Yeah, I'd much rather ride. Cycling is much much better physically too.