Yeah I get that too once in awhile. I can see why some people would think that, since riding a bike along a major roadway with multi-ton vehicles traveling at 30-50 MPH while dodging potholes and debris and objects thrown from cars is not exactly what I call a low risk situation. But to me it is a calculated risk that I am willing to take.
What I think people are telling you is that they think riding to work is dangerous, not riding a bike per se. I would not let my kid ride to school any more than a few miles but I would certainly let him ride in our neighborhood or with me somewhere. I don't think that's hypocricy at all, it's more like making a choice that's right for your situation.
-BT