"You could drive a car with your feet if you wanted to, but that doesn't make it a good idea."

Lube + torque wrench is the only proper way.

As for the original question, no I never ever worry about this. It doesn't take much pressure for it to be solidly engaged. By hand one is way more likely to over tighten and strip than under tighten.