Yeah, the little nut is just for secondary security.

I usually put a little drop of blue Loctite on the threads to keep the screw from coming out and leave the nut off.