Thanks for the tip. Loosening the chain tension is the first thing I tried after tightening the BB. It didn't fixed the issue but it slowered the rate at which the BB unscrews. I think the tension now is pretty reasonable, I set the lightest tension it is pleasant to ride.