In some situations I've locked my bike, taken my valuables and left the panniers on the bike and simply tried to not leave it out of sight for too long. I've never had a problem with theft, but I know it can happen.