You could zip tie the handles to the racks. I've never felt I needed to do that but its an easy option.