One possibility is a cracked frame. Your weight or exertion could open the crack and cause deformation of the frame. As a result, brakes could rub.