Never mind, it has to be the freewheel rattling. Just flipped it over and took it for a spin and the noise was gone.