You know I was thinking about this more and I think the problem might be that my pedals are weighted the wrong way. I didn't think they were weighted when I got them, but now that the bearings are broken in I definitely think they rest with the cleated side down.
Does anyone know where I can get info on which way various single sided pedals are weighted?