Hmmm... Seems putting my stock pedals back on removed the clunk. Which means its either an issue with the pedals, or how I put them on. Maybe I didn't tighten them enough.