I'd do both: remove the fasteners, clean 'em with a rag, put a dab of grease on 'em (on the threads and on the underside of the 'cap'), then re-tighten 'em by hand.
Referring to the "cap," mooncake wrote
What is that???
Sorry. I should have done a better job of explaining it. Take a look at the attached picture. You have the threaded part, then you have the fatter part that you put the hex wrench into. That fatter part is what I'm calling the "cap."
When you grease a fastener before inserting and tightening it, you should grease the threads and the underside of the 'cap.'
Does that make it clearer?
Others are right, by the way: it may or may not be your cleats. Squeaks are tough to isolate. You have to start somewhere, though....