From my recent experience:

Grease everything with threads, look up info on exactly what to grease.
Lube certain things like your chain. Also check your chain tension.

Might have to install/tighten your pedals, should be done with a pedal wrench.

Get your wheels looked at, see if they spin true.

Some of these should be done before seriously riding.