Before you take all the above advice, it is pertinent to ask what you are specifically trying to record.
If recording for evidence if you are hit, mount it under your seat pointed backwards. If you are trying to record a group ride or race, I'd probably want it always facing forward on the handlebars. If touring or trying to get scenery, it is far easier if it is on your head.