You don't have to, but I'd recommend at the very least doing a thorough sanding job first to level out any existing scratches, paint chips, etc and to give the primer a good surface to mate to. Yes, primer, more important than anything, use primer and wetsanding to even out the surface and give your color the best possible surface to adhere to.