Looks like the clear coat is shot. I'd remove what's left and re-clear it if that's the case.

Try using a nice microfiber cloth and a polishing compound like Meguiars Ultimate Polish or Mothers. I wouldnt worry too much about damaging the finish if you polish by hand. It's next to impossible to take off or damage the clear by hand polishing.