You are not being over fussy imho, I went through the same procedure when I got my road bike, it took a while but I finally got it just right, I would ride for half an hour or so and then adjust by ~2mm.
[B]TIP when you get it right mark it with a permanent marker or (cringe) scratch a mark around the post.