I was about to start sanding down the seam of the rim and I discovered that the right brake pad was not at the center of the width of the rim. I have re-adjusted it and all vibrations are now gone.
I am not sure now if it has moved after miles of use, or it was like that since day 0.