I wouldn't be worried one bit about this driver. They know you, they see you and they pass consistently. (If every driver could be counted on doing this most cyclist-driver communication and 'take the lane' positioning would not be needed anymore.) I also don't think you could argue that they are not giving safe passing clearance as required by law - especially as several states have set the standard minimum at less than you are getting.
Al