In normal English, a "privilege" often refers to something that is granted on sufferance and can be revoked at any time; in this sense it has a different meaning from right.
In legal usage, "privilege" and "right" are basically synonymous - i.e., doctor-patient privilege; attorney-client privilege; the privilege against self incrimination.