I've been in a similar situation, stopped alongside diagonal parking. At some point I started slapping the sheet metal or window of cars in they get too close.
It has gotten me yelled at a few times, and an apology at least once. Either way it gets the attention of the driver very fast as it sounds like they hit something. As far as I'm concerned if I can reach the vehicle with my out stretched hand the car is too close anyway.