What you did. Maybe just the slow hand signal. I cruise comfortable speed and don't try and speed up. Such a driver is not going to notice the difference nor care between 22, 25 or 28.
The morons would be able to pass sooner and easier if they didn't tailgate.
Fortunately as you note it is very rare. It's been well over a year since this happened to me.