Higher inflation does not necessarily mean less rolling resistance. You don't have to beat yourself up on rough surfaces to get best performance. At least, not if you're rolling on 40mm tires and weigh less than a lot. I've backed off on pressures after reading about this recently - hasn't slowed me down and feels smoother. (Sorry; no hard data.)
__________________
Bacchetta Giro A20, RANS V-Rex, RANS Screamer