I sorta have the same problem....an "early" ride for me is like 10 a.m....and all the Cat 5 races around here seem to start at like 8 a.m., which sucks.
Oddly enough, when I was in my teens, I used to LIVE for 4 a.m. rides when there was nobody else out on the roads. Maybe I should start doing those again this summer.
__________________
2016 Trek 520 (54cm) touring bike for sale - never ridden. Message me for photos/details.