That same issue (driving to ride) is what led me to the mountain bike because there are plenty of new and interesting places right out my back door. I think you need to move, so the hills you want to conquer are close enough.
Either that or do what suits you (drive and ride where you like is my serious response). And yes, I also have problems with certain hills, which I expect to be severely aggravated by my most recent purchase.
__________________
It's all downhill from here. Except the parts that are uphill.