When I go for a big load of groceries, I go to a more distant store, but it is a store that is uphill all the way there, and so down hill all the way home (loaded).
Also, take along a collapsable cooler or similar to put milk and other stuff that needs to stay cool inside of. That way you don't have to rush home.