I'm gonna presume that's more important for loads over 25 lbs or so. I'm sure some commuters haul that much to and fro but I'd advise against it if at all possible.

I've had big loads up high and back and yeah, it gets squirrelly. Had to kiss the stem to get reasonable front wheel response.