I've been to la belle province several times, and in the more rural areas french is the only language spoken. Like most english speaking canucks, what little french I know is from the back of the cereal box so, yeah, there is a bit of inconvenience.
But so what? One of the great pleasures of travel is meeting and interacting with people from different cultures, and one of the defining aspects of culture is language. It can be fun to try to speak the local language and generally people react in a friendly way if you do so. Shouting in english, not so much.