You'll occasionally get some attitude, but you can get around that by letting them know you're American. Most of the hardcore french-speakers don't have a problem with speaking english, they have a problem with Quebecers speaking english.

Unless, as has been mentioned, you're in the country-side. Then it's no different than visiting any other non-english-speaking country. I've never gotten any real attitude from anyone in the rural areas.